how to compare the performance of DBMS between two versions?
Today, my manager ask me test performance of the same DBMS's different version. I have no idea how to do that. I want do as below:
1. create same structure database;
2. using the DBMS's query tool insert,upate and select from the same table;
3.when I perform sql as mentioned up, I record the time of they cost;
4. then I get the result, less time cost better performance.
Is it right? someone can give me advice? thanks in advance.
Re: how to compare the performance of DBMS between two versions?
Note that you can often have more than one version of database running at once. What DB are you using? Here are some thought on the issue:
With performance testing it is important to use as close to identical emvironments for the two test runs. It's also worth running the test numerious times to get an average if the load on a machine is varying. It also highlights any caching issues (running a query the 2nd time may use some sort of caching and could be quicker).
Might also be useful to run tests as batch jobs over night while the load is lower on a machine (in an ideal world you would have a dedicated benchmark machine).
UNIX command like "time" can be useful which give user and system times as well as actual time.