A performance comparison in a multi-threaded environment

PDF download

Fikret Hasovic, November 2021

This revised performance comparison was written following a detailed discussion with the Firebird core team. You can refer to reasons for this and the changes made to IBExpert Benchmark Tool here: https://ibexpert.net/x/i.x?BenchmarkResults.

In Part 2 of the Firebird Performance series of benchmarks, we are utilizing the free IBExpert Benchmark Tool version 2.0 (https://ibexpert.net/x/i.x?FreeBenchmarkTool). The Benchmark tool is written as a multithread application and executes queries in 10 parallel running threads.

The IBExpert Benchmark tool is safe to run on your own system. The tool comes with its own Firebird engine so that there is no interference with your existing Firebird installation. Only the drive where the tool is installed will get tested.

How does it work?

Based on our demo database (https://ibexpert.net/x/i.x?DemoDB), which is created automatically, the standard benchmark, which is also included in the free IBExpert Benchmark Tool version 2.0, runs approximately 8 million operations (individual insert/update/delete/select statements) using 10 simultaneous processes in 2 runs on the demo database, created with different parameters to demonstrate the impact of the physical drive speed.

The extended benchmark, available in the full IBExpert Developer Studio customer version, uses 50 parallel processes simulating 50 concurrent users.

We have performed tests on both Linux and Windows on the same hardware, to see the influence of the OS on Firebird server performance.

The reference value of 100% in each category is defined by a server running Firebird 2.1 on a Windows server delivered to customers back in 2011. Our current 2021 IFS Servers are rated between 280% and 600%.

For example, a value of 200% means that it took half of the time or it performed twice as fast as the reference machine 10 years ago.

Note: higher % values are better.

The free IBExpert Benchmark Tool version 2.0 can only be used on Windows in standard mode. Linux tests and extended tests were performed using the IBExpert Developer Studio IDE full version, since it includes the Benchmark Tool without any limitations.

Linux IFS Server

These are results of standard reference benchmark, based on our reference (see above).

These are results of extended reference benchmark, based on our reference (see above).

Windows IFS Server

These are results of standard reference benchmark, based on our reference (see above).

These are results of extended reference benchmark, based on our reference (see above).

CPU and Drive test

Conclusion

All tests in this White Paper were performed on the same hardware with a SATA SSD for the OS and an NVMe SSD for the database, which is the standard hardware we use in our Basic IFS Servers. Our high-end IFSLR servers offer rather better performance, but are only distributed with Linux OS, and were therefore not used for these comparison performance tests.

There is no clear winner here, although Firebird 3 on Linux OS has some small advantage.

In the other hand, the Linux Operating System has a clear advantage over Windows, and Firebird 3 has some advantage in the CPU and Thread test, although Firebird 4 on Windows has a clear advantage on the Drive test.

If you would like to find out more about our high-performance dedicated Firebird servers, please contact ifs@ibexpert.biz.

back to top of page