Database management system performance comparisons: A systematic literature review

Toni Taipalus

DOI: https://doi.org/10.1016/j.jss.2023.111872

2023-11-27

Abstract:Efficiency has been a pivotal aspect of the software industry since its inception, as a system that serves the end-user fast, and the service provider cost-efficiently benefits all parties. A database management system (DBMS) is an integral part of effectively all software systems, and therefore it is logical that different studies have compared the performance of different DBMSs in hopes of finding the most efficient one. This study systematically synthesizes the results and approaches of studies that compare DBMS performance and provides recommendations for industry and research. The results show that performance is usually tested in a way that does not reflect real-world use cases, and that tests are typically reported in insufficient detail for replication or for drawing conclusions from the stated results.

Performance,Databases

What problem does this paper attempt to address?

The problems that this paper attempts to solve are some key issues in the performance comparison research of database management systems (DBMS). Specifically, through the method of systematic literature review, the author aims to solve the following problems:

1. **Limitations of test methods**: Existing performance tests are usually carried out in very specific situations, which may not necessarily reflect the actual usage. Therefore, the test results may not be widely applicable.

2. **Insufficient test details**: Many performance test reports lack sufficient details, making it difficult for other researchers to repeat the experiments or draw reliable conclusions from the existing results.

3. **Integrating existing research**: Through a systematic review of the existing literature, integrate and analyze the research results of different DBMS performance comparisons, and provide valuable reference information for the industry and academia.

4. **Providing improvement suggestions**: Based on the analysis of existing research, put forward suggestions for improving performance test methods, and point out other factors that should be considered in future research.

5. **Exploring new test directions**: Explore, in addition to traditional performance indicators, what other aspects can be used as new directions for DBMS performance tests to more comprehensively evaluate the advantages and disadvantages of DBMS.

In short, the main purpose of this paper is to reveal the problems existing in the current DBMS performance comparison through a systematic literature review, and to provide guidance and suggestions for future performance evaluation. This helps to ensure that performance tests are closer to actual application scenarios, thereby providing more reliable support for choosing the appropriate DBMS.