NewSQL: Towards Next-Generation Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management

A B M Moniruzzaman

DOI: https://doi.org/10.48550/arXiv.1411.7343

2014-11-27

Abstract:One of the key advances in resolving the big-data problem has been the emergence of an alternative database technology. Today, classic RDBMS are complemented by a rich set of alternative Data Management Systems (DMS) specially designed to handle the volume, variety, velocity and variability ofBig Data collections; these DMS include NoSQL, NewSQL and Search-based systems. NewSQL is a class of modern relational database management systems (RDBMS) that provide the same scalable performance of NoSQL systems for online transaction processing (OLTP) read-write workloads while still maintaining the ACID guarantees of a traditional database system. This paper discusses about NewSQL data management system; and compares with NoSQL and with traditional database system. This paper covers architecture, characteristics, classification of NewSQL databases for online transaction processing (OLTP) for Big data management. It also provides the list ofpopular NoSQL as well as NewSQL databases in separate categorized tables. This paper compares SQL based RDBMS, NoSQL and NewSQL databases with set of metrics; as well as, addressed some research issues ofNoSQL and NewSQL.

Databases

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the big data environment, neither traditional relational database management systems (RDBMS) nor NoSQL database systems can fully meet the requirements of online transaction processing (OLTP). Specifically:

- **Limitations of traditional RDBMS**: Traditional relational database management systems have performance bottlenecks when dealing with large - scale data sets, especially in cases where high - concurrent access and rapid response times are required. These systems usually rely on a single - machine architecture, making it difficult to achieve horizontal scaling and unable to effectively support OLTP requirements in the big data environment.

- **Limitations of NoSQL systems**: Although NoSQL databases have solved some big data management problems through distributed architectures and flexible data models, they sacrifice ACID (Atomicity, Consistency, Isolation, Durability) properties and instead adopt the BASE (Basically Available, Soft state, Eventually Consistent) principle. This makes NoSQL systems unsuitable for some application scenarios that require strong consistency.

To solve the above problems, the paper introduces the NewSQL database system, a new - generation relational database management system that aims to provide scalable performance comparable to that of NoSQL systems while retaining the ACID properties of traditional database systems. The NewSQL system achieves this goal in the following ways:

- **Distributed architecture**: The NewSQL system adopts a distributed architecture and can horizontally scale across multiple machines, improving the system's throughput and response speed.
- **High performance**: By optimizing query processing, concurrency control, and data storage techniques, the NewSQL system can provide efficient read - write performance while maintaining ACID properties.
- **Compatibility**: The NewSQL system supports the SQL language and can be seamlessly integrated into existing applications without requiring extensive modifications to existing applications.

In conclusion, through comparative analysis of traditional RDBMS, NoSQL, and NewSQL systems, this paper explores how the NewSQL system can become an ideal choice for OLTP applications in the big data environment.