Abstract:The growing popularity of big data analysis and cloud computing has created new big data management standards. Sometimes, programmers may interact with a number of heterogeneous data stores depending on the information they are responsible for: SQL and NoSQL data stores. Interacting with heterogeneous data models via numerous APIs and query languages imposes challenging tasks on multi-data processing developers. Indeed, complex queries concerning homogenous data structures cannot currently be performed in a declarative manner when found in single data storage applications and therefore require additional development efforts. Many models were presented in order to address complex queries Via multistore applications. Some of these models implemented a complex unified and fast model, while others' efficiency is not good enough to solve this type of complex database queries. This paper provides an automated, fast and easy unified architecture to solve simple and complex SQL and NoSQL queries over heterogeneous data stores (CQNS). This proposed framework can be used in cloud environments or for any big data application to automatically help developers to manage basic and complicated database queries. CQNS consists of three layers: matching selector layer, processing layer, and query execution layer. The matching selector layer is the heart of this architecture in which five of the user queries are examined if they are matched with another five queries stored in a single engine stored in the architecture library. This is achieved through a proposed algorithm that directs the query to the right SQL or NoSQL database engine. Furthermore, CQNS deal with many NoSQL Databases like MongoDB, Cassandra, Riak, CouchDB, and NOE4J databases. This paper presents a spark framework that can handle both SQL and NoSQL Databases. Four scenarios' benchmarks datasets are used to evaluate the proposed CQNS for querying different NoSQL Databases in terms of optimization process performance and query execution time. The results show that, the CQNS achieves best latency and throughput in less time among the compared systems.

Big Data, Big Decisions Choosing the Right Database

Can the Elephants Handle the NoSQL Onslaught?

From Relational Databases to NoSQL Databases: Performance Evaluation

SQL and NoSQL Databases Software architectures performance analysis and assessments -- A Systematic Literature review

NoSQL Database: New Era of Databases for Big data Analytics - Classification, Characteristics and Comparison

Comparative Study Between the MySQL Relational Database and the MongoDB NoSQL Database

NewSQL: Towards Next-Generation Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management

NoSQL Databases: Yearning for Disambiguation

A Comparative Study of MongoDB and Document-Based MySQL for Big Data Application Data Management

Performance analysis of NoSQL and relational databases with MongoDB and MySQL

An Extended Classification and Comparison of NoSQL Big Data Models

Storage Solutions for Big Data Systems: A Qualitative Study and Comparison

Utilizing a NoSQL Data Store for Scalable Log Analysis

A comparative study: MongoDB vs. MySQL

The Practice of Moving to Big Data on the Case of the NoSQL Database, Clickhouse

Performance Analysis of NoSQL and Relational Databases with CouchDB and MySQL for Application’s Data Storage

Evaluating NoSQL Databases for OLAP Workloads: A Benchmarking Study of MongoDB, Redis, Kudu and ArangoDB

Scalability and Performance Evaluation of NewSQL and Relational Databases: A Comparative Benchmark Study

An adaptive spark-based framework for querying large-scale NoSQL and relational databases

Automatic NoSQL to Relational Database Transformation with Dynamic Schema Mapping

An Analysis of the Performance and Configuration Features of MySQL Document Store and Elasticsearch as an Alternative Backend in a Data Replication Solution