Abstract:As the complexity of enterprise systems increases, the need for monitoring and analyzing such systems also grows. A number of companies have built sophisticated monitoring tools that go far beyond simple resource utilization reports. For example, based on instrumentation and specialized APIs, it is now possible to monitor single method invocations and trace individual transactions across geographically distributed systems. This high-level of detail enables more precise forms of analysis and prediction but comes at the price of high data rates (i.e., big data). To maximize the benefit of data monitoring, the data has to be stored for an extended period of time for ulterior analysis. This new wave of big data analytics imposes new challenges especially for the application performance monitoring systems. The monitoring data has to be stored in a system that can sustain the high data rates and at the same time enable an up-to-date view of the underlying infrastructure. With the advent of modern key-value stores, a variety of data storage systems have emerged that are built with a focus on scalability and high data rates as predominant in this monitoring use case. In this work, we present our experience and a comprehensive performance evaluation of six modern (open-source) data stores in the context of application performance monitoring as part of CA Technologies initiative. We evaluated these systems with data and workloads that can be found in application performance monitoring, as well as, on-line advertisement, power monitoring, and many other use cases. We present our insights not only as performance results but also as lessons learned and our experience relating to the setup and configuration complexity of these data stores in an industry setting.

Real-time analytical processing with SQL server

Enhancing Analytical Select Statements Using Reference Aliases

R-Store: A scalable distributed system for supporting real-time analytics

Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP

Fast Updates on Read-Optimized Databases Using Multi-Core CPUs

Accelerating Relational Database Analytical Processing with Bulk-Bitwise Processing-in-Memory

Plsm: A Highly Efficient LSM-Tree Index Supporting Real-Time Big Data Analysis

Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical Processing

Reducing the Storage Overhead of Main-Memory OLTP Databases with Hybrid Indexes

Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last

Transaction Time Indexing with Version Compression

Exploiting Intel Optane SSD for Microsoft SQL Server

SAP HANA and its performance benefits

HTAP Databases: A Survey

Solving Big Data Challenges for Enterprise Application Performance Management

Supporting Real-Time Analytic Queries In Big And Fast Data Environments

Agile Query Processing in Statistical Databases: A Process-In-Memory Approach.

Micro-architectural Analysis of OLAP: Limitations and Opportunities

One SQL to Rule Them All

Architectural Impact on Performance of In-memory Data Analytics: Apache Spark Case Study

A survey on hybrid transactional and analytical processing