Abstract:The commercial availability of Intel’s Haswell processor suggests that hardware transactional memory (HTM), a technique inspired by database transactions, is likely to be widely exploited for in-memory databases in the near future. Its features such as hardware-maintained read/write sets and automatic conflict detection naturally put forward a challenge on how HTM can successfully support concurrency control for fast in-memory transaction processing. To answer this challenge, we first conduct a detailed analysis on solely using HTM to protect a database transaction without other concurrency controls such as OCC or 2PL. Our analysis reveals that such an approach may lead to scalability issues due to the high probability of aborting transactions. To reduce HTM-protected transaction regions, we propose to leverage the theory of transaction chopping with several workload-inspired optimizations, including recovering commutativity with deferred execution and a database cache for database operations, to reduce HTM aborts while preserving serializability. While transaction chopping effectively reduces HTM aborts due to memory access conflicts, it also creates a new challenge for read-only transactions, which can no longer observe a consistent database snapshot. To address this problem, we propose a lazy snapshot mechanism that constructs a database snapshot during execution which eventually becomes consistent. We implement the proposed techniques in DBX-TC on an Intel Haswell processor and conduct an extensive performance study. Performance evaluation shows that DBX-TC with our mechanisms outperforms a naively constructed database using HTM by 4.77x and 36% over DBX on a 4-core/8threads machine. The speedup is especially significant under high contention.

Accelerating Hybrid Transactional/Analytical Processing Using Consistent Dual-Snapshot

A survey on hybrid transactional and analytical processing

HTAP Databases: What is New and What is Next

Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical Processing

HTAP Databases: A Survey

Enabling High-Performance and Energy-Efficient Hybrid Transactional/Analytical Databases with Hardware/Software Cooperation

A Lightweight General Adaptive Optimization Tool for Relational DBMSs under HTAP Workloads

HyBench: A New Benchmark for HTAP Databases.

Polynesia: Enabling Effective Hybrid Transactional/Analytical Databases with Specialized Hardware/Software Co-Design

Iterative Query Processing based on Unified Optimization Techniques

Bridging the Gap between Relational OLTP and Graph-based OLAP.

Near-data processing in database systems on native computational storage under HTAP workloads

PolarDB-IMCI: A Cloud-Native HTAP Database System at Alibaba.

Exploiting Hardware Transactional Memory for Efficient In-Memory Transaction Processing

Towards a Non-2PC Transaction Management in Distributed Database Systems

Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP

Webtp: A Case Study of Web Transaction Processing

Fast In-Memory Transaction Processing Using Rdma and Htm

The AHA-Tree: An Adaptive Index for HTAP Workloads

A novel agent-based parallel ETL system for massive data

Extracting More Intra-Transaction Parallelism With Work Stealing For Oltp Workloads