Abstract:Transaction processing performance council benchmark C (TPC-C) is the de facto standard for evaluating the performance of high-end computers running on-line transaction processing applications. Differing from other standard benchmarks, the transaction processing performance council only defines specifications for the TPC-C benchmark, but does not provide any standard implementation for end-users. Due to the complexity of the TPC-C workload, it is a challenging task to obtain optimal performance for TPC-C evaluation on a large-scale high-end computer. In this paper, we designed and implemented a large-scale TPC-C evaluation system based on the latest TPC-C specification using solid-state drive (SSD) storage devices. By analyzing the characteristics of the TPC-C workload, we propose a series of system-level optimization methods to improve the TPC-C performance. First, we propose an approach based on SmallFile table space to organize the test data in a round-robin method on all of the disk array partitions; this can make full use of the underlying disk arrays. Second, we propose using a NOOP-based disk scheduling algorithm to reduce the utilization rate of processors and improve the average input/output service time. Third, to improve the system translation lookaside buffer hit rate and reduce the processor overhead, we take advantage of the huge page technique to manage a large amount of memory resources. Lastly, we propose a locality-aware interrupt mapping strategy based on the asymmetry characteristic of non-uniform memory access systems to improve the system performance. Using these optimization methods, we performed the TPC-C test on two large-scale high-end computers using SSD arrays. The experimental results show that our methods can effectively improve the TPC-C performance. For example, the performance of the TPC-C test on an Intel Westmere server reached 1.018 million transactions per minute.

Synthesizing Representative I/O Workloads for TPC-H

WPC: Whole-Picture Workload Characterization Across Intermediate Representation, ISA, and Microarchitecture

LTF: A Model-Based Load Testing Framework for Web Applications

Characterizing and Optimizing TPC-C Workloads on Large-Scale Systems Using SSD Arrays

Lauca: A Workload Duplicator for Benchmarking Transactional Database Performance

Characterizing TPC-H on a Clustered Database Engine from the OS Perspective

24/7 Characterization of petascale I/O workloads

Characterization and Architectural Implications of Big Data Workloads

Automatic Generation of Benchmarks for I/O-intensive Parallel Applications.

Automated HPC Workload Generation Combining Statistical Modeling and Autoregressive Analysis.

Why TPC is Not Enough: An Analysis of the Amazon Redshift Fleet

HyBench: A New Benchmark for HTAP Databases.

Understanding Big Data Analytic Workloads on Modern Processors

IoTDataBench: Extending TPCx-IoT for Compression and Scalability

Workload Characterization on A Cloud Platform: an Early Experience

Performance models and dynamic characteristics analysis for HDFS write and read operations: A systematic view.

I/O Bottleneck Detection and Tuning: Connecting the Dots using Interactive Log Analysis

A Synthetic Bursty Workload Generation Method For Web 2.0 Benchmark

Characterizing and Subsetting Big Data Workloads

Study on Workload-aware Tuning Methods of Storage Subsystem

Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads