Abstract:Big data areas are expanding in a fast way in terms of increasing workloads and runtime systems, and this situation imposes a serious challenge to workload characterization, which is the foundation of innovative system and architecture design. The previous major efforts on big data benchmarking either propose a comprehensive but a large amount of workloads, or only select a few workloads according to so-called popularity, which may lead to partial or even biased observations. In this paper, on the basis of a comprehensive big data benchmark suite---BigDataBench, we reduced 77 workloads to 17 representative workloads from a micro-architectural perspective. On a typical state-of-practice platform---Intel Xeon E5645, we compare the representative big data workloads with SPECINT, SPECCFP, PARSEC, CloudSuite and HPCC. After a comprehensive workload characterization, we have the following observations. First, the big data workloads are data movement dominated computing with more branch operations, taking up to 92% percentage in terms of instruction mix, which places them in a different class from Desktop (SPEC CPU2006), CMP (PARSEC), HPC (HPCC) workloads. Second, corroborating the previous work, Hadoop and Spark based big data workloads have higher front-end stalls. Comparing with the traditional workloads i. e. PARSEC, the big data workloads have larger instructions footprint. But we also note that, in addition to varied instruction-level parallelism, there are significant disparities of front-end efficiencies among different big data workloads. Third, we found complex software stacks that fail to use state-of-practise processors efficiently are one of the main factors leading to high front-end stalls. For the same workloads, the L1I cache miss rates have one order of magnitude differences among diverse implementations with different software stacks.

Characterizing I/O Workloads of HPC Applications Through Online Analysis

WPC: Whole-Picture Workload Characterization Across Intermediate Representation, ISA, and Microarchitecture

24/7 Characterization of petascale I/O workloads

I/O Bottleneck Detection and Tuning: Connecting the Dots using Interactive Log Analysis

Workload Characterization on A Cloud Platform: an Early Experience

An End-to-end and Adaptive I/O Optimization Tool for Modern HPC Storage Systems

TraceTracker: Hardware/Software Co-Evaluation for Large-Scale I/O Workload Reconstruction

Characterization and Architectural Implications of Big Data Workloads

An Online Service-Oriented Performance Profiling Tool for Cloud Computing Systems

Synthesizing Representative I/O Workloads for TPC-H

P-Tracer: Path-Based Performance Profiling in Cloud Computing Systems

Characterizing the Performance of Emerging Deep Learning, Graph, and High Performance Computing Workloads Under Interference

IOmark:a high-accuracy performance testing tool for storage systems

Automatic, Application-Aware I/O Forwarding Resource Allocation

Capturing Periodic I/O Using Frequency Techniques

Lessons Learned from Optimizing the Sunway Storage System for Higher Application I/O Performance

Comprehending Performance from Real-World Execution Traces

Characterizing Job Microarchitectural Profiles at Scale: Dataset and Analysis

Diagnosing applications' I/O behavior through system call observability

Web-Oriented Visual Performance Analysis Tool for Hpc: Thptiii

End-to-end I/O Monitoring on Leading Supercomputers