Abstract:Big data areas are expanding in a fast way in terms of increasing workloads and runtime systems, and this situation imposes a serious challenge to workload characterization, which is the foundation of innovative system and architecture design. The previous major efforts on big data benchmarking either propose a comprehensive but a large amount of workloads, or only select a few workloads according to so-called popularity, which may lead to partial or even biased observations. In this paper, on the basis of a comprehensive big data benchmark suite---BigDataBench, we reduced 77 workloads to 17 representative workloads from a micro-architectural perspective. On a typical state-of-practice platform---Intel Xeon E5645, we compare the representative big data workloads with SPECINT, SPECCFP, PARSEC, CloudSuite and HPCC. After a comprehensive workload characterization, we have the following observations. First, the big data workloads are data movement dominated computing with more branch operations, taking up to 92% percentage in terms of instruction mix, which places them in a different class from Desktop (SPEC CPU2006), CMP (PARSEC), HPC (HPCC) workloads. Second, corroborating the previous work, Hadoop and Spark based big data workloads have higher front-end stalls. Comparing with the traditional workloads i. e. PARSEC, the big data workloads have larger instructions footprint. But we also note that, in addition to varied instruction-level parallelism, there are significant disparities of front-end efficiencies among different big data workloads. Third, we found complex software stacks that fail to use state-of-practise processors efficiently are one of the main factors leading to high front-end stalls. For the same workloads, the L1I cache miss rates have one order of magnitude differences among diverse implementations with different software stacks.

A Comparative Survey of Big Data Computing and HPC: From a Parallel Programming Model to a Cluster Architecture

Optimization Factor Analysis Of Large-Scale Join Queries On Different Platforms

Introduction to Harp: when Big Data Meets HPC

Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

Computing infrastructure construction and optimization for high-performance computing and artificial intelligence

Survey of Distributed Computing Frameworks for Supporting Big Data Analysis

Analysis of Big Data Platform with OpenStack and Hadoop.

Typical Big Data Computing Frameworks

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Design and Implementation of the Tianhe-2 Data Storage and Management System

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

CLUSTER-BASED OCEAN REMOTE SENSING IMAGE FUSION PARALLEL COMPUTING STRATEGY

Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure

Full Lifecycle Data Analysis on a Large-scale and Leadership Supercomputer: What Can We Learn from It?

Characterization and Architectural Implications of Big Data Workloads

A Benchmarking Study to Evaluate Apache Spark on Large-Scale Supercomputers

Computational Performance Analysis of Cluster-based Technologies for Big Data Analytics

The Research of the Parallel Computing Development from the Angle of Cloud Computing

Infrastructure for Artificial Intelligence, Quantum and High Performance Computing

Big Data Analytics Using Cloud Computing Based Frameworks for Power Management Systems: Status, Constraints, and Future Recommendations