Abstract:With the advent of the big data era, the amounts of sampling data and the dimensions of data features are rapidly growing. It is highly desired to enable fast and efficient clustering of unlabeled samples based on feature similarities. As a fundamental primitive for data clustering, the k-means operation is receiving increasingly more attentions today. To achieve high performance k-means computations on modern multi-core/many-core systems, we propose a matrix-based fused framework that can achieve high performance by conducting computations on a distance matrix and at the same time can improve the memory reuse through the fusion of the distance-matrix computation and the nearest centroids reduction. We implement and optimize the parallel k-means algorithm on the SW26010 many-core processor, which is the major horsepower of Sunway TaihuLight. In particular, we design a task mapping strategy for load-balanced task distribution, a data sharing scheme to reduce the memory footprint and a register blocking strategy to increase the data locality. Optimization techniques such as instruction reordering and double buffering are further applied to improve the sustained performance. Discussions on block-size tuning and performance modeling are also presented. We show by experiments on both randomly generated and real-world datasets that our parallel implementation of k-means on SW26010 can sustain a double-precision performance of over 348.1 Gflops, which is 46.9% of the peak performance and 84% of the theoretical performance upper bound on a single core group, and can achieve a nearly ideal scalability to the whole SW26010 processor of four core groups. Performance comparisons with the previous state-of-the-art on both CPU and GPU are also provided to show the superiority of our optimized k-means kernel.

Vectorized K-Means Algorithm on Heterogeneous CPU/MIC Architecture

Parallel Optimization Strategies for MIC Heterogeneous Parallel Systems

Enabling Highly Efficient K -Means Computations on the SW26010 Many-Core Processor of Sunway TaihuLight

MIC-THPCM: MIC-Based Heterogeneous Parallel Optimization for Axial Compressor Rotor

An Adaptive Algorithm of K-Means on Hsa Platform

MIC acceleration of short-range molecular dynamics simulations

Optimizing the MapReduce Framework for CPU-MIC Heterogeneous Cluster

Hybrid MIC/CPU Parallel Implementation of MoM on MIC Cluster for Electromagnetic Problems.

Realistic Performance Characterization of CFD Applications on Intel Many Integrated Core Architecture

Thread Mapping and Parallel Optimization for MIC Heterogeneous Parallel Systems.

A Parallel K-Means Clustering Algorithm with MPI

Parallelization and Optimization of Molecular Dynamics Simulation on Many Integrated Core

Scaling Support Vector Machines on Modern HPC Platforms

An Approach to Enhance the Performance of Large‐scale Structural Analysis on CPU‐MIC Heterogeneous Clusters

MIC-SVM: A Highly Efficient Support Vector Machine For Modern HPC Architectures

MIC-SVM: Designing a Highly Efficient Support Vector Machine for Advanced Modern Multi-core and Many-Core Architectures

Scalability of 3d Deterministic Particle Transport on the Intel Mic Architecture

Large-Scale Hierarchical K-Means for Heterogeneous Many-Core Supercomputers

Parallel 3D Deterministic Particle Transport on Intel MIC Architecture

Brief Announcement: MIC++: Accelerating Maximal Information Coefficient Calculation with GPUs and FPGAs.

Parallelized Implementation of an Explicit Finite Element Method in Many Integrated Core (MIC) Architecture