Abstract:With the advent of the big data era, the amounts of sampling data and the dimensions of data features are rapidly growing. It is highly desired to enable fast and efficient clustering of unlabeled samples based on feature similarities. As a fundamental primitive for data clustering, the k-means operation is receiving increasingly more attentions today. To achieve high performance k-means computations on modern multi-core/many-core systems, we propose a matrix-based fused framework that can achieve high performance by conducting computations on a distance matrix and at the same time can improve the memory reuse through the fusion of the distance-matrix computation and the nearest centroids reduction. We implement and optimize the parallel k-means algorithm on the SW26010 many-core processor, which is the major horsepower of Sunway TaihuLight. In particular, we design a task mapping strategy for load-balanced task distribution, a data sharing scheme to reduce the memory footprint and a register blocking strategy to increase the data locality. Optimization techniques such as instruction reordering and double buffering are further applied to improve the sustained performance. Discussions on block-size tuning and performance modeling are also presented. We show by experiments on both randomly generated and real-world datasets that our parallel implementation of k-means on SW26010 can sustain a double-precision performance of over 348.1 Gflops, which is 46.9% of the peak performance and 84% of the theoretical performance upper bound on a single core group, and can achieve a nearly ideal scalability to the whole SW26010 processor of four core groups. Performance comparisons with the previous state-of-the-art on both CPU and GPU are also provided to show the superiority of our optimized k-means kernel.

Large-Scale Automatic K-Means Clustering for Heterogeneous Many-Core Supercomputer

Large-Scale Hierarchical K-Means for Heterogeneous Many-Core Supercomputers

A Novel Kernel Possibitistic Fuzzy C-Means Clustering Algorithm For Large Scale Data Sets

Enabling Highly Efficient K -Means Computations on the SW26010 Many-Core Processor of Sunway TaihuLight

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Distributed Kernel K-Means for Large Scale Clustering

Using Multi-Core HW/SW Co-design Architecture for Accelerating K-means Clustering Algorithm

Full Lifecycle Data Analysis on a Large-scale and Leadership Supercomputer: What Can We Learn from It?

Superior Parallel Big Data Clustering through Competitive Stochastic Sample Size Optimization in Big-means

Subspace Clustering by Directly Solving Discriminative K-means

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

A multi-threaded particle swarm optimization-kmeans algorithm based on MapReduce

K*-Means: An Efficient Clustering Algorithm with Adaptive Decision Boundaries

Hierarchical K-means Method for Clustering Large-Scale Advanced Metering Infrastructure Data

High performance computing of DGDFT for tens of thousands of atoms using millions of cores on Sunway TaihuLight

A Reconfigurable 64-Dimension K-Means Clustering Accelerator with Adaptive Overflow Control

Enabling and Scaling the HPCG Benchmark on the Newest Generation Sunway Supercomputer with 42 Million Heterogeneous Cores

Enabling Large-Scale Simulation of CAM on the Sunway TaihuLight Supercomputer

Automatic Optimization of Parallel Parameters for Sunway TaihuLight Super-computer Application Program

Automatic determining optimal parameters in multi-kernel collaborative fuzzy clustering based on dimension constraint

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor