Abstract:With the advent of the big data era, the amounts of sampling data and the dimensions of data features are rapidly growing. It is highly desired to enable fast and efficient clustering of unlabeled samples based on feature similarities. As a fundamental primitive for data clustering, the k-means operation is receiving increasingly more attentions today. To achieve high performance k-means computations on modern multi-core/many-core systems, we propose a matrix-based fused framework that can achieve high performance by conducting computations on a distance matrix and at the same time can improve the memory reuse through the fusion of the distance-matrix computation and the nearest centroids reduction. We implement and optimize the parallel k-means algorithm on the SW26010 many-core processor, which is the major horsepower of Sunway TaihuLight. In particular, we design a task mapping strategy for load-balanced task distribution, a data sharing scheme to reduce the memory footprint and a register blocking strategy to increase the data locality. Optimization techniques such as instruction reordering and double buffering are further applied to improve the sustained performance. Discussions on block-size tuning and performance modeling are also presented. We show by experiments on both randomly generated and real-world datasets that our parallel implementation of k-means on SW26010 can sustain a double-precision performance of over 348.1 Gflops, which is 46.9% of the peak performance and 84% of the theoretical performance upper bound on a single core group, and can achieve a nearly ideal scalability to the whole SW26010 processor of four core groups. Performance comparisons with the previous state-of-the-art on both CPU and GPU are also provided to show the superiority of our optimized k-means kernel.

Enabling Highly Efficient Batched Matrix Multiplications on SW26010 Many-core Processor.

Towards Highly Efficient DGEMM on the Emerging SW26010 Many-Core Processor

Implementation and optimization of SpMV algorithm based on SW26010P many-core processor and stored in BCSR format

Superblock-based performance optimization for Sunway Math Library on SW26010 many-core processor

Method for realizing heterogeneous many-core of sparse matrix-vector multiplication based on domestic SW26010 processors

Enabling Highly Efficient K -Means Computations on the SW26010 Many-Core Processor of Sunway TaihuLight

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Accelerating Sparse Cholesky Factorization on Sunway Manycore Architecture.

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor

A Fast Sparse Triangular Solver for Structured-grid Problems on Sunway Many-core Processor SW26010

High Performance Matrix Multiplication on Many Cores

Efficient Processing of Convolutional Neural Networks on SW26010.

Research on the Optimization of BLAS Level 1 and 2 Functions on Shenwei Many-Core Processor

Accelerating and Tuning Small Matrix Multiplications on Sunway TaihuLight: A Case Study of Spectral Element CFD Code Nek5000

xMath2.0: a high-performance extended math library for SW26010-Pro many-core processor

Towards Efficient SpMV on Sunway Manycore Architectures.

Taming the "Monster": Overcoming Program Optimization Challenges on SW26010 Through Precise Performance Modeling

Design and Implementation of Coroutine Scheduling System on SW26010

Parallel Tridiagonal Solver on Sunway Many-Core Processors*

Efficient Processing of Moving Target Detection Based on SW26010

Towards efficient canonical polyadic decomposition on sunway many-core processor