Abstract:With the advent of the big data era, the amounts of sampling data and the dimensions of data features are rapidly growing. It is highly desired to enable fast and efficient clustering of unlabeled samples based on feature similarities. As a fundamental primitive for data clustering, the k-means operation is receiving increasingly more attentions today. To achieve high performance k-means computations on modern multi-core/many-core systems, we propose a matrix-based fused framework that can achieve high performance by conducting computations on a distance matrix and at the same time can improve the memory reuse through the fusion of the distance-matrix computation and the nearest centroids reduction. We implement and optimize the parallel k-means algorithm on the SW26010 many-core processor, which is the major horsepower of Sunway TaihuLight. In particular, we design a task mapping strategy for load-balanced task distribution, a data sharing scheme to reduce the memory footprint and a register blocking strategy to increase the data locality. Optimization techniques such as instruction reordering and double buffering are further applied to improve the sustained performance. Discussions on block-size tuning and performance modeling are also presented. We show by experiments on both randomly generated and real-world datasets that our parallel implementation of k-means on SW26010 can sustain a double-precision performance of over 348.1 Gflops, which is 46.9% of the peak performance and 84% of the theoretical performance upper bound on a single core group, and can achieve a nearly ideal scalability to the whole SW26010 processor of four core groups. Performance comparisons with the previous state-of-the-art on both CPU and GPU are also provided to show the superiority of our optimized k-means kernel.

Taming the "Monster": Overcoming Program Optimization Challenges on SW26010 Through Precise Performance Modeling

SoC performance modeling methodology and implementation basedon transaction dataflow

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Superblock-based performance optimization for Sunway Math Library on SW26010 many-core processor

Performance Modeling of Stencil Computation on SW26010 Processors

Power Profiling for Low Power Optimization Using New Computing Model

Automatic Multi-Parameter Performance Modeling of HPC Applications on a New Sunway Supercomputer

Refactoring and Optimizing WRF Model on Sunway TaihuLight

A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

Automatic Optimization of Parallel Parameters for Sunway TaihuLight Super-computer Application Program

Enabling Highly Efficient K -Means Computations on the SW26010 Many-Core Processor of Sunway TaihuLight

Enabling Highly Efficient Batched Matrix Multiplications on SW26010 Many-core Processor.

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core

Parallel optimization of method of characteristics based on Sunway Bluelight II supercomputer

swATOP: Automatically Optimizing Deep Learning Operators on SW26010 Many-Core Processor

swHPFM: Refactoring and Optimizing the Structured Grid Fluid Mechanical Algorithm on the Sunway TaihuLight Supercomputer

Refactoring and Optimizing the Community Atmosphere Model (CAM) on the Sunway Taihulight Supercomputer

swMD: Performance Optimizations for Molecular Dynamics Simulation on Sunway Taihulight

Performance Evaluation of Algorithms for Optimizing Processor Simulator Parameters

Accelerating and Tuning Small Matrix Multiplications on Sunway TaihuLight: A Case Study of Spectral Element CFD Code Nek5000

Tuning a General Purpose Software Cache Library for TaihuLight’s SW26010 Processor