Abstract:With the advent of the big data era, the amounts of sampling data and the dimensions of data features are rapidly growing. It is highly desired to enable fast and efficient clustering of unlabeled samples based on feature similarities. As a fundamental primitive for data clustering, the k-means operation is receiving increasingly more attentions today. To achieve high performance k-means computations on modern multi-core/many-core systems, we propose a matrix-based fused framework that can achieve high performance by conducting computations on a distance matrix and at the same time can improve the memory reuse through the fusion of the distance-matrix computation and the nearest centroids reduction. We implement and optimize the parallel k-means algorithm on the SW26010 many-core processor, which is the major horsepower of Sunway TaihuLight. In particular, we design a task mapping strategy for load-balanced task distribution, a data sharing scheme to reduce the memory footprint and a register blocking strategy to increase the data locality. Optimization techniques such as instruction reordering and double buffering are further applied to improve the sustained performance. Discussions on block-size tuning and performance modeling are also presented. We show by experiments on both randomly generated and real-world datasets that our parallel implementation of k-means on SW26010 can sustain a double-precision performance of over 348.1 Gflops, which is 46.9% of the peak performance and 84% of the theoretical performance upper bound on a single core group, and can achieve a nearly ideal scalability to the whole SW26010 processor of four core groups. Performance comparisons with the previous state-of-the-art on both CPU and GPU are also provided to show the superiority of our optimized k-means kernel.

KPynq: A Work-Efficient Triangle-Inequality Based K-means on FPGA

TiAcc: Triangle-inequality Based Hardware Accelerator for K-means on FPGAs

High-performance K-means Implementation based on a Simplified Map-Reduce Architecture

BiS-KM: Enabling Any-Precision K-Means on FPGAs

SAKMA: Specialized FPGA-Based Accelerator Architecture for Data-Intensive K-Means Algorithms

L-FNNG: Accelerating Large-Scale KNN Graph Construction on CPU-FPGA Heterogeneous Platform

WooKong: A Ubiquitous Accelerator for Recommendation Algorithms with Custom Instruction Sets on FPGA

An FPGA Based Accelerator for Clustering Algorithms With Custom Instructions

STPAcc: Structural TI-Based Pruning for Accelerating Distance-Related Algorithms on CPU-FPGA Platforms

FT K-means: A High-Performance K-means on GPU with Fault Tolerance

A pure hardware implementation of CRYSTALS-KYBER PQC algorithm through resource reuse

A Reconfigurable 64-Dimension K-Means Clustering Accelerator with Adaptive Overflow Control

Communication-efficient k-Means for Edge-based Machine Learning

High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline

Using Multi-Core HW/SW Co-design Architecture for Accelerating K-means Clustering Algorithm

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Enabling Highly Efficient K -Means Computations on the SW26010 Many-Core Processor of Sunway TaihuLight

HI-Kyber: A Novel High-Performance Implementation Scheme of Kyber Based on GPU

The Implementation of A Knn Classifier on Fpga with A Parallel and Pipelined Architecture Based on Predetermined Range Search

On Simplifying Large-Scale Spatial Vectors: Fast, Memory-Efficient, and Cost-Predictable k-means

AccD: A Compiler-based Framework for Accelerating Distance-related Algorithms on CPU-FPGA Platforms