Abstract:Scalability of clustering algorithms is a critical issue in real world clustering applications. Usually, data sampling and parallelization are two common ways to address the scalability issue. Despite their wide utilization in a number of clustering algorithms, they suffer from several major drawbacks. For example, most data sampling can often lead to biased solutions due to its inability in accurately capturing the distribution of the entire data set. On the other hand, the performance of parallelization highly depends on the original clustering routines which are not parallel algorithms in nature, such that customizing each algorithm to be parallel may hurt the clustering performance. To alleviate these problems, we propose a general two-step framework for scalable clustering in this work, where the first step is to obtain skeleton structure of data and the second step is to obtain the final clustering. Concretely, data are first partitioned and located across a two-dimensional grid, and then local clustering algorithms are iteratively applied on the cells of the grid, each providing a set of intermediate core points. These core points represent the dense or central regions of data, which can be centers, modes and means for centroid-based, density-based and probability-based clustering, respectively. Finally, these core points are further used to obtain the final clustering. The proposed framework enjoys several benefits: (1) the local clustering on partitioned cells are conducted in parallel and thus can lead to high speed-up; (2) the clustering on the representative core points can be more robust; (3) the framework can be easily applied to other basic clustering methods and thus achieves a general scalable solution. Theoretical analysis is provided and extensive experimental results have demonstrated the effectiveness and efficiency of the proposed framework.

Parallel spectral clustering algorithm

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Parallelization of Spectral Clustering Algorithm on Multi-Core Processors and GPGPU

Parallel Pls Aigorithm Using Mapreduce and Its Aplication in Spectral Modeling

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

An Efficient Parallel Nonlinear Clustering Algorithm Using Mapreduce

Parallel Based on Cloud Computing to Achieve Large Data Sets Clustering

Parallel Subspace Clustering Using MapReduce

Research on K-medoids clustering algorithm based on data density and its parallel processing based on MapReduce

A Parallel Clustering Algorithm Using Mapping and Sampling-Partitioning on the Cluster Computing Systems

A Parallel Clustering Algorithm for Power Big Data Analysis.

Parallel Boosted Clustering

A Spectral Clustering Algorithm Based on Hierarchical Method

A Distributed Block Chebyshev-Davidson Algorithm for Parallel Spectral Clustering

Parallel implementing k-means clustering algorithm using MapReduce programming mode

An Improved Parallel K-means Clustering Algorithm with MapReduce

The Parallel Implementation and Application of an Improved K-means Algorithm

A 2-Tier Clustering Algorithm with Map-Reduce

Research On The Parallelization Of The Dbscan Clustering Algorithm For Spatial Data Mining Based On The Spark Platform

Parallel ISODATA Clustering of Remote Sensing Images Based on MapReduce