Abstract:The traditional K-means clustering algorithm is difficult to initialize the number of clusters K, and the initial cluster centers are selected randomly, this makes the clustering results very unstable. Meanwhile, algorithms are susceptible to noise points. To solve the problems, the traditional K-means algorithm is improved. The improved method is divided into the same grid in space, according to the size of the data point property value and assigns it to the corresponding grid. And count the number of data points in each grid. Selecting M(M>K) grids, comprising the maximum number of data points, and calculate the central point. These M central points as input data, and then to determine the k value based on the clustering results. In the M points, find K points farthest from each other and those K center points as the initial cluster center of K-means clustering algorithm. At the same time, the maximum value in M must be included in K. If the number of data in the grid less than the threshold, then these points will be considered as noise points and be removed. In order to make the improved algorithm can adapt to handle large data. We will parallel the improved k-mean algorithm and combined with the MapReduce framework. Theoretical analysis and experimental results show that the improved algorithm compared to the traditional K-means clustering algorithm has high quality results, less iteration and has good stability. Parallelized algorithm has a very high efficiency in data processing, and has good scalability and speedup.

Optimization of k-means clustering algorithm in hadoop distributed computing framework

A K-means clustering with optimized initial center based on Hadoop platform

An Improved K-means Distributed Clustering Algorithm Based on Spark Parallel Computing Framework

An Improved K-means Algorithm Based on Multiple Clustering and Density.

An Optimization Algorithm of Selecting Initial Clustering Center in K - Means

An Improved Parallel K-means Clustering Algorithm with MapReduce

An Improved Parallel K-means Algorithm Based on MapReduce

The Parallel Implementation and Application of an Improved K-means Algorithm

Research on Efficient K_Means Parallel Algorithm Based on Hadoop Distributed Architecture

An Improved K-means Algorithm Based on Mapreduce and Grid

Optimization to K-Means Initial Cluster Centers

An Optimal Distributed K-Means Clustering Algorithm Based on Cloudstack

Optimized Big Data K-means Clustering Using MapReduce

Research on K-medoids clustering algorithm based on data density and its parallel processing based on MapReduce

An Efficient K-Means Clustering Algorithm On Mapreduce

A modified parallel k-means clustering with improved initial centers

Algorithm for Initialization of K-Means Clustering Center Based on Optimized-Division

More effective algorithm for K-means clustering

Research of an Impoved K-means Algorithm for Aanalyzing Mass Data

K*-Means: an Effective and Efficient K-Means Clustering Algorithm

A Novel Effective Distance Measure and a Relevant Algorithm for Optimizing the Initial Cluster Centroids of K-means