Abstract:The traditional K-means clustering algorithm is difficult to initialize the number of clusters K, and the initial cluster centers are selected randomly, this makes the clustering results very unstable. Meanwhile, algorithms are susceptible to noise points. To solve the problems, the traditional K-means algorithm is improved. The improved method is divided into the same grid in space, according to the size of the data point property value and assigns it to the corresponding grid. And count the number of data points in each grid. Selecting M(M>K) grids, comprising the maximum number of data points, and calculate the central point. These M central points as input data, and then to determine the k value based on the clustering results. In the M points, find K points farthest from each other and those K center points as the initial cluster center of K-means clustering algorithm. At the same time, the maximum value in M must be included in K. If the number of data in the grid less than the threshold, then these points will be considered as noise points and be removed. In order to make the improved algorithm can adapt to handle large data. We will parallel the improved k-mean algorithm and combined with the MapReduce framework. Theoretical analysis and experimental results show that the improved algorithm compared to the traditional K-means clustering algorithm has high quality results, less iteration and has good stability. Parallelized algorithm has a very high efficiency in data processing, and has good scalability and speedup.

Parallel K-PSO Based on MapReduce

A multi-threaded particle swarm optimization-kmeans algorithm based on MapReduce

Quantum-Behaved Particle Swarm Optimization Using MapReduce.

DYPSOKM: A Dynamic Union of PSO and K-Means, A Better Cluster

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

An Improved Parallel K-means Algorithm Based on MapReduce

Parallel Multi-Swarm PSO Based on K-Medoids and Uniform Design

K-Means Clustering Algorithm Optimized By Particle Swarm Optimization Algorithm

Parallel Particle Swarm Optimization Using Message Passing Interface

Distributed Parallel Particle Swarm Optimization for Multi-Objective and Many-Objective Large-Scale Optimization.

Cooperative Particle Swarm Optimization Using MapReduce

Hybrid Particle Swarm Optimization Based on Parallel Collaboration

An Efficient Hybrid Approach Based on PSO, ABC and K-Means for Cluster Analysis

Parallel implementing k-means clustering algorithm using MapReduce programming mode

The Study Of Parallel K-Means Algorithm

A Hybrid PSO Based on Dynamic Clustering for Global Optimization

A Novel Distributed Quantum-Behaved Particle Swarm Optimization

An parallel particle swarm optimization approach for multiobjective optimization problems.

K‐PSO: an Improved PSO‐based Container Scheduling Algorithm for Big Data Applications

An Improved K-means Algorithm Based on Mapreduce and Grid

Parallel asynchronous particle swarm optimization