Abstract:Cluster analysis is one of the most fundamental methods in data mining, and it has been widely used in economics, social sciences and computer science. However, with the rapid development of Internet technology, the volume of data required for various web applications has grown rapidly, making the traditional clustering analysis methods face technical challenges. How to obtain useful information in a large amount of data quickly and efficiently is an urgent problem in many industrial fields. With the continuous development of cloud computing technology, large amounts of data can be performed quickly and efficiently. Hadoop is an open source distributed cloud computing platform with HDFS (Digital File System) and MapReduce as its core. HDFS provides massive data storage, while MapReduce uses the MapReduce programming model to achieve parallel processing. Compared with the traditional parallel programming model, it contains basic functions such as data partitioning, task scheduling, and parallel processing, making it possible for users to develop distributed applications on their own without understanding the basics of distributed basics, thus facilitating the design of parallel programs. K-means algorithm is a typical clustering analysis method, which is widely used in industry, but the number of iterations will increase significantly due to the growth of data volume, thus reducing the efficiency of computation. In order to better apply to the cluster analysis of large-scale data, this paper firstly implements a parallelization algorithm based on MapReduce on Hadoop platform using the basic idea of MapReduce and improves the K-means algorithm for the problems of blindness and easy to fall into local optimum when selecting randomly in clusters.

An Efficient Mapreduce-Based Parallel Clustering Algorithm for Distributed Traffic Subarea Division

Distributed Affinity Propagation Clustering Based on MapReduce

Dividing Traffic Sub-areas Based on a Parallel K-Means Algorithm.

Parallel spectral clustering algorithm

MapReduce based distributed parallel algorithm for extracting the hot path

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

Parallel discovering of city hot spot based on taxi trajectories

An Efficient Parallel Nonlinear Clustering Algorithm Using Mapreduce

An Improved Parallel K-means Clustering Algorithm with MapReduce

A 2-Tier Clustering Algorithm with Map-Reduce

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

A Parallel Clustering Algorithm for Power Big Data Analysis.

MapReduce-based distributed tensor clustering algorithm

A parallel computing framework for solving user equilibrium problem on computer clusters

An Improved Parallel K-means Algorithm Based on MapReduce

Research on K-medoids clustering algorithm based on data density and its parallel processing based on MapReduce

An Efficient Division Method of Traffic Cell Based on Improved K-means Clustering Algorithm for the Location of Infrastructure in Vehicular Networks

A Parallel Implementation of the K-Means Algorithm Based on MapReduce

K-Means Parallel Algorithm of Big Data Clustering Based on Mapreduce PCAM Method

The Parallel Implementation and Application of an Improved K-means Algorithm

Parallel implementing k-means clustering algorithm using MapReduce programming mode