Abstract:The traditional K-means clustering algorithm is difficult to initialize the number of clusters K, and the initial cluster centers are selected randomly, this makes the clustering results very unstable. Meanwhile, algorithms are susceptible to noise points. To solve the problems, the traditional K-means algorithm is improved. The improved method is divided into the same grid in space, according to the size of the data point property value and assigns it to the corresponding grid. And count the number of data points in each grid. Selecting M(M>K) grids, comprising the maximum number of data points, and calculate the central point. These M central points as input data, and then to determine the k value based on the clustering results. In the M points, find K points farthest from each other and those K center points as the initial cluster center of K-means clustering algorithm. At the same time, the maximum value in M must be included in K. If the number of data in the grid less than the threshold, then these points will be considered as noise points and be removed. In order to make the improved algorithm can adapt to handle large data. We will parallel the improved k-mean algorithm and combined with the MapReduce framework. Theoretical analysis and experimental results show that the improved algorithm compared to the traditional K-means clustering algorithm has high quality results, less iteration and has good stability. Parallelized algorithm has a very high efficiency in data processing, and has good scalability and speedup.

Analysis and Research of K-Means Algorithm in Soil Fertility Based on Hadoop Platform

Analysis of Plant Breeding on Hadoop and Spark

Design of smart agriculture based on big data and Internet of things

Analysis Of Soil Fertility Based On Fumf Algorithm

The Parallel Implementation and Application of an Improved K-means Algorithm

An Enhanced K-Means Algorithm for Water Quality Analysis of The Haihe River in China

Data Analysis of Educational Evaluation Using K-Means Clustering Method

An Improved K-means Algorithm Based on Mapreduce and Grid

An Efficient K-Means Clustering Algorithm On Mapreduce

Large-scale Data Mining Method based on Clustering Algorithm Combined with MAPREDUCE

K-Means Clustering with Bagging and MapReduce

Research Of Large-Scale And Complex Agricultural Data Classification Algorithms Based On The Spatial Variability

A multi-threaded particle swarm optimization-kmeans algorithm based on MapReduce

A 2-Tier Clustering Algorithm with Map-Reduce

Research on the Analysis and Statistic of Geographical Conditions Based on the Strategy of "grid Index + MapReduce"

Research on the processing method of multi-source heterogeneous data in the intelligent agriculture cloud platform

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

Research and implementation of user clustering based on MapReduce in multimedia big data

K-Means Parallel Algorithm of Big Data Clustering Based on Mapreduce PCAM Method

An Enhanced Agglomerative Fuzzy K-Means Clustering Method with Mapreduce Implementation on Hadoop Platform

The Application Of The Optics Algorithm In The Maize Precise Fertilization Decision-Making