Abstract:Due to the rapid development of information technology and network technology, there is a lot of data, but the phenomenon of lack of knowledge is becoming more and more serious. Data mining technology has developed vigorously in this environment, and it has shown more and more vitality. Based on Spark programming model, this paper designs the parallel extension of fuzzy c-means. In order to enhance the performance of fuzzy c-means parallel expansion, the improvement strategy of k-means during the initialization phase is borrowed, and k-means// is extended to fuzzy c-means to obtain better clustering performance. Combined with Spark's programming model, this paper can obtain extended parallel fuzzy c-means algorithm. Several experiments on the data set of the algorithm proposed in this paper have shown good scalability and parallelism, effectively expanding fuzzy c-means clustering to distributed applications, greatly increasing the scale of the data processed by the algorithm. This improves the robustness of the algorithm and the adaptability of the algorithm to the shape and structure of the data, so that the parallel and scalable clustering algorithm can more effectively perform cluster analysis on big data. Three algorithms were simulated on MATLAB platform. We use simple data sets and complex two-dimensional data sets, and compare with the traditional fuzzy c-means algorithm and fuzzy c-means algorithm based on fuzzy entropy. Experiments show that the scalable parallel fuzzy c-means algorithm not only greatly improves the anti-noise performance, but also improves the convergence speed, and it can automatically determine the optimal number of clusters.

Parallel fuzzy clustering algorithm for interval data

A kind of practical fuzzy clustering

Fuzzy Clustering Algorithms Based on Resolution and Their Application in Image Compression.

Parallel spectral clustering algorithm

A clustering algorithm for distributed time-series data

Cloud Scheduling Algorithm Based on Fuzzy Clustering

Data Mining Algorithm for Cloud Network Information Based on Artificial Intelligence Decision Mechanism

An Improved Fcm Clustering Method For Interval Data

The interrelation in fuzzy clustering

Interval-valued possibilistic fuzzy C-means clustering algorithm

Fuzzy clustering algorithm for outlier-interval data based on the robust exponent distance

The Study of Parallel Clustering Algorithm for Cluster System

IPFCM Clustering Algorithm Under Euclidean and Hausdorff Distance Measure for Symbolic Interval Data

The interelation in fuzzy clustering

Adaptive Approach to Fuzzy Clustering

Fuzzy clustering of spatial interval-valued data

A Hierarchical Clustering Algorithm Based on Fuzzy Graph Connectedness.

Improved Clustering Algorithm Based on Modified Fuzzy C-means Applied to the Traffic

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Fuzzy hierarchical clustering algorithm facing large databases

Building the forecasting model for interval time series based on the fuzzy clustering technique