Abstract:Conventional semi-supervised clustering approaches have several shortcomings, such as (1) not fully utilizing all useful must-link and cannot-link constraints, (2) not considering how to deal with high dimensional data with noise, and (3) not fully addressing the need to use an adaptive process to further improve the performance of the algorithm. In this paper, we first propose the transitive closure based constraint propagation approach, which makes use of the transitive closure operator and the affinity propagation to address the first limitation. Then, the random subspace based semi-supervised clustering ensemble framework with a set of proposed confidence factors is designed to address the second limitation and provide more stable, robust, and accurate results. Next, the adaptive semi-supervised clustering ensemble framework is proposed to address the third limitation, which adopts a newly designed adaptive process to search for the optimal subspace set. Finally, we adopt a set of nonparametric tests to compare different semi-supervised clustering ensemble approaches over multiple datasets. The experimental results on 20 real high dimensional cancer datasets with noisy genes and 10 datasets from UCI datasets and KEEL datasets show that (1) The proposed approaches work well on most of the real-world datasets. (2) It outperforms other state-of-the-art approaches on 12 out of 20 cancer datasets, and 8 out of 10 UCI machine learning datasets.

Parallel Semi-Supervised Multi-Ant Colonies Clustering Ensemble Based on MapReduce Methodology.

Distributed Affinity Propagation Clustering Based on MapReduce

Parallel spectral clustering algorithm

A 2-Tier Clustering Algorithm with Map-Reduce

MapReduce Based Method for Big Data Semantic Clustering.

Parallel Subspace Clustering Using MapReduce

K-Means Clustering with Bagging and MapReduce

An Enhanced Agglomerative Fuzzy K-Means Clustering Method with Mapreduce Implementation on Hadoop Platform

An efficient PAM spatial clustering algorithm based on MapReduce

The Parallel Implementation and Application of an Improved K-means Algorithm

K-Means Parallel Algorithm of Big Data Clustering Based on Mapreduce PCAM Method

MReC4.5: C4.5 Ensemble Classification with MapReduce

Large-scale Data Mining Method based on Clustering Algorithm Combined with MAPREDUCE

A multi-threaded particle swarm optimization-kmeans algorithm based on MapReduce

EST Clustering in Large Dataset with MapReduce

5New density clustering algorithm based on MapReduce

Adaptive Ensembling of Semi-Supervised Clustering Solutions.

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

A Parallel Computing Model for Large-Graph Mining with MapReduce.

Network Public Opinion Monitoring Based on MapReduce

Research and implementation of user clustering based on MapReduce in multimedia big data