Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

Parallel Subspace Clustering Using MapReduce

Distributed Affinity Propagation Clustering Based on MapReduce

Parallel spectral clustering algorithm

MR-Mafia: Parallel Subspace Clustering Algorithm Based on MapReduce for Large Multi-dimensional Datasets

Parallel ISODATA Clustering of Remote Sensing Images Based on MapReduce

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

RESEARCH ON CASCADE-GROUPING PARALLEL SVM ALGORITHM BASED ON MAPREDUCE

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

Parallel clustering of very large document datasets with MapReduce

An efficient PAM spatial clustering algorithm based on MapReduce

An Efficient Parallel Nonlinear Clustering Algorithm Using Mapreduce

Parallel CSA-FCM Clustering Algorithm Based on MapReduce

An Improved Parallel K-means Clustering Algorithm with MapReduce

A 2-Tier Clustering Algorithm with Map-Reduce

A Parallel Implementation of the K-Means Algorithm Based on MapReduce

Optimized Big Data K-means Clustering Using MapReduce

Parallel Based on Cloud Computing to Achieve Large Data Sets Clustering

Parallel K-Means Clustering Of Remote Sensing Images Based On Mapreduce

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Research on K-medoids clustering algorithm based on data density and its parallel processing based on MapReduce

Subspace Clustering by Directly Solving Discriminative K-means