Abstract:One of the hottest topics in unsupervised learning is how to efficiently and effectively cluster large amounts of unlabeled data. To address this issue, we propose an orthogonal conceptual factorization (OCF) model to increase clustering effectiveness by restricting the degree of freedom of matrix factorization. In addition, for the OCF model, a fast optimization algorithm containing only a few low-dimensional matrix operations is given to improve clustering efficiency, as opposed to the traditional CF optimization algorithm, which involves dense matrix multiplications. To further improve the clustering efficiency while suppressing the influence of the noises and outliers distributed in real-world data, an efficient correntropy-based clustering algorithm (ECCA) is proposed in this article. Compared with OCF, an anchor graph is constructed and then OCF is performed on the anchor graph instead of directly performing OCF on the original data, which can not only further improve the clustering efficiency but also inherit the advantages of the high performance of spectral clustering. In particular, the introduction of the anchor graph makes ECCA less sensitive to changes in data dimensions and still maintains high efficiency at higher data dimensions. Meanwhile, for various complex noises and outliers in real-world data, correntropy is introduced into ECCA to measure the similarity between the matrix before and after decomposition, which can greatly improve the clustering effectiveness and robustness. Subsequently, a novel and efficient half-quadratic optimization algorithm was proposed to quickly optimize the ECCA model. Finally, extensive experiments on different real-world datasets and noisy datasets show that ECCA can archive promising effectiveness and robustness while achieving tens to thousands of times the efficiency compared with other state-of-the-art baselines.

Fuzzy Clustering Method with Approximate Orthogonal Regularization.

Data Clustering Based on the Modified Relaxation Cheeger Cut Model

Fuzzy Smooth Equilibrium Method for Clustering.

Spectral Clustering Via Half-Quadratic Optimization

Efficient Uncertainty Minimization for Fuzzy Spectral Clustering

Subspace Clustering Via Variance Regularized Ridge Regression

A Group Norm Regularized LRR Factorization Model for Spectral Clustering

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Sparse Regularization in Fuzzy $c$ -Means for High-Dimensional Data Clustering

ECCA: Efficient Correntropy-Based Clustering Algorithm With Orthogonal Concept Factorization

Adaptive Spectral Rotation via Joint Cluster and Pairwise Structure

An Optimization Model for Fuzzy Binary Clustering

Fuzzy Clustering Guided by Spectral Rotation and Scaling

Adaptive Projected Clustering with Graph Regularization.

A semi-supervised approximate spectral clustering algorithm based on HMRF model

Nonconvex Sparse Spectral Clustering by Alternating Direction Method of Multipliers and Its Convergence Analysis

Robust spectral embedded bilateral orthogonal concept factorization for clustering

Nonnegative Spectral Clustering with Discriminative Regularization.

Adaptive Manifold Regularized Matrix Factorization for Data Clustering.

Spectral Clustering with Fuzzy Similarity Measure

Spectral Clustering via Orthogonalization-Free Methods