Abstract:One of the hottest topics in unsupervised learning is how to efficiently and effectively cluster large amounts of unlabeled data. To address this issue, we propose an orthogonal conceptual factorization (OCF) model to increase clustering effectiveness by restricting the degree of freedom of matrix factorization. In addition, for the OCF model, a fast optimization algorithm containing only a few low-dimensional matrix operations is given to improve clustering efficiency, as opposed to the traditional CF optimization algorithm, which involves dense matrix multiplications. To further improve the clustering efficiency while suppressing the influence of the noises and outliers distributed in real-world data, an efficient correntropy-based clustering algorithm (ECCA) is proposed in this article. Compared with OCF, an anchor graph is constructed and then OCF is performed on the anchor graph instead of directly performing OCF on the original data, which can not only further improve the clustering efficiency but also inherit the advantages of the high performance of spectral clustering. In particular, the introduction of the anchor graph makes ECCA less sensitive to changes in data dimensions and still maintains high efficiency at higher data dimensions. Meanwhile, for various complex noises and outliers in real-world data, correntropy is introduced into ECCA to measure the similarity between the matrix before and after decomposition, which can greatly improve the clustering effectiveness and robustness. Subsequently, a novel and efficient half-quadratic optimization algorithm was proposed to quickly optimize the ECCA model. Finally, extensive experiments on different real-world datasets and noisy datasets show that ECCA can archive promising effectiveness and robustness while achieving tens to thousands of times the efficiency compared with other state-of-the-art baselines.

Maximum Correntropy Criterion-Based Hierarchical One-Class Classification

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Hierarchical One-Class Model With Subnetwork for Representation Learning and Outlier Detection

Robust Randomized Autoencoder and Correntropy Criterion-Based One-Class Classification

Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field

Exploring the Optimization Objective of One-Class Classification for Anomaly Detection

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

A Privacy-Preserving Semisupervised Algorithm Under Maximum Correntropy Criterion

Hierarchical Multilabel Ship Classification in Remote Sensing Images Using Label Relation Graphs

Hierarchical Learning-Enhanced Chaotic Crayfish Optimization Algorithm: Improving Extreme Learning Machine Diagnostics in Breast Cancer

Robust One-Class Classification with Signed Distance Function using 1-Lipschitz Neural Networks

Robust One-Class SVM for Fault Detection

A Computing-in-Memory-based One-Class Hyperdimensional Computing Model for Outlier Detection

A Family of Maximum Margin Criterion for Adaptive Learning

Bayes-optimal Hierarchical Classification over Asymmetric Tree-Distance Loss

Anomaly Detection using One-Class Neural Networks

Restricted Minimum Error Entropy Criterion for Robust Classification

Maximum Margin Multi-Dimensional Classification

Nonparallel Hyperplane Classifiers for Multi-category Classification

ECCA: Efficient Correntropy-Based Clustering Algorithm With Orthogonal Concept Factorization

Effective hierarchical clustering based on structural similarities in nearest neighbor graphs