Abstract:Recently, a new clustering method called maximum margin clustering (MMC) was proposed and has shown promising performances. It was originally formulated as a difficult nonconvex integer problem. To make the MMC problem practical, the researchers either relaxed the original MMC problem to inefficient convex optimization problems or reformulated it to nonconvex optimization problems, which sacrifice the convexity for efficiency. However, no approaches can both hold the convexity and be efficient. In this paper, a new linearithmic time sparse and convex MMC algorithm, called support-vector-regression-based MMC (SVR-MMC), is proposed. Generally, it first uses the SVR as the core of the MMC. Then, it is relaxed as a convex optimization problem, which is iteratively solved by the cutting-plane algorithm. Each cutting-plane subproblem is further decomposed to a serial supervised SVR problem by a new global extended-level method (GELM). Finally, each supervised SVR problem is solved in a linear time complexity by a new sparse-kernel SVR (SKSVR) algorithm. We further extend the SVR-MMC algorithm to the multiple-kernel clustering (MKC) problem and the multiclass MMC (M3C) problem, which are denoted as SVR-MKC and SVR-M3C, respectively. One key point of the algorithms is the utilization of the SVR. It can prevent the MMC and its extensions meeting an integer matrix programming problem. Another key point is the new SKSVR. It provides a linear time interface to the nonlinear kernel scenarios, so that the SVR-MMC and its extensions can keep a linearthmic time complexity in nonlinear kernel scenarios. Our experimental results on various real-world data sets demonstrate the effectiveness and the efficiency of the SVR-MMC and its two extensions. Moreover, the unsupervised application of the SVR-MKC to the voice activity detection (VAD) shows that the SVR-MKC can achieve good performances that are close to its supervised counterpart, meet the real-time demand of the VAD, and need no labeling for model training.

Voting-Xcsc: A Consensus Clustering Method Via Learning Classifier System

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Combining multiple clusterings via k-modes algorithm

Xcsc: a Novel Approach to Clustering with Extended Classifier System.

Gaining Confidence on Molecular Classification Through Consensus Modeling and Validation

SSCC: A Novel Computational Framework for Rapid and Accurate Clustering Large-scale Single Cell RNA-seq Data.

SSCNet: learning-based subspace clustering

Comparison of Spectral Clustering, K-clustering and Hierarchical Clustering on E-Nose Datasets: Application to the Recognition of Material Freshness, Adulteration Levels and Pretreatment Approaches for Tomato Juices

K-Means-Based Consensus Clustering: A Unified View

Self-paced Adaptive Bipartite Graph Learning for Consensus Clustering

Clustering with XCS on Complex Structure Dataset

Supervised Convex Clustering

Large-Scale Subspace Clustering by Independent Distributed and Parallel Coding

Consensus Clustering With Co-Association Matrix Optimization

SSCC: a novel computational framework for rapid and accurate clustering large single cell RNA-seq data

A Clustering Method with Historical Data to Support Large-Scale Consensus-Reaching Process in Group Decision-Making

ssvEEGc: An efficient EEG clustering method using balance-constrained voting mechanism

Clustering with XCS and Agglomerative Rule Merging

Study on consensus function based on clustering algorithms of categorical data

Linearithmic Time Sparse and Convex Maximum Margin Clustering

MaskClustering: View Consensus based Mask Graph Clustering for Open-Vocabulary 3D Instance Segmentation