Abstract:Owing to its application in solving the difficult and diverse clustering or outlier detection problem, support-based clustering has recently drawn plenty of attention. Support-based clustering method always undergoes two phases: finding the domain of novelty and performing clustering assignment. To find the domain of novelty, the training time given by the current solvers is typically over-quadratic in the training size, and hence precluding the usage of support-based clustering method for large-scale datasets. In this paper, we propose applying Stochastic Gradient Descent (SGD) framework to the first phase of support-based clustering for finding the domain of novelty and a new strategy to perform the clustering assignment. However, the direct application of SGD to the first phase of support-based clustering is vulnerable to the curse of kernelization, that is, the model size linearly grows up with the data size accumulated overtime. To address this issue, we invoke the budget approach which allows us to restrict the model size to a small budget. Our new strategy for clustering assignment enables a fast computation by means of reducing the task of clustering assignment on the full training set to the same task on a significantly smaller set. We also provide a rigorous theoretical analysis about the convergence rate for the proposed method. Finally, we validate our proposed method on the well-known datasets for clustering to show that the proposed method offers a comparable clustering quality while simultaneously achieving significant speedup in comparison with the baselines.

Partitioning Clustering Based on Support Vector Ranking.

An improved clustering algorithm based support vectors

Fuzzy support vector clustering

Web Document Categorization by Support Vector Clustering.

Incremental Support Vector Clustering

Group-Air Grouping Algorithm Based on Support Vector Clustering

A Novel SVC Method Based on K-means

Support Vector Machine Classifier Based on Fuzzy Partition and Neighborhood Pairs

Double centroids-weighted support vector clustering algorithm for group-air grouping

A Novel Approach to Clustering Analysis Based on Support Vector Machine

Support Vector Classifier Based on Principal Component Analysis

Novel Grouping Method-Based Support Vector Machine Plus for Structured Data

Improved Algorithm of Target Grouping Based on Data Field

Least-Square Support Vector Clustering

Incremental Support Vector Clustering with Outlier Detection

A Novel Clustering Based Classifier Using Support Vector Machines Criterion

DBSVEC: Density-Based Clustering Using Support Vector Expansion

MPMSVC: Multiple Parametric-Margin Support Vector Clustering

Unsupervised and Semi-supervised Support Vector Machines

Scalable Support Vector Clustering Using Budget

Support Vector Clustering for Outlier Detection