Abstract:Learning a proper distance for clustering from prior knowledge falls into the realm of semisupervised fuzzy clustering. Although most existing learning methods take prior knowledge (e.g., pairwise constraints) into account, they pay little attention to local knowledge of data, which, however, can be utilized to optimize the distance. In this article, we propose a novel distance learning method, which learns from the Group-level information, for semisupervised fuzzing clustering. We first present a new format of constraint information, called Group-level constraints, by elevating the pairwise constraints (must-links and cannot-links) from point level to Group level. The Groups, generated around data points contained in the pairwise constraints, carry not only the local information of data (the relation between close data points) but also more background information under some given limited prior knowledge. Then, we propose a novel method to learn a distance by using the Group-level constraints, namely, Group-based distance learning, in order to optimize the performance of fuzzy clustering. The distance learning process aims to pull must-link Groups as close as possible while pushing cannot-link Groups as far as possible. We formulate the learning process with the weights of constraints by invoking some linear and nonlinear transformations. The linear Group-based distance learning method is realized by means of semidefinite programming, and the nonlinear learning method is realized by using the neural network, which can explicitly provide nonlinear mappings. Experimental results based on both synthetic and real-world datasets show that the proposed methods yield much better performance compared to other distance learning methods using pairwise constraints.

Semi-Supervised Clustering with Partial Background Information.

Semi-supervised Clustering Using Incomplete Prior Knowledge

Near-Optimal Algorithms for Constrained k-Center Clustering with Instance-level Background Knowledge

Research Progress on Semi-Supervised Clustering

Using Clustering Analysis to Improve Semi-Supervised Classification.

A Group-Based Distance Learning Method for Semisupervised Fuzzy Clustering

Semi-supervised clustering based on spectral clustering

Semi-Supervised Hybrid Clustering by Integrating Gaussian Mixture Model and Distance Metric Learning

Knowledge Augmentation-Based Soft Constraints for Semi-Supervised Clustering

Semi-supervised Clustering by Input Pattern Assisted Pairwise Similarity Matrix Completion

Genetic-guided Semi-Supervised Clustering Algorithm with Instance-Level Constraints

Research of Semi-Supervised Spectral Clustering Algorithm Based on Pairwise Constraints.

An Efficient Semi-Supervised Clustering Algorithm with Sequential Constraints

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

An Exact Algorithm for Semi-supervised Minimum Sum-of-Squares Clustering

Clustering Based on Supervised Learning of Exemplar Discriminative Information

A Flexible Convex Optimization Model for Semi-supervised Clustering with Instance-level Constraints

Semi-Supervised Fuzzy Clustering with Feature Discrimination

Semi-Supervised Constrained Clustering: An In-Depth Overview, Ranked Taxonomy and Future Research Directions

Semi-supervised Clustering of Graph Objects: A Subgraph Mining Approach

An Improved Semi-Supervised Clustering Algorithm For Multi-Density Datasets With Fewer Constraints