Abstract:We study constrained clustering, where constraints guide the clustering process. In existing works, two categories of constraints have been widely explored, namely pairwise and cardinality constraints. Pairwise constraints enforce the cluster labels of two instances to be the same (must-link constraints) or different (cannot-link constraints). Cardinality constraints encourage cluster sizes to satisfy a user-specified distribution. Most existing constrained clustering models can only utilize one category of constraints at a time. We enforce the above two categories into a unified clustering model starting with the integer program formulation of the standard K-means. As the two categories provide different useful information, utilizing both allow for better clustering performance. However, the optimization is difficult due to the binary and quadratic constraints in the unified formulation. To solve this, we utilize two techniques: equivalently replacing the binary constraints by the intersection of two continuous constraints; the other is transforming the quadratic constraints into bi-linear constraints by introducing extra variables. We derive an equivalent continuous reformulation with simple constraints, which can be efficiently solved by Alternating Direction Method of Multipliers. Extensive experiments on both synthetic and real data demonstrate when: (1) utilizing a single category of constraint, the proposed model is superior to or competitive with SOTA constrained clustering models, and (2) utilizing both categories of constraints jointly, the proposed model shows better performance than the case of the single category. The experiments show that the proposed method exploits the constraints to achieve perfect clustering performance with improved clustering to 2%-5% in classical clustering metrics, e.g. Adjusted Random, Mirkin's, and Huber's, indices outerperfomring other methods.

Constrained Dominant sets and Its applications in computer vision

Applications of a Graph Theoretic Based Clustering Framework in Computer Vision and Pattern Recognition

Deep Constrained Dominant Sets for Person Re-identification

Constrained Clustering: General Pairwise and Cardinality Constraints

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

Graph Embedding with Constraints

Multi-Target Tracking in Multiple Non-Overlapping Cameras using Constrained Dominant Sets

Constrained Clustering Based on the Link Structure of a Directed Graph.

Semi-Supervised Constrained Clustering: An In-Depth Overview, Ranked Taxonomy and Future Research Directions

Constrained Tensor Representation Learning for Multi-View Semi-Supervised Subspace Clustering

Weakly Supervised Multilabel Clustering and Its Applications in Computer Vision

Constrained Text Coclustering with Supervised and Unsupervised Constraints

Video shot segmentation using graph-based dominant-set clustering

Deep Learning of Unified Region, Edge, and Contour Models for Automated Image Segmentation

Semantic Segmentation Using Multiple Graphs With Block-Diagonal Constraints

Constrained Domain Adaptation for Image Segmentation

Spectral Clustering in Convex and Constrained Settings

A review on declarative approaches for constrained clustering

Web Image Clustering by Consistent Utilization of Visual Features and Surrounding Texts.

Constrained Sparse Concept Coding Algorithm with Application to Image Representation.

Submodular Function Optimization for Motion Clustering and Image Segmentation.