Abstract:We study constrained clustering, where constraints guide the clustering process. In existing works, two categories of constraints have been widely explored, namely pairwise and cardinality constraints. Pairwise constraints enforce the cluster labels of two instances to be the same (must-link constraints) or different (cannot-link constraints). Cardinality constraints encourage cluster sizes to satisfy a user-specified distribution. Most existing constrained clustering models can only utilize one category of constraints at a time. We enforce the above two categories into a unified clustering model starting with the integer program formulation of the standard K-means. As the two categories provide different useful information, utilizing both allow for better clustering performance. However, the optimization is difficult due to the binary and quadratic constraints in the unified formulation. To solve this, we utilize two techniques: equivalently replacing the binary constraints by the intersection of two continuous constraints; the other is transforming the quadratic constraints into bi-linear constraints by introducing extra variables. We derive an equivalent continuous reformulation with simple constraints, which can be efficiently solved by Alternating Direction Method of Multipliers. Extensive experiments on both synthetic and real data demonstrate when: (1) utilizing a single category of constraint, the proposed model is superior to or competitive with SOTA constrained clustering models, and (2) utilizing both categories of constraints jointly, the proposed model shows better performance than the case of the single category. The experiments show that the proposed method exploits the constraints to achieve perfect clustering performance with improved clustering to 2%-5% in classical clustering metrics, e.g. Adjusted Random, Mirkin's, and Huber's, indices outerperfomring other methods.

Clustering with Relative Constraints

Semi-supervised Learning Based on Group Sparse for Relative Attributes.

Comparative Density Peaks Clustering

Clustering with Complex Constraints - Algorithms and Applications.

Constrained Clustering: General Pairwise and Cardinality Constraints

Constrained Information-Theoretic Tripartite Graph Clustering to Identify Semantically Similar Relations

A Hierarchical Clustering Algorithm Based on K-Means with Constraints

Is an Affine Constraint Needed for Affine Subspace Clustering?

The interelation in fuzzy clustering

Cluster ensemble selection with constraints.

Probabilistic and Graphical Model Based Genetic Algorithm Driven Clustering with Instance-level Constraints

Extracting Elite Pairwise Constraints for Clustering

Dynamic Structural Clustering on Graphs

Density Peak Clustering Based on Relative Density Relationship

Genetic-guided Semi-Supervised Clustering Algorithm with Instance-Level Constraints

Semi-Supervised Clustering via Structural Entropy with Different Constraints

Constrained Hierarchical Clustering via Graph Coarsening and Optimal Cuts

An algorithm for clustering with confidence-based must-link and cannot-link constraints

Cluster Aggregate Inequality And Multi-Level Hierarchical Clustering

Semi-Supervised Constrained Clustering: An In-Depth Overview, Ranked Taxonomy and Future Research Directions

A Semi-Supervised Agglomerative Hierarchical Clustering Method Based on Dynamically Updating Constraints