Abstract:We study constrained clustering, where constraints guide the clustering process. In existing works, two categories of constraints have been widely explored, namely pairwise and cardinality constraints. Pairwise constraints enforce the cluster labels of two instances to be the same (must-link constraints) or different (cannot-link constraints). Cardinality constraints encourage cluster sizes to satisfy a user-specified distribution. Most existing constrained clustering models can only utilize one category of constraints at a time. We enforce the above two categories into a unified clustering model starting with the integer program formulation of the standard K-means. As the two categories provide different useful information, utilizing both allow for better clustering performance. However, the optimization is difficult due to the binary and quadratic constraints in the unified formulation. To solve this, we utilize two techniques: equivalently replacing the binary constraints by the intersection of two continuous constraints; the other is transforming the quadratic constraints into bi-linear constraints by introducing extra variables. We derive an equivalent continuous reformulation with simple constraints, which can be efficiently solved by Alternating Direction Method of Multipliers. Extensive experiments on both synthetic and real data demonstrate when: (1) utilizing a single category of constraint, the proposed model is superior to or competitive with SOTA constrained clustering models, and (2) utilizing both categories of constraints jointly, the proposed model shows better performance than the case of the single category. The experiments show that the proposed method exploits the constraints to achieve perfect clustering performance with improved clustering to 2%-5% in classical clustering metrics, e.g. Adjusted Random, Mirkin's, and Huber's, indices outerperfomring other methods.

Sparse Neighbor Constrained Co-Clustering Via Category Consistency Learning

Penalized Nonnegative Nonnegative Matrix Tri-Factorization For Co-Clustering

Consensus Clustering With Co-Association Matrix Optimization

Co-Clustering With Manifold And Double Sparse Representation

A probabilistic constrained clustering for transfer learning and image category discovery.

Maintaining Consistency with Constraints: A Constrained Deep Clustering Method

Sparse Learning Based Linear Coherent Bi-clustering.

Learning an Optimal Bipartite Graph for Subspace Clustering Via Constrained Laplacian Rank

Constrained Clustering: General Pairwise and Cardinality Constraints

Robust co-clustering via dual local learning and high-order matrix factorization

Adaptive Local Learning Regularized Nonnegative Matrix Factorization for Data Clustering.

Constrained neighborhood preserving concept factorization for data representation.

Constrained Neighborhood Preserving Concept Factorization for Data Representation

Subspace Clustering Via Good Neighbors

Exploiting Correlation Consensus: Towards Subspace Clustering For Multi-Modal Data

Adaptive Local Structure Learning for Document Co-Clustering

Robust Adaptive Graph Learning with Manifold Constraints for Subspace Clustering

NCCR: Neighbor and Cluster Consistency Regularization for Improving Graph Node Classification

Visual Object Clustering Via Mixed-Norm Regularization.

DNA: Denoised Neighborhood Aggregation for Fine-grained Category Discovery

Improving Clustering with Pairwise Constraints: a Discriminative Approach