Abstract:Contrastive learning-based deep multi-view clustering methods have become a mainstream solution for unlabeled multi-view data. These methods usually utilize a basic structure that combines autoencoder, contrastive learning, or/and MLP projectors to generate more representative latent representations for the final clustering stage. However, existing deep contrastive multi-view clustering ignores two key points: (i) the latent representations projecting from one or more layers of MLP or new representations directly obtained from autoencoder fail to mine inherent relationship inner-view or cross-views; (ii) more existing frameworks only employ a one or dual-contrastive learning module, i.e., view- or/and category-oriented, which may result in the lack of communication between latent representations and clustering assignments. This paper proposes a new composite attention framework for contrastive multi-view clustering to address the above two challenges. Our method learns latent representations utilizing composite attention structure, i.e., Hierarchical Transformer for each view and Shared Attention for all views, rather than simple MLP. As a result, the learned representations can simultaneously preserve important features inside the view and balance the contributions across views. In addition, we add a new communication loss in our new dual contrastive framework. The common semantics will be brought into clustering assignments by pushing clustering assignments closer to the fused latent representations. Therefore, our method will provide a higher quality of clustering assignments for the segmentation problem of unlabeled multi-view data. The extensive experiments on several real data demonstrate that the proposed method can achieve superior performance over many state-of-the-art clustering algorithms, especially the significant improvement of an average of 10% on datasets Caltech and its subsets according to accuracy.

Composite attention mechanism network for deep contrastive multi-view clustering

AMCFCN: attentive multi-view contrastive fusion clustering net

Dual Contrast-Driven Deep Multi-View Clustering

Simple Contrastive Multi-View Clustering with Data-Level Fusion

Multi-View Clustering with Semantic Fusion and Contrastive Learning

Incomplete multi-view clustering via attention-based contrast learning

Deep Co-Attention Network for Multi-View Subspace Learning

Graph Structure Aware Contrastive Multi-View Clustering

Global and local combined contrastive learning for multi-view clustering

A Clustering-guided Contrastive Fusion for Multi-view Representation Learning

Contrastive Consistency and Attentive Complementarity for Deep Multi-View Subspace Clustering

Multi-level Feature Learning for Contrastive Multi-view Clustering

Contrastive and View-Interaction Structure Learning for Multi-view Clustering

Dual-Contrastive Multi-view Clustering under the Guidance of Global Similarity and Pseudo-label

Progressive Neighbor-masked Contrastive Learning for Fusion-style Deep Multi-view Clustering

Multi-view Contrastive Clustering Via Integrating Graph Aggregation and Confidence Enhancement

Graph Contrastive Partial Multi-View Clustering

CCR-Net: Consistent Contrastive Representation Network for Multi-View Clustering.

View-Driven Multi-View Clustering via Contrastive Double-Learning

Incomplete Contrastive Multi-View Clustering with High-Confidence Guiding