Self-Weighted Contrastive Fusion for Deep Multi-View Clustering

Song Wu,Yan Zheng,Yazhou Ren,Jing He,Xiaorong Pu,Shudong Huang,Zhifeng Hao,Lifang He
DOI: https://doi.org/10.1109/tmm.2024.3387298
IF: 7.3
2024-01-01
IEEE Transactions on Multimedia
Abstract:Multi-view clustering can explore consensus information from multiple views and has attracted increasing attention in the past two decades. However, existing works face two major challenges: i) how to deal with the conflict between learning view-consensus information and reconstructing inconsistent view-private information and ii) how to mitigate representation degeneration caused by implementing the consistency objective for multi-view data. To address these challenges, we propose a novel framework of self-weighted contrastive fusion for deep multi-view clustering (SCMVC). First, our method establishes a hierarchical feature fusion framework, effectively segregating the consistency objective from the reconstruction objective. Then, multi-view contrastive fusion is implemented via maximizing consistency expression between the view-consensus representation and global representation, fully exploring the view consistency and complementary. More importantly, we propose to measure the discrepancy between pairwise representations, and then introduce a self-weighting method, which adaptively strengthens useful views in feature fusion and weakens unreliable views, to mitigate representation degeneration. Extensive experiments on nine public datasets demonstrate that our proposed method achieves state-of-the-art clustering performance.
What problem does this paper attempt to address?