Abstract:Multi-view subspace clustering aims to discover the inherent structure of data by fusing multiple views of complementary information. Most existing methods first extract multiple types of handcrafted features and then learn a joint affinity matrix for clustering. The disadvantage of this approach lies in two aspects: 1) multi-view relations are not embedded into feature learning, and 2) the end-to-end learning manner of deep learning is not suitable for multi-view clustering. Even when deep features have been extracted, it is a nontrivial problem to choose a proper backbone for clustering on different datasets. To address these issues, we propose the Multi-view Deep Subspace Clustering Networks (MvDSCN), which learns a multi-view self-representation matrix in an end-to-end manner. The MvDSCN consists of two sub-networks, \ie, a diversity network (Dnet) and a universality network (Unet). A latent space is built using deep convolutional autoencoders, and a self-representation matrix is learned in the latent space using a fully connected layer. Dnet learns view-specific self-representation matrices, whereas Unet learns a common self-representation matrix for all views. To exploit the complementarity of multi-view representations, the Hilbert--Schmidt independence criterion (HSIC) is introduced as a diversity regularizer that captures the nonlinear, high-order inter-view relations. Because different views share the same label space, the self-representation matrices of each view are aligned to the common one by universality regularization. The MvDSCN also unifies multiple backbones to boost clustering performance and avoid the need for model selection. Experiments demonstrate the superiority of the MvDSCN.

Multi-view Teacher–Student Network

DMTMV: A Unified Learning Framework for Deep Multi-task Multi-view Learning.

Cross-modality Online Distillation for Multi-View Action Recognition

MVTN: Learning Multi-View Transformations for 3D Understanding

The Application of Target Embedding AutoEncoder based on Knowledge Distillation in Multi-View Multi-Label Classification

Cross-View Gait Recognition Method Based on Multi-Teacher Joint Knowledge Distillation

Multi-view knowledge distillation transformer for human action recognition

Collaborative Teacher-Student Learning via Multiple Knowledge Transfer

Teacher-student collaborative knowledge distillation for image classification

Deep Embedded Complementary and Interactive Information for Multi-View Classification

Multi-view Subspace Clustering Networks with Local and Global Graph Information

MTD-MVSNet: Multi-view Stereo Network with Multi-scale Transformer and Dual Attention

Multi-task self-supervised learning based fusion representation for Multi-view clustering

N2MVSNet: Non-Local Neighbors Aware Multi-View Stereo Network

Multi-View Stereo Network Based on Attention Mechanism and Neural Volume Rendering

Embedded Deep Bilinear Interactive Information and Selective Fusion for Multi-view Learning

MKTN: Adversarial-Based Multifarious Knowledge Transfer Network from Complementary Teachers

Multi-view Deep Subspace Clustering Networks

Learning from Multiple Teacher Networks

GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo

MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation