Abstract:As we all know, multi-view data is more expressive than single-view data and multi-label annotation enjoys richer supervision information than single-label, which makes multi-view multi-label learning widely applicable for various pattern recognition tasks. In this complex representation learning problem, three main challenges can be characterized as follows: i) How to learn consistent representations of samples across all views? ii) How to exploit and utilize category correlations of multi-label to guide inference? iii) How to avoid the negative impact resulting from the incompleteness of views or labels? To cope with these problems, we propose a general multi-view multi-label learning framework named label-guided masked view- and category-aware transformers in this paper. First, we design two transformer-style based modules for cross-view features aggregation and multi-label classification, respectively. The former aggregates information from different views in the process of extracting view-specific features, and the latter learns subcategory embedding to improve classification performance. Second, considering the imbalance of expressive power among views, an adaptively weighted view fusion module is proposed to obtain view-consistent embedding features. Third, we impose a label manifold constraint in sample-level representation learning to maximize the utilization of supervised information. Last but not least, all the modules are designed under the premise of incomplete views and labels, which makes our method adaptable to arbitrary multi-view and multi-label data. Extensive experiments on five datasets confirm that our method has clear advantages over other state-of-the-art methods.

Views Meet Labels: Personalized Relation Refinement Network for Multiview Multilabel Learning

Relation-Aware Alignment Attention Network for Multi-view Multi-label Learning.

Common-Individual Semantic Fusion for Multi-View Multi-Label Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Label-Specific Alignment with Adversarial Multi-View Representation

Multi-view Multi-label Learning with Shared Features Inconsistency

Individuality- and Commonality-Based Multiview Multilabel Learning

Deep Double Incomplete Multi-View Multi-Label Learning With Incomplete Labels and Missing Views

Global and local multi-view multi-label learning with incomplete views and labels

Partial Multi-label Learning with Label and Feature Collaboration

Deep Incomplete Multi-View Learning Network with Insufficient Label Information

Rethinking Modal-oriented Label Correlations for Multi-modal Multi-label Learning

Reliable Representations Learning for Incomplete Multi-View Partial Multi-Label Classification

Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers

Multi-scale locality preserving projection for partial multi-view incomplete multi-label learning

Embedding Regularizer Learning for Multi-View Semi-Supervised Classification.

Label recovery and label correlation co-learning for multi-view multi-label classification with incomplete labels

Partially Shared Latent Factor Learning with Multiview Data

Deep dual incomplete multi-view multi-label classification via label semantic-guided contrastive learning

A two-stage multi-view partial multi-label learning for enhanced disambiguation

Multiview Concept Learning Via Deep Matrix Factorization