Abstract:In the task of multiview multilabel (MVML) classification, each object is described by several heterogeneous view features and annotated with multiple relevant labels. Existing MVML methods usually assume that these heterogeneous features are strictly view-aligned, and they directly conduct cross-view information fusion to train a multilabel prediction model. However, in real-world scenarios, such strict view-aligned requirement can be hardly satisfied due to the recurrent spatiotemporal asynchronism when collecting MVML data, which would cause inaccurate multiview fusion results and degrade the classification performance. To address this issue, we propose a generalized nonaligned MVML (GNAM) classification method, which achieves multiview information fusion while aligning cross-view features and accordingly learns a desired multilabel classifier. Specifically, we first introduce a multiorder matching alignment strategy to achieve cross-view feature alignments, where both first-order feature correspondence and second-order structure correspondence are jointly integrated to guarantee the compactness of the view-alignment results. Afterward, a commonality-and individuality-based multiview fusion structure is formulated on the aligned-view features to excavate the consistencies and complementarities across different views, which leads all relevant multiview semantic labels, especially rare labels, to be characterized more comprehensively. Finally, we embed adaptive global label correlations to multilabel classification model to further enhance its semantic expression integrity and develop an alternative algorithm to optimize the whole model. Extensive experimental results have verified that GNAM is significantly superior to other state-of-the-art methods.

Label-Specific Alignment with Adversarial Multi-View Representation

Multi-View Analysis Dictionary Learning for Image Classification.

Multi-view Multi-label Learning with Shared Features Inconsistency

Common-Individual Semantic Fusion for Multi-View Multi-Label Learning

Relation-Aware Alignment Attention Network for Multi-view Multi-label Learning.

Dual Enhancement for Multi-Label Learning with Missing Labels

Align While Fusion: A Generalized Nonaligned Multiview Multilabel Classification Method

Multi-view multi-label learning for label-specific features via GLocal Shared Subspace Learning

Views Meet Labels: Personalized Relation Refinement Network for Multiview Multilabel Learning

Deep dual incomplete multi-view multi-label classification via label semantic-guided contrastive learning

CAMVR: Context-Adaptive Multi-View Representation Learning for Dense Retrieval

Global and local multi-view multi-label learning with incomplete views and labels

Individuality- and Commonality-Based Multiview Multilabel Learning

Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers

Weakly-Supervised Multi-view Multi-instance Multi-label Learning

Label recovery and label correlation co-learning for multi-view multi-label classification with incomplete labels

Deep Double Incomplete Multi-View Multi-Label Learning With Incomplete Labels and Missing Views

A two-stage multi-view partial multi-label learning for enhanced disambiguation

Labeling Complicated Objects: Multi-View Multi-Instance Multi-Label Learning

Self-adaptive label discovery and multi-view fusion for complementary label learning

Partial Multi-label Learning with Label and Feature Collaboration