Abstract:Objects are usually associated with multiple attributes, and these attributes often exhibit high correlations. Modeling complex relationships between attributes poses a great challenge for multi-attribute learning. This paper proposes a simple yet generic framework named Label2Label to exploit the complex attribute correlations. Label2Label is the first attempt for multi-attribute prediction from the perspective of language modeling. Specifically, it treats each attribute label as a "word" describing the sample. As each sample is annotated with multiple attribute labels, these "words" will naturally form an unordered but meaningful "sentence" , which depicts the semantic information of the corresponding sample. Inspired by the remarkable success of pre-training language models in NLP, Label2Label introduces an image-conditioned masked language model, which randomly masks some of the "word" tokens from the label "sentence" and aims to recover them based on the masked "sentence" and the context conveyed by image features. Our intuition is that the instance-wise attribute relations are well grasped if the neural net can infer the missing attributes based on the context and the remaining attribute hints. Label2Label is conceptually simple and empirically powerful. Without incorporating task-specific prior knowledge and highly specialized network designs, our approach achieves state-of-the-art results on three different multi-attribute learning tasks, compared to highly customized domain-specific methods. Code is available at https:// github.com/Li-Wanhua/Label2Label.

Combine Multi-Valued Attribute Decomposition with Multi-Label Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Decompose Learning: Combine Feature Extraction and Classification

Label2Label: A Language Modeling Framework for Multi-attribute Learning

Multi-Label Learning by Exploiting Label Correlations with LDA

Multi-label Classification via Label-Topic Pairs

A Divide-and-Conquer Approach for Large-Scale Multi-label Learning

Partial Multi-label Learning with Label and Feature Collaboration

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Multi-Dimensional Classification via Decomposed Label Encoding

Multi-Label Bayesian Active Learning with Inter-Label Relationships

Collaboration based multi-modal multi-label learning

Multi-Label Learning by Exploiting Label Correlations Locally

Multi-Label Learning with Deep Forest

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Multi-label Classification: Dealing with Imbalance by Combining Labels

Enhancing multi-label classification by modeling dependencies among labels.

Dual Set Multi-Label Learning

Capturing Correlations of Multiple Labels: A Generative Probabilistic Model for Multi-Label Learning

Large-Scale Multi-Label Learning with Incomplete Label Assignments