Abstract:Label Distributed Learning (LDL) is an emerging machine learning paradigm that has received extensive research in recent years. Owing to the excellent capability in dealing with label ambiguity, LDL has been widely adopted in many real-world scenarios. Though remarkable progress has been achieved in various tasks, one limitation with existing LDL methods is that they are all based on the i.i.d. assumption that training and test data are identically and independently distributed. As a result, they suffer obvious performance degradation and are no longer applicable when tested in out-of-distribution scenarios, which severely limits the application of LDL in many tasks. In this paper, we identify and investigate the Generalizable Label Distribution Learning (GLDL) problem. To handle such a challenging problem, we delve into the characteristics of GLDL and find that feature-label correlation and label-label correlation are two essential subjects in GLDL. Inspired by this finding, we propose a simple yet effective model-agnostic framework named Domain-Invariant Correlation lEarning (DICE). DICE mines and utilizes the correlation between feature and label that are invariant across different domains to learn a generalizable feature-label correlation by introducing a prior alignment strategy. In the meantime, it leverages a label correlation alignment strategy to further retain the consistency of label-label correlation in different domains. Extensive experiments verify the superior performance of DICE. Our work fills the gap in benchmarks and techniques for practical GLDL problems.

COS-LDL: Label Distribution Learning by Cosine-Based Distance-Mapping Correlation

Label Distribution Learning by Exploiting Label Correlations.

Label Distribution Learning by Exploiting Feature-Label Correlations Locally

Label Distribution Learning with High-Order Label Correlations.

Label Distribution Learning by Exploiting Fuzzy Label Correlation

Label Distribution Learning by Exploiting Sample Correlations Locally.

Label Distribution Learning with Label Correlations Via Low-Rank Approximation

Label Distribution Learning: A Local Collaborative Mechanism

Label Distribution Learning with Label Correlations on Local Samples

Label Distribution Learning by Exploiting Label Distribution Manifold

Exploiting Multi-Label Correlation in Label Distribution Learning

Label Distribution Learning by Mining Local Label Correlations in Self-regulating Clusters Independent of Sample Distance

Incomplete Label Distribution Learning by Exploiting Global Sample Correlation

Two-stage Label Distribution Learning with Label-Independent Prediction Based on Label-Specific Features

Multi-Label Active Learning With Label Correlation For Image Classification

Label Distribution Learning by Optimal Transport.

Incomplete Label Distribution Learning Via Label Correlation Decomposition

Label Distribution Learning with Label-Specific Features.

Generalizable Label Distribution Learning

Weakly Supervised Label Distribution Learning Based on Transductive Matrix Completion with Sample Correlations

Label Distribution Learning Through Exploring Nonnegative Components