Abstract:Label Distributed Learning (LDL) is an emerging machine learning paradigm that has received extensive research in recent years. Owing to the excellent capability in dealing with label ambiguity, LDL has been widely adopted in many real-world scenarios. Though remarkable progress has been achieved in various tasks, one limitation with existing LDL methods is that they are all based on the i.i.d. assumption that training and test data are identically and independently distributed. As a result, they suffer obvious performance degradation and are no longer applicable when tested in out-of-distribution scenarios, which severely limits the application of LDL in many tasks. In this paper, we identify and investigate the Generalizable Label Distribution Learning (GLDL) problem. To handle such a challenging problem, we delve into the characteristics of GLDL and find that feature-label correlation and label-label correlation are two essential subjects in GLDL. Inspired by this finding, we propose a simple yet effective model-agnostic framework named Domain-Invariant Correlation lEarning (DICE). DICE mines and utilizes the correlation between feature and label that are invariant across different domains to learn a generalizable feature-label correlation by introducing a prior alignment strategy. In the meantime, it leverages a label correlation alignment strategy to further retain the consistency of label-label correlation in different domains. Extensive experiments verify the superior performance of DICE. Our work fills the gap in benchmarks and techniques for practical GLDL problems.

Incomplete Label Distribution Learning by Exploiting Global Sample Correlation

Incomplete Label Distribution Learning Via Label Correlation Decomposition

Label Distribution Learning by Exploiting Sample Correlations Locally.

Label Distribution Learning by Exploiting Label Correlations.

Incomplete Label Distribution Learning

Label Distribution Learning by Exploiting Label Distribution Manifold

Label Distribution Learning with Label Correlations on Local Samples

Incomplete Label Distribution Learning Based on Supervised Neighborhood Information

Label Distribution Learning by Exploiting Fuzzy Label Correlation

Label Distribution Learning by Exploiting Feature-Label Correlations Locally

Label Distribution Learning with Label Correlations Via Low-Rank Approximation

Label Distribution Learning with High-Order Label Correlations.

Weakly Supervised Label Distribution Learning Based on Transductive Matrix Completion with Sample Correlations

Filling Missing Values by Local Reconstruction for Incomplete Label Distribution Learning.

Label Distribution Learning: A Local Collaborative Mechanism

Label Distribution Learning by Mining Local Label Correlations in Self-regulating Clusters Independent of Sample Distance

Exploiting Multi-Label Correlation in Label Distribution Learning

Generalizable Label Distribution Learning

Label Enhancement Using Inter-example Correlation Information

Safe Incomplete Label Distribution Learning

Label Distribution Learning with Label-Specific Features.