Abstract:Multi-label classification (MLC) can attach multiple labels on single image, and has achieved promising results on medical images. But existing MLC methods still face challenging clinical realities in practical use, such as: (1) medical risks arising from misclassification, (2) sample imbalance problem among different diseases, (3) inability to classify the diseases that are not pre-defined (unseen diseases). Here, we design a hybrid label to improve the flexibility of MLC methods and alleviate the sample imbalance problem. Specifically, in the labeled training set, we remain independent labels for high-frequency diseases with enough samples and use a hybrid label to merge low-frequency diseases with fewer samples. The hybrid label can also be used to put unseen diseases in practical use. In this paper, we propose Triplet Attention and Dual-pool Contrastve Learning (TA-DCL) for multi-label medical image classification based on the aforementioned label representation. TA-DCL architecture is a triplet attention network (TAN), which combines category-attention, self-attention and cross-attention together to learn high-quality label embeddings for all disease labels by mining effective information from medical images. DCL includes dual-pool contrastive training (DCT) and dual-pool contrastive inference (DCI). DCT optimizes the clustering centers of label embeddings belonging to different disease labels to improve the discrimination of label embeddings. DCI relieves the error classification of sick cases for reducing the clinical risk and improving the ability to detect unseen diseases by contrast of differences. TA-DCL is validated on two public medical image datasets, ODIR and NIH-ChestXray14, showing superior performance than other state-of-the-art MLC methods. Code is available at https://github.com/ZhangYH0502/TA-DCL.

MLC Toolbox: A MATLAB/OCTAVE Library for Multi-Label Classification

A Multi-Class Large Margin Classifier

Compact learning for multi-label classification

MIML library: a Modular and Flexible Library for Multi-instance Multi-label Learning

Positive Label Is All You Need for Multi-Label Classification

Scalable Label Distribution Learning for Multi-Label Classification

MLCM: Multi-Label Confusion Matrix

Automated Machine Learning for Multi-Label Classification

A hybrid principal label space transformation-based ridge regression and decision tree for multi-label classification

Probability-based Label Enhancement for Multi-Dimensional Classification

Research of multi-label text classification based on label attention and correlation networks

Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labels

A Novel Learning-Based PLST Algorithm for Multi-Label Classification

CoMAL: Contrastive Active Learning for Multi-Label Text Classification

Multi-label classification by exploiting local positive and negative pairwise label correlation

Triplet attention and dual-pool contrastive learning for clinic-driven multi-label medical image classification

AdaBoost.C2: Boosting Classifiers Chains for Multi-Label Classification.

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

HCL-MTC: Hierarchical Contrastive Learning for Multi-label Text Classiﬁcation