Transduction Enhanced Inductive Inference for Imbalanced Classification in Medical Images

Yizhe Zhang,Tao Zhou,Ye Wu,Shuo Wang,Danny Z. Chen
DOI: https://doi.org/10.1109/isbi56570.2024.10635370
2024-01-01
Abstract:In medical images, disease and rare cases often have a much smaller population than normal cases. Due to their smaller sample sizes, these minority classes can easily be overwhelmed by the majority classes during model training. Disease and rare cases are of main interest in medical image analysis and diagnosis. Techniques such as class re-weighting, minority over-sampling, and majority under-sampling have been used to tackle the class imbalance problem. Although these techniques showed successes, their hyper-parameters (e.g., class weights) are not easy to determine and adjust in practice, and their effects can be marginal in sub-optimal settings. In another track of research, algorithms such as under-bagging KNN perform balanced transductive inference in a given feature space. This type of algorithms shows strong theoretical guarantee and impressive empirical results for imbalanced classification but is restricted by the quality of the given features. In this paper, we propose to combine a class-balanced transductive inference method with an inductive inference model (e.g., ResNet) in such a way that: (1) the inductive learning will yield features more suitable for transductive inference for classification on imbalanced data, and (2) classification performance can be significantly improved by the transductive inference performed on top of the inductively learned features. Our proposed Transduction Enhanced Inductive Inference (TEII) is novel, theoretically sound, and effective in training time and test time. Experiments on three public classification datasets show that our TEII delivers impressive results on data exhibiting moderate to severe class-imbalance behaviors.
What problem does this paper attempt to address?