A Hybrid Framework Based on Classifier Calibration for Imbalanced Aerial Scene Recognition

Yihong Zhuang,Changxing Jing,Senlin Cai,Lexing Huang,Yue Huang,Xiaotong Tu,Xinghao Ding
DOI: https://doi.org/10.1007/978-3-031-30111-7_10
2023-01-01
Abstract:Aerial scene images are often imbalanced, where the most common classes as majorities and a few significant classes as minorities. We observe that the majority classes not only dominate the classification optimization but also generate deviations that affect the classifier weight matrices. In this work, we propose a hybrid framework based on classifier calibration, which mitigate the effect of the class imbalance problem in aerial scene recognition. In particular, the framework progressively incorporates feature representation and classifier learning branches, while building a memory bank of learned representations for approximating deviations derived from imbalanced data. We calibrate the classifier by excluding the deviations in the prediction of the testing stage. Extensive experiments are evaluated on class imbalanced aerial scene image datasets, which show the advantages of the proposed hybrid framework with classifier calibration outperforming state-of-the-art aerial scene recognition methods.
What problem does this paper attempt to address?