Weakly Correlated Distillation for Remote Sensing Object Recognition

Wenda Zhao,Xiangzhu Lv,Haipeng Wang,Yu Liu,You He,Huchuan Lu
DOI: https://doi.org/10.1109/tgrs.2023.3317264
IF: 8.2
2023-10-04
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Remote sensing object labels require high specialization, resulting in a limited number of labeled samples. Without large labeled samples to support training, general remote sensing object recognition models have limited accuracy. Addressing this issue, this article proposes a weakly correlated distillation learning framework for remote sensing object recognition with a small number of samples. Benefitting from large-scale natural image datasets, many recognition models achieve superior feature extraction capabilities. Thus, we use them as backbones to build teacher models, and then fine-tune the teacher models with a small-scale remote sensing dataset. However, due to the limited number of remote sensing samples, the teacher models may produce noisy features that reduce the performance of the student model. Therefore, we propose a weakly correlated distillation method that selects the weakly correlated features from teacher models to distill the student. Since the weakly correlated features contain different noise distributions that can be mutually suppressed, thereby improving the performance of the student. Extensive experiments on three widely-used datasets of DOTA, HRRSD, and NWPU VHR-10 demonstrate the superior performance of our method compared with the state of the arts (SOTA). Code is available at: https://github.com/wdzhao123/WCD.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?