A Multiscale Incremental Learning Network for Remote Sensing Scene Classification

Zhen Ye,Yu Zhang,Jinxin Zhang,Wei Li,Lin Bai
DOI: https://doi.org/10.1109/tgrs.2024.3353737
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:To infer unknown remote sensing scenarios, for remote sensing scene classification (RSSC) most existing deep neural networks (DNNs) are trained on closed datasets. When the acquisition speed and quantity of remote sensing images increases rapidly, these models cannot be used to classify new scenes. Currently, incremental learning as an effective solution for solving the catastrophic forgetting issue, but ignoring the stability-plasticity dilemma . In this paper, we propose a new incremental learning network, named efficient channel attention-based multiscale depthwise network (ECA-MSDWNet), in which efficient channel attention (ECA) improve the model’s ability to focus on critical information in complex context and multiscale depthwise convolution (MSDW Conv) extracts multiscale features in a fine-grained way. In addtion, in incremental learning process, we expand new modules based on a dynamic-structure method to fit the residuals between the labels and the outputs of the old model, enhancing the plasticity of the new model for new tasks while maintaining the performance of the old tasks. Finally, we compress the model to reduce redundant parameters and feature dimensions through an effective knowledge distillation strategy. Experiments on four open datasets demonstrate the effectiveness of our method. Our code is available at https://github.com/zhangyu-chd/ECA-MSDWNet.
What problem does this paper attempt to address?