An Evaluation of Representative Samples Replay and Knowledge Distillation Regularization for SAR ATR Continual Learning

Hao Sun,Yanjie Xu,Kai Fu,Lin Lei,Kefeng Ji,Gangyao Kuang
DOI: https://doi.org/10.1109/piers62282.2024.10618705
2024-01-01
Abstract:Synthetic aperture radar (SAR) remote sensing is not affected by weather and is widely used in both military and civilian fields. Automatic target recognition (ATR) algorithms can quickly locate and recognize different kinds of targets from SAR images, greatly improving the application value of SAR images. Most of the existing SAR ATR technologies rely on deep neural network (DNN) models. However, DNN based SAR ATR relies on the assumption that the training data and the testing data are independently and identically distributed. Furthermore, DNN models cannot continuously learn multiple tasks effectively. They face the dilemma of catastrophic forgetting when learning new targets. This paper reviews the recent progress of continual learning and provides a detailed analysis of the typical modules to alleviate catastrophic forgetting. Several state-of-the-art DNN continual learning methods have been evaluted for SAR automatic vechicle recognition and ship recognition applications. Experimental results demonstrated that a combination of both data-driven representative samples replay and knowledge-driven distillation regularization helps to improve the recognition accuracy under class incremental learning settings.
What problem does this paper attempt to address?