InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images

Wuzhou Li,Jiawei Zhou,Xiang Li,Yi Cao,Guang Jin,Xuemin Zhang
DOI: https://doi.org/10.1109/tgrs.2024.3475482
IF: 8.2
2024-10-25
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Few-shot detection in remote sensing images has witnessed significant advancements recently. Despite these progresses, the capacity for continuous conceptual learning still poses a significant challenge to existing methodologies. In this article, we explore the intricate task of incremental few-shot object detection (iFSOD) in remote sensing images. We present a pioneering transfer-learning-based technique, termed InfRS, designed to enable the incremental learning of novel classes using a restricted set of examples, while simultaneously preserving the knowledge learned from previously seen classes without the need to revisit old data. Specifically, we pretrain the detector using sufficient data from base datasets and then generate a set of classwise prototypes that represent the intrinsic characteristics of the data. In the incremental learning session, we design a hybrid prototypical contrastive (HPC) encoding module for learning discriminative representations. Furthermore, we develop a prototypical calibration strategy based on the Wasserstein distance to overcome the catastrophic forgetting problem. Comprehensive evaluations conducted with two aerial imagery datasets show that our InfRS effectively addresses the iFSOD issue in remote sensing imagery. Code is available at https://github.com/lyanna4869/InfRS.git.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?