SMDC-Net: Saliency-Guided Multihead Distribution Calibration Network for Few-Shot Object Detection on Remote Sensing Images

Jiayi Wu,Chuan Qin,Guorui Feng
DOI: https://doi.org/10.1109/lgrs.2024.3385399
IF: 5.343
2024-04-19
IEEE Geoscience and Remote Sensing Letters
Abstract:Object detection on remote sensing images (RSIs) is a critical component of RSI processing techniques. Nonetheless, as the complexity of the model structure increases, more training data is required to prevent a severe decline in object detection performance. This requirement highlights the potential of few-shot object detection techniques. At present, few researches have been investigated for few-shot object detection on RSIs. To address this situation, we propose the saliency-guided multihead distribution calibration network (SMDC-Net) by building upon the existing fine-tuning-based two-stage few-shot object detection approach. We employ an RSI salient object detection (SOD) branch that leverages the feature of RSIs to predict the saliency maps. These predicted saliency maps are used as an attention map to augment the feature of RSIs. Meanwhile, to guarantee the ability of the network to identify objects in both the base and novel categories accurately, we design a multihead detector that can recognize objects in base and novel categories separately while introducing a consistency loss to supervise the consistency of the multihead predicted labels. We evaluate the performance of two widely recognized RSI datasets (i.e., DIOR and NWPU VHR-10) in various experimental settings for comparison and ablation analysis. The results illustrate that SMDC-Net enhances the detection performance of novel categories by approximately 3% compared to the state-of-the-art MM-RCNN while preserving the performance of base categories.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?