Abstract:Salient Object Detection (SOD) is gradually applied in natural scene images. However, due to the apparent differences between optical remote sensing images and natural scene images, directly applying the SOD of natural scene images to optical remote sensing images has limited performance in global context information. Therefore, salient object detection in optical remote sensing images (ORSI-SOD) is challenging. Optical remote sensing images usually have large-scale variations. However, the vast majority of networks are based on Convolutional Neural Network (CNN) backbone networks such as VGG and ResNet, which can only extract local features. To address this problem, we designed a new model that employs a transformer-based backbone network capable of extracting global information and remote dependencies. A new framework is proposed for this question, named Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images (GMANet). In this framework, the Pyramid Vision Transformer (PVT) is an encoder to catch remote dependencies. A Multiscale Attention Module (MAM) is introduced for extracting multiscale information. Meanwhile, a Global Guiled Brach (GGB) is used to learn the global context information and obtain the complete structure. Four MAMs are densely connected to this GGB. The Aggregate Refinement Module (ARM) is used to enrich the details of edge and low-level features. The ARM fuses global context information and encoder multilevel features to complement the details while the structure is complete. Extensive experiments on two public datasets show that our proposed framework GMANet outperforms 28 state-of-the-art methods on six evaluation metrics, especially E-measure and F-measure. It is because we apply a coarse-to-fine strategy to merge global context information and multiscale information.

Global Perception Network for Salient Object Detection in Remote Sensing Images

GPONet: A two-stream gated progressive optimization network for salient object detection

Object Detection Based on Global-Local Saliency Constraint in Aerial Images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images

SGMFNet: a remote sensing image object detection network based on spatial global attention and multi-scale feature fusion

GAB-Net: A Robust Detector for Remote Sensing Object Detection Under Dramatic Scale Variation and Complex Backgrounds

Global Semantic-Sense Aggregation Network for Salient Object Detection in Remote Sensing Images

PDNet: Prior-model Guided Depth-enhanced Network for Salient Object Detection

Object Detection in Remote Sensing Imagery Based on Prototype Learning Network With Proposal Relation

CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images

Global-prior-guided fusion network for salient object detection

Large Selective Kernel Network for Remote Sensing Object Detection

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

Dual-Stream Feature Collaboration Perception Network for Salient Object Detection in Remote Sensing Images

Global Context Dependencies Aware Network for Efficient Semantic Segmentation of Fine-Resolution Remoted Sensing Images

Salient Object Detection in Optical Remote Sensing Images Based on Global Context Mixed Attention

PRNet: Parallel Refinement Network With Group Feature Learning for Salient Object Detection in Optical Remote Sensing Images

Global–Local Semantic Interaction Network for Salient Object Detection in Optical Remote Sensing Images With Scribble Supervision

Salient Object Detection in Optical Remote Sensing Images Driven by Transformer