Abstract:Salient Object Detection (SOD) is gradually applied in natural scene images. However, due to the apparent differences between optical remote sensing images and natural scene images, directly applying the SOD of natural scene images to optical remote sensing images has limited performance in global context information. Therefore, salient object detection in optical remote sensing images (ORSI-SOD) is challenging. Optical remote sensing images usually have large-scale variations. However, the vast majority of networks are based on Convolutional Neural Network (CNN) backbone networks such as VGG and ResNet, which can only extract local features. To address this problem, we designed a new model that employs a transformer-based backbone network capable of extracting global information and remote dependencies. A new framework is proposed for this question, named Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images (GMANet). In this framework, the Pyramid Vision Transformer (PVT) is an encoder to catch remote dependencies. A Multiscale Attention Module (MAM) is introduced for extracting multiscale information. Meanwhile, a Global Guiled Brach (GGB) is used to learn the global context information and obtain the complete structure. Four MAMs are densely connected to this GGB. The Aggregate Refinement Module (ARM) is used to enrich the details of edge and low-level features. The ARM fuses global context information and encoder multilevel features to complement the details while the structure is complete. Extensive experiments on two public datasets show that our proposed framework GMANet outperforms 28 state-of-the-art methods on six evaluation metrics, especially E-measure and F-measure. It is because we apply a coarse-to-fine strategy to merge global context information and multiscale information.

Multi-scale Feature Aggregation Network for Salient Object Detection in Optical Remote Sensing Images

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Multiscale Feature Enhancement Network for Salient Object Detection in Optical Remote Sensing Images

Multiscale and Multidimensional Weighted Network for Salient Object Detection in Optical Remote Sensing Images

Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images

Multilevel Interactive Reverse-Guided Network for Salient Object Detection in Optical Remote Sensing Images

ORSI Salient Object Detection Via Cross-Scale Interaction and Enlarged Receptive Field.

MFCANet: Multiscale Feature Context Aggregation Network for Oriented Object Detection in Remote-Sensing Images

Bi-Branch Multiscale Feature Joint Network for ORSI Salient Object Detection in Adverse Weather Conditions

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images

A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images

RRNet: Relational Reasoning Network With Parallel Multiscale Attention for Salient Object Detection in Optical Remote Sensing Images

ORSI Salient Object Detection via Progressive Semantic Flow and Uncertainty-Aware Refinement

One-stop multiscale reconciliation attention network with scribble supervision for salient object detection in optical remote sensing images

Salient Object Detection in Optical Remote Sensing Images Based on Global Context Mixed Attention

CRNet: Channel-Enhanced Remodeling-Based Network for Salient Object Detection in Optical Remote Sensing Images

RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

ORSI Salient Object Detection via Multiscale Joint Region and Boundary Model

Edge-Aware Multiscale Feature Integration Network for Salient Object Detection in Optical Remote Sensing Images

Multi-modality information refinement fusion network for RGB-D salient object detection