Abstract:Salient Object Detection (SOD) is gradually applied in natural scene images. However, due to the apparent differences between optical remote sensing images and natural scene images, directly applying the SOD of natural scene images to optical remote sensing images has limited performance in global context information. Therefore, salient object detection in optical remote sensing images (ORSI-SOD) is challenging. Optical remote sensing images usually have large-scale variations. However, the vast majority of networks are based on Convolutional Neural Network (CNN) backbone networks such as VGG and ResNet, which can only extract local features. To address this problem, we designed a new model that employs a transformer-based backbone network capable of extracting global information and remote dependencies. A new framework is proposed for this question, named Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images (GMANet). In this framework, the Pyramid Vision Transformer (PVT) is an encoder to catch remote dependencies. A Multiscale Attention Module (MAM) is introduced for extracting multiscale information. Meanwhile, a Global Guiled Brach (GGB) is used to learn the global context information and obtain the complete structure. Four MAMs are densely connected to this GGB. The Aggregate Refinement Module (ARM) is used to enrich the details of edge and low-level features. The ARM fuses global context information and encoder multilevel features to complement the details while the structure is complete. Extensive experiments on two public datasets show that our proposed framework GMANet outperforms 28 state-of-the-art methods on six evaluation metrics, especially E-measure and F-measure. It is because we apply a coarse-to-fine strategy to merge global context information and multiscale information.

Multiscale and Multidimensional Weighted Network for Salient Object Detection in Optical Remote Sensing Images

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Multi-scale Feature Aggregation Network for Salient Object Detection in Optical Remote Sensing Images

Multiscale Feature Enhancement Network for Salient Object Detection in Optical Remote Sensing Images

Multilevel Interactive Reverse-Guided Network for Salient Object Detection in Optical Remote Sensing Images

Cross-Modal Weighting Network for RGB-D Salient Object Detection

Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images

Lightweight Salient Object Detection in Optical Remote-Sensing Images Via Semantic Matching and Edge Alignment

Edge-Aware Multiscale Feature Integration Network for Salient Object Detection in Optical Remote Sensing Images

ORSI Salient Object Detection Via Cross-Scale Interaction and Enlarged Receptive Field.

Dual-Stream Feature Collaboration Perception Network for Salient Object Detection in Remote Sensing Images

SFSANet: Multiscale Object Detection in Remote Sensing Image Based on Semantic Fusion and Scale Adaptability

Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

SLMSF-Net: A Semantic Localization and Multi-Scale Fusion Network for RGB-D Salient Object Detection

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images

SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images

RRNet: Relational Reasoning Network With Parallel Multiscale Attention for Salient Object Detection in Optical Remote Sensing Images

Bi-Branch Multiscale Feature Joint Network for ORSI Salient Object Detection in Adverse Weather Conditions