Abstract:We consider the problem of segmentation and classification of high-resolution and hyperspectral remote sensing images. Unlike conventional natural (RGB) images, the inherent large scale and complex structures of remote sensing images pose major challenges such as spatial object distribution diversity and spectral information extraction when existing models are directly applied for image classification. In this study, we develop an attention-based pyramid network for segmentation and classification of remote sensing datasets. Attention mechanisms are used to develop the following modules: i) a novel and robust attention-based multi-scale fusion method effectively fuses useful spatial or spectral information at different and same scales; ii) a region pyramid attention mechanism using region-based attention addresses the target geometric size diversity in large-scale remote sensing images; and iii cross-scale attention} in our adaptive atrous spatial pyramid pooling network adapts to varied contents in a feature-embedded space. Different forms of feature fusion pyramid frameworks are established by combining these attention-based modules. First, a novel segmentation framework, called the heavy-weight spatial feature fusion pyramid network (FFPNet), is proposed to address the spatial problem of high-resolution remote sensing images. Second, an end-to-end spatial--spectral FFPNet is presented for classifying hyperspectral images. Experiments conducted on ISPRS Vaihingen and ISPRS Potsdam high-resolution datasets demonstrate the competitive segmentation accuracy achieved by the proposed heavy-weight spatial FFPNet. Furthermore, experiments on the Indian Pines and the University of Pavia hyperspectral datasets indicate that the proposed spatial--spectral FFPNet outperforms the current state-of-the-art methods in hyperspectral image classification.

A 2 -FPN for semantic segmentation of fine-resolution remotely sensed images

A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

A^2-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentation

A<sup>2</sup>-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentation

AF$_2$: Adaptive Focus Framework for Aerial Imagery Segmentation

AF2: Adaptive Focus Framework for Aerial Imagery Segmentation

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

SemSegFPA: Semantic Segmentation Feature Pyramid Network with Attention Module

Spatial--spectral FFPNet: Attention-Based Pyramid Network for Segmentation and Classification of Remote Sensing Images

FPANet: Feature Pyramid Aggregation Network for Real-Time Semantic Segmentation

AFNet: Adaptive Fusion Network for Remote Sensing Image Semantic Segmentation

Semantic Labeling Of High Resolution Aerial Imagery And Lidar Data With Fine Segmentation Network

AF: Adaptive Focus Framework for Aerial Imagery Segmentation

S$^2$-FPN: Scale-ware Strip Attention Guided Feature Pyramid Network for Real-time Semantic Segmentation

Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images

Feature Fusion Detector for Semantic Cognition of Remote Sensing

FPANet: Feature-enhanced Position Attention Network for Semantic Segmentation

LR-FPN: Enhancing Remote Sensing Object Detection with Location Refined Feature Pyramid Network

A Frequency Domain Feature-Guided Network for Semantic Segmentation of Remote Sensing Images

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images