Abstract:We consider the problem of segmentation and classification of high-resolution and hyperspectral remote sensing images. Unlike conventional natural (RGB) images, the inherent large scale and complex structures of remote sensing images pose major challenges such as spatial object distribution diversity and spectral information extraction when existing models are directly applied for image classification. In this study, we develop an attention-based pyramid network for segmentation and classification of remote sensing datasets. Attention mechanisms are used to develop the following modules: i) a novel and robust attention-based multi-scale fusion method effectively fuses useful spatial or spectral information at different and same scales; ii) a region pyramid attention mechanism using region-based attention addresses the target geometric size diversity in large-scale remote sensing images; and iii cross-scale attention} in our adaptive atrous spatial pyramid pooling network adapts to varied contents in a feature-embedded space. Different forms of feature fusion pyramid frameworks are established by combining these attention-based modules. First, a novel segmentation framework, called the heavy-weight spatial feature fusion pyramid network (FFPNet), is proposed to address the spatial problem of high-resolution remote sensing images. Second, an end-to-end spatial--spectral FFPNet is presented for classifying hyperspectral images. Experiments conducted on ISPRS Vaihingen and ISPRS Potsdam high-resolution datasets demonstrate the competitive segmentation accuracy achieved by the proposed heavy-weight spatial FFPNet. Furthermore, experiments on the Indian Pines and the University of Pavia hyperspectral datasets indicate that the proposed spatial--spectral FFPNet outperforms the current state-of-the-art methods in hyperspectral image classification.

Fully Contextual Network for Hyperspectral Scene Parsing

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Adaptive Context Network for Scene Parsing

OCNet: Object Context Network for Scene Parsing

Adaptive Pyramid Context Network for Semantic Segmentation

Global-Guided Selective Context Network for Scene Parsing

Adaptive Spectral Spatial Multiscale Contextual Feature Extraction for Hyperspectral Image Classification

Context Prior Based Semantic-Spatial Graph Network for Human Parsing.

HCNet: Hierarchical Context Network for Semantic Segmentation

HSNet: Hierarchical Semantics Network for Scene Parsing

Context-Integrated and Feature-Refined Network for Lightweight Object Parsing

Preserving Details in Semantics-Aware Context for Scene Parsing.

Context Aggregation Network for Remote Sensing Image Semantic Segmentation

Spatial--spectral FFPNet: Attention-Based Pyramid Network for Segmentation and Classification of Remote Sensing Images

Toward Achieving Robust Low-Level and High-Level Scene Parsing

Filling the Gaps in Atrous Convolution: Semantic Segmentation with a Better Context

ContextNet: Learning Context Information for Texture-Less Light Field Depth Estimation.

CATNet: Context AggregaTion Network for Instance Segmentation in Remote Sensing Images.

Double-Branch Local Context Feature Extraction Network for Hyperspectral Image Classification

Attention-Based Context Aware Network for Semantic Comprehension of Aerial Scenery

SPNet: Superpixel Pyramid Network for Scene Parsing