Abstract:Semantic labeling of very high-resolution remote sensing images (VHRRSI) has emerged as a crucial research area in remote sensing image interpretation. However, challenges arise due to significant variations in target orientation and scale, particularly for small targets that are more prone to obscuration and misidentification. The high interclass similarity and low intraclass similarity further exacerbate difficulties in distinguishing objects with similar color and geographic location. To address this concern, we introduce a self-cascading multiscale network (ScasMNet) based on a fully convolutional network, aimed at enhancing the segmentation precision for each category in remote sensing images (RSIs). In ScasMNet, cropped Digital Surface Model (DSM) data and corresponding RGB data are fed into the network via two distinct paths. In the encoder stage, one branch utilizes convolution to extract height information from DSM images layer by layer, enabling better differentiation of trees and low vegetation with similar color and geographic location. A parallel branch extracts spatial, color, and texture information from the RGB data. By cascading the features of different layers, the heterogeneous data are fused to generate complementary discriminative characteristics. Lastly, to refine segmented edges, fully conditional random fields (DenseCRFs) are employed for postprocessing presegmented images. Experimental findings showcase that ScasMNet achieves an overall accuracy (OA) of 92.74% on two challenging benchmarks, demonstrating its outstanding performance, particularly for small-scale objects. This demonstrates that ScasMNet ranks among the state-of-the-art methods in addressing challenges related to semantic segmentation in RSIs.

Context-aware Cascade Network for Semantic Labeling in VHR Image

Semantic Labeling of Very High-Resolution Imagery by Leveraging Contextual Information with Optimized Non-Local Neural Network.

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

Real-Time Dense Semantic Labeling with Dual-Path Framework for High-Resolution Remote Sensing Image

High-Resolution Semantic Labeling with Convolutional Neural Networks

Semantic Labeling Of High Resolution Aerial Imagery And Lidar Data With Fine Segmentation Network

Contextually guided very-high-resolution imagery classification with semantic segments

HCNet: Hierarchical Context Network for Semantic Segmentation

Cascaded CNN and global–local attention transformer network-based semantic segmentation for high-resolution remote sensing image

Mining Hierarchical Information of CNNs for Scene Classification of VHR Remote Sensing Images.

Multibranch Spatial-Channel Attention for Semantic Labeling of Very High-Resolution Remote Sensing Images.

High-Resolution Aerial Imagery Semantic Labeling With Dense Pyramid Network

Attention-Guided Label Refinement Network For Semantic Segmentation Of Very High Resolution Aerial Orthoimages

Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.

Attention-Based Context Aware Network for Semantic Comprehension of Aerial Scenery

Context Union Edge Network for Semantic Segmentation of Small-Scale Objects in Very High Resolution Remote Sensing Images

Learning to Segment Objects of Various Sizes in VHR Aerial Images.

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Semantic Segmentation for High-Resolution Aerial Imagery Using Multi-Skip Network and Markov Random Fields

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

Dual-Path Sparse Hierarchical Network for Semantic Segmentation of Remote Sensing Images