Abstract:Semantic segmentation of very-high-resolution (VHR) remote sensing images is of great significance, in which remote sensing can be applied to numerous fields. However, VHR remote sensing images are taken at different seasons and regions, causing the large intra-class and low inter-class variations of pixels. Thus, the state-of-the-art semantic segmentation network have considerable misclassifications and blurring of object boundaries. To solve the above problems, a deep learning-based semantic segmentation framework (DLSS) of VHR remote sensing images is proposed in this study, which comprising three stages. At the pre-processing stage, a novel data pre-processing method named Image Block Segmentation (IBS) is proposed to coarse segmentation of VHR remote sensing images at the image block scale. At the image segmentation stage, the different strategies are adopted to segment image blocks of different categories for fine segmentation. Through these two stages, this study implements a coarse-to-fine segmentation strategy, which reduces the phenomenon of misclassification by using different network models for low inter class variations of pixels. At the post-processing stage, a novel post-processing method termed Superpixel Cluster (SPC) is proposed to modify the segmentation results. SPC can capture fine details of objects and aggregating continuous pixels with similar characteristics into a set of superpixels, so as to ensure the boundary accuracy and internal consistency of ground object. Extensive experiments, including a comprehensive ablation study, confirm that IBS is capable of effectively reducing the misclassification, and SPC can correct the segmentation results significantly. The experimental results on the Gaofen Image Dataset (GID) suggest that the overall accuracy (OA) of the commonly utilized models combined with DLSS framework can increase, and the average is 2.05%. The code of DLSS is available at https://github.com/dxj620/Deep-learning-semantic-segementation.

An automatic region-based image segmentation algorithm for remote sensing applications

Accuracy Evaluation of Segmentation for High Resolution Imagery and 3D Laser Point Cloud Data

An Efficient Two-Objective Automatic Sar Image Segmentation Framework Using Artificial Immune System

An Object-Oriented Remote Sensing Image Segmentation Approach Based on Edge Detection

Interactive segmentation in aerial images: a new benchmark and an open access web-based tool

RSPS-SAM: A Remote Sensing Image Panoptic Segmentation Method Based on SAM

Local Scale-Guided Hierarchical Region Merging and Further Over- and Under-Segmentation Processing for Hybrid Remote Sensing Image Segmentation

A deep learning based framework for remote sensing image ground object segmentation

Segmentation Quality Evaluation Using Region-Based Precision and Recall Measures for Remote Sensing Images

Region of Interest Detection Based on Salient Feature Clustering for Remote Sensing Images

Boundary-constrained multi-scale segmentation method for remote sensing images

RSProtoSeg: High Spatial Resolution Remote Sensing Images Segmentation Based on Non-Learnable Prototypes

Segmentation for High-Resolution Optical Remote Sensing Imagery Using Improved Quadtree and Region Adjacency Graph Technique

Self-adaptive Segmentation of Satellite Images Based on a Weighted Aggregation Approach

Accurate Instance Segmentation for Remote Sensing Images via Adaptive and Dynamic Feature Learning

Efficient Instance Segmentation Paradigm for Interpreting SAR and Optical Images

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Common Regions of Interest Extraction Based on Saliency Statistic Analysis for Multiple Remote Sensing Images.

Design and Implementation of a High Spatial Resolution Remote Sensing Image Intelligent Interpretation System

SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraints

ALPS: An Auto-Labeling and Pre-training Scheme for Remote Sensing Segmentation With Segment Anything Model