Abstract:In the field of remote sensing image processing, semantic segmentation has always been a hot research topic. Currently, deep convolutional neural networks (DCNNs) are the mainstream methods for the semantic segmentation of remote sensing image (RSI). There are two commonly used semantic segmentation methods based on DCNNs: multiscale feature extraction based on deep-level features, and global modeling. The former can better extract object features of different scales in complex scenes. However, this method lacks sufficient spatial information, resulting in poor edge segmentation ability. The latter can effectively solve the problem of limited receptive field in DCNNs obtaining more comprehensive feature extraction results. Unfortunately, this method is prone to misclassification, resulting in incorrect predictions of local pixels. To address these issues, we propose the dual-branch hybrid reinforcement network (DHRNet) for more precise semantic segmentation of RSI. This model is a dual-branch parallel structure with a multiscale feature extraction branch and a global context and detail enhancement branch. This structure decomposes the complex semantic segmentation task, allowing each branch to extract features with different emphases while retaining sufficient spatial information. The results of both branches are fused to obtain a more comprehensive segmentation result. After conducting extensive experiments on three publicly available RSI datasets, ISPRS Potsdam, ISPRS Vaihingen, and LoveDA, DHRNet demonstrates excellent results with the mean intersection over union of 86.97%, 83.53%, and 54.48% on the three datasets, respectively.

Coupling Two-Stream Rgb-D Semantic Segmentation Network By Idempotent Mappings

ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation.

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Learning Common and Specific Features for RGB-D Semantic Segmentation with Deconvolutional Networks

RFBNet: Deep Multimodal Networks with Residual Fusion Blocks for RGB-D Semantic Segmentation

RGB×D: Learning Depth-Weighted RGB Patches for RGB-D Indoor Semantic Segmentation

Interactive Efficient Multi-Task Network for RGB-D Semantic Segmentation

TCANet: three-stream coordinate attention network for RGB-D indoor semantic segmentation

Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation.

Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation

Self-Enhanced Feature Fusion for RGB-D Semantic Segmentation

Incorporating Luminance, Depth and Color Information by a Fusion-based Network for Semantic Segmentation

Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation

DHRNet: A Dual-Branch Hybrid Reinforcement Network for Semantic Segmentation of Remote Sensing Images

HAFFseg: RGB-Thermal semantic segmentation network with hybrid adaptive feature fusion strategy

Spatial-information Guided Adaptive Context-aware Network for Efficient RGB-D Semantic Segmentation

DHFNet: Decoupled Hierarchical Fusion Network for RGB-T dense prediction tasks

Optimizing rgb-d semantic segmentation through multi-modal interaction and pooling attention

Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation