Abstract:Semantic segmentation in high resolution remote sensing images is a fundamental and challenging task. Convolutional neural networks (CNNs), such as fully convolutional network (FCN) and SegNet, have shown outstanding performance in many segmentation tasks. One key pillar of these successes is mining useful information from features in convolutional layers for producing high resolution segmentation maps. For example, FCN nonlinearly combines high-level features extracted from last convolutional layers; whereas SegNet utilizes a deconvolutional network which takes as input only coarse, high-level feature maps of the last convolutional layer. However, how to better fuse multi-level convolutional feature maps for semantic segmentation of remote sensing images is underexplored. In this work, we propose a novel bidirectional network called recurrent network in fully convolutional network (RiFCN), which is end-to-end trainable. It has a forward stream and a backward stream. The former is a classification CNN architecture for feature extraction, which takes an input image and produces multi-level convolutional feature maps from shallow to deep; while in the later, to achieve accurate boundary inference and semantic segmentation, boundary-aware high resolution feature maps in shallower layers and high-level but low-resolution features are recursively embedded into the learning framework (from deep to shallow) to generate a fused feature representation that draws a holistic picture of not only high-level semantic information but also low-level fine-grained details. Experimental results on two widely-used high resolution remote sensing data sets for semantic segmentation tasks, ISPRS Potsdam and Inria Aerial Image Labeling Data Set, demonstrate competitive performance obtained by the proposed methodology compared to other studied approaches.

Semantic Labeling Of High Resolution Aerial Imagery And Lidar Data With Fine Segmentation Network

Semantic Segmentation of Aerial Image Using Fully Convolutional Network.

High-Resolution Aerial Images Semantic Segmentation Using Deep Fully Convolutional Network with Channel Attention Mechanism

Developing a multi-filter convolutional neural network for semantic segmentation using high-resolution aerial imagery and LiDAR data

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Semantic Segmentation for High-Resolution Aerial Imagery Using Multi-Skip Network and Markov Random Fields

A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image.

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Attention-Guided Label Refinement Network For Semantic Segmentation Of Very High Resolution Aerial Orthoimages

Semantic Labeling in Very High Resolution Images Via a Self-Cascaded Convolutional Neural Network

High-Resolution Aerial Imagery Semantic Labeling With Dense Pyramid Network

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

AFNet: Adaptive Fusion Network for Remote Sensing Image Semantic Segmentation

An Aerial Image Segmentation Approach Based on Enhanced Multi-Scale Convolutional Neural Network

Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

RiFCN: Recurrent Network in Fully Convolutional Network for Semantic Segmentation of High Resolution Remote Sensing Images

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

Lightweight Attention Network for Very High-Resolution Image Semantic Segmentation

Semantic Labeling of Very High-Resolution Imagery by Leveraging Contextual Information with Optimized Non-Local Neural Network.

A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images