Abstract:Many current works directly adopt multi-rate depth-wise dilated convolutions to capture multi-scale contextual information simultaneously from one input feature map, thus improving the feature extraction efficiency for real-time semantic segmentation. However, this design may lead to difficult access to multi-scale contextual information because of the unreasonable structure and hyperparameters. To lower the difficulty of drawing multi-scale contextual information, we propose a highly efficient multi-scale feature extraction method, which decomposes the original single-step method into two steps, Region Residualization-Semantic Residualization. In this method, the multi-rate depth-wise dilated convolutions take a simpler role in feature extraction: performing simple semantic-based morphological filtering with one desired receptive field in the second step based on each concise feature map of region form provided by the first step, to improve their efficiency. Moreover, the dilation rates and the capacity of dilated convolutions for each network stage are elaborated to fully utilize all the feature maps of region form that can be achieved.Accordingly, we design a novel Dilation-wise Residual (DWR) module and a Simple Inverted Residual (SIR) module for the high and low level network, respectively, and form a powerful DWR Segmentation (DWRSeg) network. Extensive experiments on the Cityscapes and CamVid datasets demonstrate the effectiveness of our method by achieving a state-of-the-art trade-off between accuracy and inference speed, in addition to being lighter weight. Without pretraining or resorting to any training trick, we achieve an mIoU of 72.7% on the Cityscapes test set at a speed of 319.5 FPS on one NVIDIA GeForce GTX 1080 Ti card, which exceeds the latest methods of a speed of 69.5 FPS and 0.8% mIoU. The code and trained models are publicly available.

Context-Adaptive Deep Learning for Efficient Image Parsing in Remote Sensing: An Automated Parameter Selection Approach

Lightweight cross-guided contextual perceptive network for visible–infrared urban road scene parsing

Special Perceptual Parsing for Chinese Landscape Painting Scene Understanding: a Semantic Segmentation Approach.

Learning to Aggregate Multi-Scale Context for Instance Segmentation in Remote Sensing Images

A Hierarchical and Contextual Model for Aerial Image Parsing

Global Context Dependencies Aware Network for Efficient Semantic Segmentation of Fine-Resolution Remoted Sensing Images

Encouraging the Mutual Interact Between Dataset-Level and Image-Level Context for Semantic Segmentation of Remote Sensing Image

Towards Panoptic 3D Parsing for Single Image in the Wild

ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Images

OCNet: Object Context Network for Scene Parsing

A Data-efficient Framework for Robotics Large-scale LiDAR Scene Parsing

Weakly Supervised Scene Parsing with Point-Based Distance Metric Learning.

Combined multi-level context aggregation and attention mechanism method for photovoltaic panel extraction from high resolution remote sensing images

DWRSeg: Rethinking Efficient Acquisition of Multi-scale Contextual Information for Real-time Semantic Segmentation

Discriminative Context-Aware Network for Target Extraction in Remote Sensing Imagery

Image Parsing: Unifying Segmentation, Detection, and Recognition.

Unified Perceptual Parsing for Scene Understanding

DOCNet: Dual-Domain Optimized Class-Aware Network for Remote Sensing Image Segmentation

Deep Learning Technique for Human Parsing: A Survey and Outlook

Context Aggregation Network for Remote Sensing Image Semantic Segmentation

Multi-layer Feature Aggregation for Deep Scene Parsing Models