Abstract:In this work, we propose PMSDSEN, a parallel multi-scale encoder-decoder network architecture for semantic segmentation, inspired by the human visual perception system's ability to aggregate contextual information in various contexts and scales. Our approach introduces the efficient Parallel Multi-Scale Detail and Semantic Encoding (PMSDSE) unit to extract detailed local information and coarse large-range relationships in parallel, enabling the recognition of object boundaries and object-level areas. By stacking multiple PMSDSEs, our network learns fine-grained details and textures along with abstract category and semantic information, effectively utilizing a larger range of surrounding context information for robust segmentation. To further enhance the network's receptive field without increasing computational complexity, the Multi-Scale Semantic Extractor (MSSE) at the end of the encoder is utilized for multi-scale semantic context extraction and detailed information encoding. Additionally, the Dynamic Weighted Feature Fusion (DWFF) strategy is employed to integrate shallow layer detail information and deep layer semantic information during the decoder stage. Our method can obtain multi-scale context from local to global, achieving efficiently low-level feature extraction to high-level semantic interpretation at different scales and in different contexts. Without bells and whistles, PMSDSEN obtains a better trade-off between accuracy and complexity on popular benchmarks, including Cityscapes and Camvid. Specifically, PMSDSEN attains 73.2% mIoU with only 0.9M parameters on the Cityscapes test set. Codes and supplementary materials link: https://github.com/liux520/PMSDSEN.

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Multi‐stream Densely Connected Network for Semantic Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Semantic Image Segmentation Based On Attentions To Intra Scales And Inner Channels

Multiscale Deep Feature Selection Fusion Network for Referring Image Segmentation

Multi-scale deep context convolutional neural networks for semantic segmentation

Context and Boundary Guided Multi-Scale Feature Fusion Network for Semantic Segmentation

Adaptive multi-scale dual attention network for semantic segmentation

Efficient Parallel Multi-Scale Detail and Semantic Encoding Network for Lightweight Semantic Segmentation

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

MFEAFN: Multi-scale feature enhanced adaptive fusion network for image semantic segmentation

MSSINet: Real-Time Segmentation Based on Multi-Scale Strip Integration

Deep Feature Selection-And-Fusion for RGB-D Semantic Segmentation

DCANet: Dense Context-Aware Network for Semantic Segmentation

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Remote Sensing Image Semantic Segmentation Network Based on Multi-Scale Feature Enhancement Fusion

Stair Fusion Network With Context-Refined Attention for Remote Sensing Image Semantic Segmentation

Dynamic Multi-Scale Filters for Semantic Segmentation.

Dual Context Prior and Refined Prediction for Semantic Segmentation

Using Features Specifically: an Efficient Network for Scene Segmentation Based on Dedicated Attention Mechanisms