Abstract:Semantic segmentation has been a hot topic across diverse research fields. Along with the success of deep convolutional neural networks, semantic segmentation has made great achievements and improvements, in terms of both urban scene parsing and indoor semantic segmentation. However, most of the state-of-the-art models are still faced with a challenge in discriminative feature learning, which limits the ability of a model to detect multi-scale objects and to guarantee semantic consistency inside one object or distinguish different adjacent objects with similar appearance. In this paper, a practical and efficient edge-aware neural network is presented for semantic segmentation. This end-to-end trainable engine consists of a new encoder-decoder network, a large kernel spatial pyramid pooling (LKPP) block, and an edge-aware loss function. The encoder-decoder network was designed as a balanced structure to narrow the semantic and resolution gaps in multi-level feature aggregation, while the LKPP block was constructed with a densely expanding receptive field for multi-scale feature extraction and fusion. Furthermore, the new powerful edge-aware loss function is proposed to refine the boundaries directly from the semantic segmentation prediction for more robust and discriminative features. The effectiveness of the proposed model was demonstrated using Cityscapes, CamVid, and NYUDv2 benchmark datasets. The performance of the two structures and the edge-aware loss function in ELKPPNet was validated on the Cityscapes dataset, while the complete ELKPPNet was evaluated on the CamVid and NYUDv2 datasets. A comparative analysis with the state-of-the-art methods under the same conditions confirmed the superiority of the proposed algorithm.

Ppednet: Pyramid Pooling Encoder-Decoder Network For Real-Time Semantic Segmentation

Pooling Attention-Based Encoder-Decoder Network for Semantic Segmentation

Real-time Semantic Segmentation in Traffic Scene Using Cross Stage Partial-based Encoder–decoder Network

Efficient pyramid context encoding and feature embedding for semantic segmentation

ELKPPNet: An Edge-aware Neural Network with Large Kernel Pyramid Pooling for Learning Discriminative Features in Semantic Segmentation

FPANet: Feature Pyramid Aggregation Network for Real-Time Semantic Segmentation

DPNet: Dual-Pyramid Semantic Segmentation Network Based on Improved Deeplabv3 Plus

Lightweight Spatial Pyramid Pooling Network for Real-Time Semantic Segmentation

PSDNet: A Balanced Architecture of Accuracy and Parameters for Semantic Segmentation

FCPFNet: Feature Complementation Network with Pyramid Fusion for Semantic Segmentation

PPNet : Pooling Position Attention Network for Semantic Segmentation

A Method of Image Semantic Segmentation Based on PSPNet

Cross Guided and Pyramid Aggregation Networks for Real-time Semantic Segmentation

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

SPMNet: A Light-Weighted Network with Separable Pyramid Module for Real-Time Semantic Segmentation

DMPNet: Distributed Multi-Scale Pyramid Network for Real-Time Semantic Segmentation

Sub-pixel Upsampling Decode Network for Semantic Segmentation

BMSeNet: Multiscale Context Pyramid Pooling and Spatial Detail Enhancement Network for Real-Time Semantic Segmentation

Reparameterizable Dual-Resolution Network for Real-time Semantic Segmentation

Image Semantic Segmentation Based on Encoder-Decoder Network

PPANet: Point-Wise Pyramid Attention Network for Semantic Segmentation.