Abstract:As a research area of computer vision and deep learning, scene understanding has attracted a lot of attention in recent years. One major challenge encountered is obtaining high levels of segmentation accuracy while dealing with the computational cost and time associated with training or inference. Most current algorithms compromise one metric for the other depending on the intended devices. To address this problem, this paper proposes a novel deep neural network architecture called Segmentation Efficient Blocks Network (SEB-Net) that seeks to achieve the best possible balance between accuracy and computational costs as well as real-time inference speed. The model is composed of both an encoder path and a decoder path in a symmetric structure. The encoder path consists of 16 convolution layers identical to a VGG-19 model, and the decoder path includes what we call E-blocks (Efficient Blocks) inspired by the widely popular ENet architecture's bottleneck module with slight modifications. One advantage of this model is that the max-unpooling in the decoder path is employed for expansion and projection convolutions in the E-Blocks, allowing for less learnable parameters and efficient computation (10.1 frames per second (fps) for a 480x320 input, 11x fewer parameters than DeconvNet, 52.4 GFLOPs for a 640x360 input on a TESLA K40 GPU device). Experimental results on two outdoor scene datasets; Cambridge-driving Labeled Video Database (CamVid) and Cityscapes, indicate that SEB-Net can achieve higher performance compared to Fully Convolutional Networks (FCN), SegNet, DeepLabV, and Dilation8 in most cases. What's more, SEB-Net outperforms efficient architectures like ENet and LinkNet by 16.1 and 11.6 respectively in terms of Instance-level intersection over Union (iLoU). SEB-Net also shows better performance when further evaluated on the SUNRGB-D, an indoor scene dataset

EKENet: Efficient knowledge enhanced network for real-time scene parsing

EFRNet: Efficient Feature Reconstructing Network for Real-Time Scene Parsing

ECNet: an Efficient and Context-Aware Network for Street Scene Parsing.

Adaptive Context Network for Scene Parsing

Parsing Very High Resolution Urban Scene Images by Learning Deep ConvNets with Edge-Aware Loss

Objectness Region Enhancement Networks for Scene Parsing

Toward Achieving Robust Low-Level and High-Level Scene Parsing

Channel and Spatial Enhancement Network for human parsing

Flexible Neural Network for Fast and Accurate Road Scene Perception.

SEB-Net: Revisiting Deep Encoder-Decoder Networks for Scene Understanding.

SPNet: Superpixel Pyramid Network for Scene Parsing

Scene Parsing Using Inference Embedded Deep Networks

Efficient Light Deep Network for Street Scene Parsing.

EHANet: an Effective Hierarchical Aggregation Network for Face Parsing

EANET: Efficient Attention-Augmented Network for Real-Time Semantic Segmentation.

Lightweight cross-guided contextual perceptive network for visible–infrared urban road scene parsing

MoE-SPNet: A Mixture-of-experts Scene Parsing Network.

Improve SegNet with Feature Pyramid for Road Scene Parsing

Fast and Accurate Scene Parsing Via Bi-direction Alignment Networks

MoE-SPNet: A mixture-of-experts scene parsing network

Robust Scene Parsing by Mining Supportive Knowledge From Dataset