Abstract:Real-time semantic segmentation, which can be visually understood as the pixel-level classification task on the input image, currently has broad application prospects, especially in the fast-developing fields of autonomous driving and drone navigation. However, the huge burden of calculation together with redundant parameters are still the obstacles to its technological development. In this paper, we propose a Fast Bilateral Symmetrical Network (FBSNet) to alleviate the above challenges. Specifically, FBSNet employs a symmetrical encoder-decoder structure with two branches, semantic information branch and spatial detail branch. The Semantic Information Branch (SIB) is the main branch with semantic architecture to acquire the contextual information of the input image and meanwhile acquire sufficient receptive field. While the Spatial Detail Branch (SDB) is a shallow and simple network used to establish local dependencies of each pixel for preserving details, which is essential for restoring the original resolution during the decoding phase. Meanwhile, a Feature Aggregation Module (FAM) is designed to effectively combine the output of these two branches. Experimental results of Cityscapes and CamVid show that the proposed FBSNet can strike a good balance between accuracy and efficiency. Specifically, it obtains 70.9\% and 68.9\% mIoU along with the inference speed of 90 fps and 120 fps on these two test datasets, respectively, with only 0.62 million parameters on a single RTX 2080Ti GPU. The code is available at <a class="link-external link-https" href="https://github.com/IVIPLab/FBSNet" rel="external noopener nofollow">this https URL</a>.

Spatial-Semantic Fusion Network for Semantic Segmentation in Real-time

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

Multi-Scale Depthwise Separable Convolution for Semantic Segmentation in Street–Road Scenes

ZMNet: feature fusion and semantic boundary supervision for real-time semantic segmentation

FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentation

Spatial-Assistant Encoder-Decoder Network for Real Time Semantic Segmentation

Self-Learned Feature Reconstruction and Offset-Dilated Feature Fusion for Real-Time Semantic Segmentation

Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation

Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentation

Spatial-information Guided Adaptive Context-aware Network for Efficient RGB-D Semantic Segmentation

Asymmetric-Convolution-Guided Multipath Fusion for Real-Time Semantic Segmentation Networks

Real-Time Semantic Segmentation via Spatial-Detail Guided Context Propagation

Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation

Dual-Branch Dynamic Object Segmentation Network Based on Spatio-Temporal Information Fusion