Abstract:Existing semantic segmentation networks perform well in accuracy by spending much computation. However, for practical applications, not only high segmentation accuracy but also high inference speed is required. To solve the problem of the difficult balance between accuracy and speed, we propose a new real-time semantic segmentation network (FBRNet). To extract multi-scale semantic information more quickly, we propose a lightly weighted reinforced atrous spatial pyramid pooling module (arASPP) based on the attention mechanism, which can extract richer and more advanced features with less computation than the original ASPP. To eliminate the semantic gap between high- and low-level features, we propose a new feature fusion module (CSFM), in which a shuffling mechanism is introduced to enhance robustness, and a parallel contextual information enhancement module and detail information enhancement module are built to facilitate the information exchange between high- and low-level features, achieving the effect of improving the model feature representation. Finally, we also introduce high-level features, fusing Laplace convolution and spatial attention mechanisms, and design the edge feature reinforcement module (LABRM) to eliminate the noise of low-level features and compensate for the model's segmentation effect target boundary. In the Cityscapes validation set and test set, FBRNet achieves 77.63% and 75.3% mIoU, and 101.9 FPS on a single tesla-T4 GPU, also achieved 72.4% mIoU and 89.8 FPS on the CamVid dataset and 55.2% mIoU and 100.8 FPS on the BDD100K dataset, which is a better balance of accuracy and speed compared with existing networks. The code is available at https://github.com/little5570/FBRNet.

FDLNet: Boosting Real-time Semantic Segmentation by Image-size Convolution Via Frequency Domain Learning.

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

FDDWNet: A Lightweight Convolutional Neural Network for Real-Time Semantic Segmentation

A Multi-level Feature Fusion Network for Real-time Semantic Segmentation

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

LFFNet: lightweight feature-enhanced fusion network for real-time semantic segmentation of road scenes

FDDWNet: A Lightweight Convolutional Neural Network for Real-time Sementic Segmentation

MLFNet: Multi-Level Fusion Network for Real-Time Semantic Segmentation of Autonomous Driving

Depthwise and Spatial Factorized Network: a Light-weight Network for Real-time Semantic Segmentation

BFMNet: Bilateral Feature Fusion Network with Multi-Scale Context Aggregation for Real-Time Semantic Segmentation.

FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentation

FBRNet: a feature fusion and border refinement network for real-time semantic segmentation

A Lightweight and Dynamic Convolutional Network for Real-time Semantic Segmentation

ASFNet: Adaptive Multiscale Segmentation Fusion Network for Real‐time Semantic Segmentation

LCFNets: Compensation Strategy for Real-time Semantic Segmentation of Autonomous Driving

EFRNet: A Lightweight Network with Efficient Feature Fusion and Refinement for Real-Time Semantic Segmentation

DFFNet: An IoT-perceptive dual feature fusion network for general real-time semantic segmentation

LMFFNet: A Well-Balanced Lightweight Network for Fast and Accurate Semantic Segmentation

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network