Abstract:Existing semantic segmentation networks perform well in accuracy by spending much computation. However, for practical applications, not only high segmentation accuracy but also high inference speed is required. To solve the problem of the difficult balance between accuracy and speed, we propose a new real-time semantic segmentation network (FBRNet). To extract multi-scale semantic information more quickly, we propose a lightly weighted reinforced atrous spatial pyramid pooling module (arASPP) based on the attention mechanism, which can extract richer and more advanced features with less computation than the original ASPP. To eliminate the semantic gap between high- and low-level features, we propose a new feature fusion module (CSFM), in which a shuffling mechanism is introduced to enhance robustness, and a parallel contextual information enhancement module and detail information enhancement module are built to facilitate the information exchange between high- and low-level features, achieving the effect of improving the model feature representation. Finally, we also introduce high-level features, fusing Laplace convolution and spatial attention mechanisms, and design the edge feature reinforcement module (LABRM) to eliminate the noise of low-level features and compensate for the model's segmentation effect target boundary. In the Cityscapes validation set and test set, FBRNet achieves 77.63% and 75.3% mIoU, and 101.9 FPS on a single tesla-T4 GPU, also achieved 72.4% mIoU and 89.8 FPS on the CamVid dataset and 55.2% mIoU and 100.8 FPS on the BDD100K dataset, which is a better balance of accuracy and speed compared with existing networks. The code is available at https://github.com/little5570/FBRNet.

A Multi-level Feature Fusion Network for Real-time Semantic Segmentation

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

CFFNet: Cross-scale Feature Fusion Network for Real-Time Semantic Segmentation

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network

ZMNet: feature fusion and semantic boundary supervision for real-time semantic segmentation

MFAFNet: A Lightweight and Efficient Network with Multi-Level Feature Adaptive Fusion for Real-Time Semantic Segmentation

ASFNet: Adaptive Multiscale Segmentation Fusion Network for Real‐time Semantic Segmentation

BFMNet: Bilateral Feature Fusion Network with Multi-Scale Context Aggregation for Real-Time Semantic Segmentation.

LFFNet: lightweight feature-enhanced fusion network for real-time semantic segmentation of road scenes

Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

LMFFNet: A Well-Balanced Lightweight Network for Fast and Accurate Semantic Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

MLFNet: Multi-Level Fusion Network for Real-Time Semantic Segmentation of Autonomous Driving

EFRNet: A Lightweight Network with Efficient Feature Fusion and Refinement for Real-Time Semantic Segmentation

Boundary Corrected Multi-scale Fusion Network for Real-time Semantic Segmentation

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

AM‐MulFSNet: A Fast Semantic Segmentation Network Combining Attention Mechanism and Multi‐branch

Multi-path Fusion Network for Semantic Image Segmentation

MSCFNet: A Lightweight Network with Multi-Scale Context Fusion for Real-Time Semantic Segmentation

FBRNet: a feature fusion and border refinement network for real-time semantic segmentation