Abstract:As a key technology for scene understanding, real-time semantic segmentation is an important topic in the field of computer vision in recent years. However, some lightweight networks designed for real-time semantic segmentation only have limited receptive field, so they cannot effectively perceive multi-scale objects in images. In addition, although the fast downsampling feature extraction network reduces the amount of computation, it has the problem of loss of detailed information, resulting in poor prediction accuracy. In this paper, we propose an efficient lightweight semantic segmentation network called BFMNet to address these issues. First, we use a lightweight bilateral structure to encode the semantic and detailed information from images respectively and introduce feature interactions during the encoding process. Furthermore, we design a novel Multi-Scale Context Aggregation Module (MSCAM) to help the network perceive the information of multi-scale objects, which is crucial for semantic segmentation. Finally, we introduce a new fusion module (AEFM) that uses attention perception to facilitate bilateral feature fusion. Our network achieves competitive results on three popular semantic segmentation benchmarks: Cityscapes, CamVid and COCO-Stuff. Specifically, on a single 2080Ti GPU, our network yields 77.7% mIoU at 63.7 FPS on Cityscapes test set with the input resolution of 768 × 1536. Considering the speed-accuracy trade-off, we also report the results with 1024 × 2048 input resolution: 78.9% mIoU at 31.4 FPS. On the Camvid test set, our network achieves 75.6% mIoU at 95.8 FPS, while on the COCO-Stuff validation set, our network achieves 31.2% mIoU.

RELAXNet: Residual Efficient Learning and Attention Expected Fusion Network for Real-Time Semantic Segmentation

EHANet: Efficient Hybrid Attention Network Towards Real-time Semantic Segmentation

EARMNet:A Fast and Accurate Semantic Segmentation Network with Lightweight Efficient Asymmetric Residual Module

BFMNet: Bilateral Feature Fusion Network with Multi-Scale Context Aggregation for Real-Time Semantic Segmentation.

EFRNet: A Lightweight Network with Efficient Feature Fusion and Refinement for Real-Time Semantic Segmentation

A Lightweight Network with Attention Decoder for Real-Time Semantic Segmentation

Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation

Research on Efficient Asymmetric Attention Module for Real-Time Semantic Segmentation Networks in Urban Scenes

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

EANET: Efficient Attention-Augmented Network for Real-Time Semantic Segmentation.

A Lightweight Network for Fast Semantic Segmentation.

ASFNet: Adaptive Multiscale Segmentation Fusion Network for Real‐time Semantic Segmentation

LMFFNet: A Well-Balanced Lightweight Network for Fast and Accurate Semantic Segmentation

ZMNet: feature fusion and semantic boundary supervision for real-time semantic segmentation

MFAFNet: A Lightweight and Efficient Network with Multi-Level Feature Adaptive Fusion for Real-Time Semantic Segmentation

Attentional Residual Dense Factorized Network for Real-Time Semantic Segmentation

LFFNet: lightweight feature-enhanced fusion network for real-time semantic segmentation of road scenes

EMFANet: a lightweight network with efficient multi-scale feature aggregation for real-time semantic segmentation

MLFNet: Multi-Level Fusion Network for Real-Time Semantic Segmentation of Autonomous Driving

Real-Time Semantic Segmentation With Fast Attention

A lightweight multi-dimension dynamic convolutional network for real-time semantic segmentation