Abstract:In computer vision, the task of semantic segmentation is crucial for applications such as autonomous driving and intelligent surveillance. However, achieving a balance between real-time performance and segmentation accuracy remains a significant challenge. Although Fast-SCNN is favored for its efficiency and low computational complexity, it still faces difficulties when handling complex street scene images. To address this issue, this paper presents an improved Fast-SCNN, aiming to enhance the accuracy and efficiency of semantic segmentation by incorporating a novel attention mechanism and an enhanced feature extraction module. Firstly, the integrated SimAM (Simple, Parameter-Free Attention Module) increases the network's sensitivity to critical regions of the image and effectively adjusts the feature space weights across channels. Additionally, the refined pyramid pooling module in the global feature extraction module captures a broader range of contextual information through refined pooling levels. During the feature fusion stage, the introduction of an enhanced DAB (Depthwise Asymmetric Bottleneck) block and SE (Squeeze-and-Excitation) attention optimizes the network's ability to process multi-scale information. Furthermore, the classifier module is extended by incorporating deeper convolutions and more complex convolutional structures, leading to a further improvement in model performance. These enhancements significantly improve the model's ability to capture details and overall segmentation performance. Experimental results demonstrate that the proposed method excels in processing complex street scene images, achieving a mean Intersection over Union (mIoU) of 71.7% and 69.4% on the Cityscapes and CamVid datasets, respectively, while maintaining inference speeds of 81.4 fps and 113.6 fps. These results indicate that the proposed model effectively improves segmentation quality in complex street scenes while ensuring real-time processing capabilities.

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

EHANet: Efficient Hybrid Attention Network Towards Real-time Semantic Segmentation

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

DSANet: Dilated Spatial Attention for Real-Time Semantic Segmentation in Urban Street Scenes.

ASFNet: Adaptive Multiscale Segmentation Fusion Network for Real‐time Semantic Segmentation

Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

Depthwise and Spatial Factorized Network: a Light-weight Network for Real-time Semantic Segmentation

Fast Real-time Semantic Segmentation Network with an Asymmetric Encoder-Decoder Structure

A Fast Attention-Guided Hierarchical Decoding Network for Real-Time Semantic Segmentation

Spatial-Semantic Fusion Network for Semantic Segmentation in Real-time

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network

ZMNet: feature fusion and semantic boundary supervision for real-time semantic segmentation

Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

Attentional Residual Dense Factorized Network for Real-Time Semantic Segmentation

Real-time Semantic Segmentation Via Region and Pixel Context Network.

Dsmrseg: Dual-Stage Feature Pyramid And Multi-Range Context Aggregation For Real-Time Semantic Segmentation

Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes.

A lightweight multi-dimension dynamic convolutional network for real-time semantic segmentation

RELAXNet: Residual Efficient Learning and Attention Expected Fusion Network for Real-Time Semantic Segmentation

BFMNet: Bilateral Feature Fusion Network with Multi-Scale Context Aggregation for Real-Time Semantic Segmentation.

Real-Time Semantic Segmentation Algorithm for Street Scenes Based on Attention Mechanism and Feature Fusion