Abstract:The vehicle-borne optical imaging sensor system cannot accurately and quickly receive information about the driving environment, which may lead to the Autonomous Driving System (ADS) being unable to make accurate and rapid decisions, thus bringing potential safety hazards to autonomous driving. In order to solve the above problems, we propose a real-time semantic segmentation method for end-to-end autonomous driving. This method improves the practicability and reliability of autonomous driving technology by improving the real-time and accuracy of the semantic segmentation method. First, in order to solve the problem that existing semantic segmentation methods cannot meet the requirements of vehicle-borne embedded terminals for real-time and segmentation accuracy of semantic segmentation methods due to complex network structure, difficulties in extracting useful features in complex autonomous driving environments, high training hardware configuration, we propose a real-time semantic segmentation network model L2-LiteSeg, it solves the problems of the low extraction efficiency of feature and parameter redundancy by optimizing the configuration of Unified Attention Fusion Module (UAFM) modules and the network structure of the PP-LiteSeg model. On semantic segmentation datasets for autonomous driving and CamVid, L2-LiteSeg only uses 0.82M parameters, the semantic segmentation precision reaches 73.1%, 67.7% mIoU, and 67.7% mIoU respectively, and the reasoning speed reaches 73.68 Frames Per Second (FPS), 85.16 FPS, and 73.68 FPS respectively. This shows that the L2-LiteSeg method has achieved a good balance in the three indicators of parameter, accuracy, and reasoning speed and can meet the real-time and accuracy requirements of semantic segmentation by the vehicle-borne embedded terminals.

Single Annotated Pixel Based Weakly Supervised Semantic Segmentation under Driving Scenes

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Realizing Pixel-Level Semantic Learning in Complex Driving Scenes Based on Only One Annotated Pixel Per Class

Few Annotated Pixels and Point Cloud Based Weakly Supervised Semantic Segmentation of Driving Scenes

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

Weakly Supervised Semantic Segmentation for Driving Scenes

Weakly supervised multi-class semantic video segmentation for road scenes

Weaklier Supervised Semantic Segmentation with Only One Image Level Annotation Per Category.

Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism

Learning Nighttime Semantic Segmentation the Hard Way

Semantic Segmentation of 3D LiDAR Data in Dynamic Scene Using Semi-Supervised Learning

Weakly Supervised LiDAR Semantic Segmentation via Scatter Image Annotation

Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving

Exploiting Minority Pseudo-Labels for Semi-Supervised Semantic Segmentation in Autonomous Driving

An Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation

An Image-based Approach of Task-driven Driving Scene Categorization

Applying Unsupervised Semantic Segmentation to High-Resolution UAV Imagery for Enhanced Road Scene Parsing

Weakly Supervised Semantic Segmentation with a Multiscale Model

Progressive Feature Self-reinforcement for Weakly Supervised Semantic Segmentation

L2-LiteSeg: A Real-Time Semantic Segmentation Method for End-to-End Autonomous Driving