Abstract:The vehicle-borne optical imaging sensor system cannot accurately and quickly receive information about the driving environment, which may lead to the Autonomous Driving System (ADS) being unable to make accurate and rapid decisions, thus bringing potential safety hazards to autonomous driving. In order to solve the above problems, we propose a real-time semantic segmentation method for end-to-end autonomous driving. This method improves the practicability and reliability of autonomous driving technology by improving the real-time and accuracy of the semantic segmentation method. First, in order to solve the problem that existing semantic segmentation methods cannot meet the requirements of vehicle-borne embedded terminals for real-time and segmentation accuracy of semantic segmentation methods due to complex network structure, difficulties in extracting useful features in complex autonomous driving environments, high training hardware configuration, we propose a real-time semantic segmentation network model L2-LiteSeg, it solves the problems of the low extraction efficiency of feature and parameter redundancy by optimizing the configuration of Unified Attention Fusion Module (UAFM) modules and the network structure of the PP-LiteSeg model. On semantic segmentation datasets for autonomous driving and CamVid, L2-LiteSeg only uses 0.82M parameters, the semantic segmentation precision reaches 73.1%, 67.7% mIoU, and 67.7% mIoU respectively, and the reasoning speed reaches 73.68 Frames Per Second (FPS), 85.16 FPS, and 73.68 FPS respectively. This shows that the L2-LiteSeg method has achieved a good balance in the three indicators of parameter, accuracy, and reasoning speed and can meet the real-time and accuracy requirements of semantic segmentation by the vehicle-borne embedded terminals.

A RGB-Thermal Image Segmentation Method Based on Parameter Sharing and Attention Fusion for Safe Autonomous Driving

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

Rgb-t semantic segmentation based on cross-operational fusion attention in autonomous driving scenario

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation

IAFFNet: Illumination-Aware Feature Fusion Network for All-Day RGB-Thermal Semantic Segmentation of Road Scenes.

HAFFseg: RGB-Thermal semantic segmentation network with hybrid adaptive feature fusion strategy

Image Fusion Via Mutual Information Maximization for Semantic Segmentation in Autonomous Vehicles

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

FuseSeg: Semantic Segmentation of Urban Scenes Based on RGB and Thermal Data Fusion

Multispectral Fusion Transformer Network for RGB-Thermal Urban Scene Semantic Segmentation

Real-Time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-Driving Images

Context-aware Method for Small Object Segmentation in Road Scenes.

Robust Semantic Segmentation Based on RGB-thermal in Variable Lighting Scenes

L2-LiteSeg: A Real-Time Semantic Segmentation Method for End-to-End Autonomous Driving

Image Fusion with Inverted Residual Densely Connected Directional Differentiation and Attention Mechanisms

Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

CCAFFMNet: Dual-spectral semantic segmentation network with channel-coordinate attention feature fusion module

Accurate 3D Semantic Segmentation of Point Clouds for Intelligent Vehicles Based on Multi-view Edge Guidance and Fusion

Dual-branch deep cross-modal interaction network for semantic segmentation with thermal images

Location-Guided LiDAR-Based Panoptic Segmentation for Autonomous Driving.