Abstract:Due to deep learning's accurate cognition of the street environment, the convolutional neural network has achieved dramatic development in the application of street scenes. Considering the needs of autonomous driving and assisted driving, in a general way, computer vision technology is used to find obstacles to avoid collisions, which has made semantic segmentation a research priority in recent years. However, semantic segmentation has been constantly facing new challenges for quite a long time. Complex network depth information, large datasets, real-time requirements, etc., are typical problems that need to be solved urgently in the realization of autonomous driving technology. In order to address these problems, we propose an improved lightweight real-time semantic segmentation network, which is based on an efficient image cascading network (ICNet) architecture, using multi-scale branches and a cascaded feature fusion unit to extract rich multi-level features. In this paper, a spatial information network is designed to transmit more prior knowledge of spatial location and edge information. During the course of the training phase, we append an external loss function to enhance the learning process of the deep learning network system as well. This lightweight network can quickly perceive obstacles and detect roads in the drivable area from images to satisfy autonomous driving characteristics. The proposed model shows substantial performance on the Cityscapes dataset. With the premise of ensuring real-time performance, several sets of experimental comparisons illustrate that SP-ICNet enhances the accuracy of road obstacle detection and provides nearly ideal prediction outputs. Compared to the current popular semantic segmentation network, this study also demonstrates the effectiveness of our lightweight network for road obstacle detection in autonomous driving.

LR3S: A lightweight semantic segmentation model for road scenes based on improved DeepLabV3+

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Light-Deeplabv3+: a lightweight real-time semantic segmentation method for complex environment perception

Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection

Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

An Improved Deeplabv3+ Model for Semantic Segmentation of Urban Environments Targeting Autonomous Driving

LRNNet: A Light-Weighted Network with Efficient Reduced Non-Local Operation for Real-Time Semantic Segmentation

Lightweight Deep Learning for Road Environment Recognition

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

An improved semantic segmentation algorithm for high-resolution remote sensing images based on DeepLabv3+

MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Driving

A Lightweight High-Resolution RS Image Road Extraction Method Combining Multi-Scale and Attention Mechanism

S3Net: 3D LiDAR Sparse Semantic Segmentation Network

Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

DRMNet: more efficient bilateral networks for real-time semantic segmentation of road scenes

Enhanced Scene Understanding and Situation Awareness for Autonomous Vehicles Based on Semantic Segmentation

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Exploiting Low-level Representations for Ultra-Fast Road Segmentation