Abstract:Due to deep learning's accurate cognition of the street environment, the convolutional neural network has achieved dramatic development in the application of street scenes. Considering the needs of autonomous driving and assisted driving, in a general way, computer vision technology is used to find obstacles to avoid collisions, which has made semantic segmentation a research priority in recent years. However, semantic segmentation has been constantly facing new challenges for quite a long time. Complex network depth information, large datasets, real-time requirements, etc., are typical problems that need to be solved urgently in the realization of autonomous driving technology. In order to address these problems, we propose an improved lightweight real-time semantic segmentation network, which is based on an efficient image cascading network (ICNet) architecture, using multi-scale branches and a cascaded feature fusion unit to extract rich multi-level features. In this paper, a spatial information network is designed to transmit more prior knowledge of spatial location and edge information. During the course of the training phase, we append an external loss function to enhance the learning process of the deep learning network system as well. This lightweight network can quickly perceive obstacles and detect roads in the drivable area from images to satisfy autonomous driving characteristics. The proposed model shows substantial performance on the Cityscapes dataset. With the premise of ensuring real-time performance, several sets of experimental comparisons illustrate that SP-ICNet enhances the accuracy of road obstacle detection and provides nearly ideal prediction outputs. Compared to the current popular semantic segmentation network, this study also demonstrates the effectiveness of our lightweight network for road obstacle detection in autonomous driving.

Semantic Segmentation-Inspired Prediction of Pavement Adhesion Coefficient

A Robust Road Segmentation Method

Improved MobileNet V3-Based Identification Method for Road Adhesion Coefficient

Semantic segmentation of remote sensing imagery for road extraction via joint angle prediction: comparisons to deep learning

A Deeply Supervised Semantic Segmentation Method Based on GAN

ME-Seg&DLS-Net: A Dataset and a Network for Autonomous Driving Based on Multi-Element Semantic Segmentation of Pavement

Road Adhesion Coefficient Estimation Based on Vehicle-Road Coordination and Deep Learning

Lane and Road Marker Semantic Video Segmentation Using Mask Cropping and Optical Flow Estimation

A Data-Driven Prediction for Concrete Crack Propagation Path Based on Deep Learning Method

Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving

A Method to Improve the Accuracy of Pavement Crack Identification by Combining a Semantic Segmentation and Edge Detection Model

Semantic Segmentation Via Structured Patch Prediction, Context Crf And Guidance Crf

Semantic and Instance Segmentation in Coastal Urban Spatial Perception: A Multi-Task Learning Framework with an Attention Mechanism

Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network

Adaptive Canny and Semantic Segmentation Networks Based on Feature Fusion for Road Crack Detection

Erroneous Pixel Prediction for Semantic Image Segmentation

Towards Accurate High Resolution Satellite Image Semantic Segmentation

Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism

Learning Cross-Channel Representations for Semantic Segmentation

Using Channel-Wise Attention for Deep CNN Based Real-Time Semantic Segmentation With Class-Aware Edge Information

Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection