Abstract:With the rapid development of artificial intelligence and computer vision technology, autonomous driving technology has become a hot area of concern. The driving scenarios of autonomous vehicles can be divided into structured scenarios and unstructured scenarios. Compared with structured scenes, unstructured road scenes lack the constraints of lane lines and traffic rules, and the safety awareness of traffic participants is weaker. Therefore, there are new and higher requirements for the environment perception tasks of autonomous vehicles in unstructured road scenes. The current research rarely integrates the target detection and road segmentation to achieve the simultaneous processing of target detection and road segmentation of autonomous vehicle in unstructured road scenes. Aiming at the above issues, a multitask model for object detection and road segmentation in unstructured road scenes is proposed. Through the sharing and fusion of the object detection model and road segmentation model, multitask model can complete the tasks of multi-object detection and road segmentation in unstructured road scenes while inputting a picture. Firstly, MobileNetV2 is used to replace the backbone network of YOLOv5, and multi-scale feature fusion is used to realize the information exchange layer between different features. Subsequently, a road segmentation model was designed based on the DeepLabV3+ algorithm. Its main feature is that it uses MobileNetV2 as the backbone network and combines the binary classification focus Loss function for network optimization. Then, we fused the object detection algorithm and road segmentation algorithm based on the shared MobileNetV2 network to obtain a multitask model and trained it on both the public dataset and the self-built dataset NJFU. The training results demonstrate that the multitask model significantly enhances the algorithm's execution speed by approximately 10 FPS while maintaining the accuracy of object detection and road segmentation. Finally, we conducted validation of the multitask model on an actual vehicle.

Research on road semantic segmentation based on hybrid auto-encoder

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Semantic road segmentation using encoder-decoder architectures

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms

Automatic Road Extraction From Remote Sensing Imagery Using Ensemble Learning and Postprocessing

Semantic segmentation of remote sensing imagery for road extraction via joint angle prediction: comparisons to deep learning

Automatic extraction and 3D modeling of real road scenes using UAV imagery and deep learning semantic segmentation

A Deeply Supervised Semantic Segmentation Method Based on GAN

Rse-net: Road-shape enhanced neural network for Road extraction in high resolution remote sensing image

Using layer-wise training for Road Semantic Segmentation in Autonomous Cars

DANet: A Semantic Segmentation Network for Remote Sensing of Roads Based on Dual-ASPP Structure

Road Extraction from Very-High-Resolution Remote Sensing Images via a Nested SE-Deeplab Model

Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection

A novel approach for semantic segmentation of automatic road network extractions from remote sensing images by modified UNet

Enhanced Scene Understanding and Situation Awareness for Autonomous Vehicles Based on Semantic Segmentation

Advancements in Road Lane Mapping: Comparative Fine-Tuning Analysis of Deep Learning-based Semantic Segmentation Methods Using Aerial Imagery

Research on multitask model of object detection and road segmentation in unstructured road scenes

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

Automatic Road Extraction from High-Resolution Remote Sensing Images Using a Method Based on Densely Connected Spatial Feature-Enhanced Pyramid