Abstract:In order to address the issue of environmental perception in autonomous driving on structured roads, we propose MultiNet-GS, a convolutional neural network model based on an encoder-decoder architecture that tackles multiple tasks simultaneously. We use the main structure of the latest object detection model, the YOLOv8 model, as the encoder structure of our model. We introduce a new dynamic sparse attention mechanism, BiFormer, in the feature extraction part of the model to achieve more flexible computing resource allocation, which can significantly improve the computational efficiency and occupy a small computational overhead. We introduce a lightweight convolution, GSConv, in the feature fusion part of the network, which is used to build the neck part into a new slim-neck structure so as to reduce the computational complexity and inference time of the detector. We also add an additional detector for tiny objects to the conventional three-head detector structure. Finally, we introduce a lane detection method based on guide lines in the lane detection part, which can aggregate the lane feature information into multiple key points, obtain the lane heat map response through conditional convolution, and then describe the lane line through the adaptive decoder, which effectively makes up for the shortcomings of the traditional lane detection method. Our comparative experiments on the BDD100K dataset on the embedded platform NVIDIA Jetson TX2 show that compared with SOTA(YOLOPv2), the mAP@0.5 of the model in traffic object detection reaches 82.1%, which is increased by 2.7%. The accuracy of the model in drivable area detection reaches 93.2%, which is increased by 0.5%. The accuracy of the model in lane detection reaches 85.7%, which is increased by 4.3%. The Params and FLOPs of the model reach 47.5 M and 117.5, which are reduced by 6.6 M and 8.3, respectively. The model achieves 72 FPS, which is increased by 5. Our MultiNet-GS model has the highest detection accuracy among the current mainstream models while maintaining a good detection speed and has certain superiority.

MBBNet: An edge IoT computing-based traffic light detection solution for autonomous bus

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Deep CNN-Based Real-Time Traffic Light Detector for Self-Driving Vehicles

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

MultiNet-GS: Structured Road Perception Model Based on Multi-Task Convolutional Neural Network

Deep Learning-Enhanced Environment Perception for Autonomous Driving: MDNet with CSP-DarkNet53

A Hierarchical Deep Architecture and Mini-Batch Selection Method For Joint Traffic Sign and Light Detection

Driving Assistance System Based on Deep Learning and Traditional Vision

A Traffic Sign Recognition System Based on Lightweight Network Learning

Mobip: a lightweight model for driving perception using MobileNet

Detecting The Objects on The Road Using Modular Lightweight Network

DV3-IBi_YOLOv5s: A Lightweight Backbone Network and Multiscale Neck Network Vehicle Detection Algorithm

DenseLightNet: A Light-Weight Vehicle Detection Network for Autonomous Driving

Deep Neural Network Based Vehicle and Pedestrian Detection for Autonomous Driving: A Survey

Fast Traffic Light Recognition Using a Lightweight Attention-Enhanced Model

Mobilenetv2_CA Lightweight Object Detection Network in Autonomous Driving

An Edge Traffic Flow Detection Scheme Based on Deep Learning in an Intelligent Transportation System

Modular Lightweight Network for Road Object Detection Using a Feature Fusion Approach

ICONet: A Lightweight Network with Greater Environmental Adaptivity

Efficientdet Based Visial Perception for Autonomous Driving

A Faster and Lightweight Lane Detection Method in Complex Scenarios