Abstract:Here, a LiDAR (light detection and ranging) and visual information fusion intelligent driving vehicle based on the improved YOLOv7 (You Only Look Once version 7) algorithm is proposed, and virtual simulation and real vehicle tests are conducted. The challenges of baseline YOLOv7 application in target detection are being addressed. Accurately and quickly detecting obstacles ahead is a prerequisite for intelligent driving. The combined detection scheme of light detection and ranging (LiDAR) and the camera is far more capable of coping with complex road conditions than a single sensor. However, immediately afterward, ensuring the real‐time performance of the sensing algorithms through a significantly increased amount of computation has become a new challenge. For this purpose, the paper introduces an improved dynamic obstacle detection algorithm based on YOLOv7 (You Only Look Once version 7) to overcome the drawbacks of slow and unstable detection of traditional methods. Concretely, Mobilenetv3 supplants the backbone network utilized in the original YOLOv7 architecture, thereby achieving a reduction in computational overhead. It integrates a specialized layer for the detection of small‐scale targets and incorporates a convolutional block attention module to enhance detection efficacy for diminutive obstacles. Furthermore, the framework adopts the Efficient Intersection over Union Loss function, which is specifically designed to mitigate the issue of mutual occlusion among detected objects. On a dataset consisting of 27,362 labelled KITTI data samples, the improved YOLOv7 algorithm achieves 92.6% mean average precision and 82 frames per second, which reduces the Model_size by 85.9% and loses only 1.5% accuracy compared with the traditional YOLOv7 algorithm. In addition, this paper builds a virtual scene to test the improved algorithm and fuses LiDAR and camera data. Experimental results conducted on a test vehicle equipped with a camera and LiDAR sensor demonstrate the effectiveness and significant performance of the method. The improved obstacle detection algorithm proposed in this research can significantly reduce the computational cost of the environment perception task, meet the requirements of real‐world applications, and is crucial for achieving safer and smarter driving.

Image recognition and blind-guiding algorithm based on improved YOLOv3

Blind Obstacle Avoidance System Based on Improved YOLOv3

YOLOv3-MT: A YOLOv3 using multi-target tracking for vehicle visual detection

Lightweight environment sensing algorithm for intelligent driving based on improved YOLOv7

YOLO-OD: Obstacle Detection for Visually Impaired Navigation Assistance

Enhanced Yolov8 with OpenCV for Blind-Friendly Object Detection and Distance Estimation

Investigating YOLO Models Towards Outdoor Obstacle Detection For Visually Impaired People

Intelligent Recognition of Traffic Signs Based on Improved YOLO v3 Algorithm

Applying Image Analysis to Build a Lightweight System for Blind Obstacles Detecting of Intelligent Wheelchairs

Road Obstacle Object Detection Based on Improved YOLO V4

Enhanced lightweight infrared object detection algorithm for assistive navigation in visually impaired individuals

Improved YOLOv3 model with feature map cropping for multi-scale road object detection

Improvement of Remote sensing image target detection algorithm based on YOLO V5

An improved YOLOv5 algorithm for obscured target recognition

An Enhanced Deep Learning Model for Obstacle and Traffic Light Detection Based on YOLOv5

Detection and Recognition for Autonomous Driving Based on Improved YOLO Algorithm

Application Research of Fast UAV Aerial Photography Object Detection and Recognition Based on Improved YOLOv3

Improved yolov5 algorithm combined with depth camera and embedded system for blind indoor visual assistance

Biomimetic Vision for Zoom Object Detection Based on Improved Vertical Grid Number YOLO Algorithm

KCS-YOLO: an Improved Algorithm for Traffic Light Detection under Low Visibility Conditions

An advanced YOLOv3 method for small-scale road object detection