Abstract:Real-time detection and tracking of pedestrian targets is a critical aspect of autonomous driving. However, due to complex road conditions, bad weather and other factors, traditional image detection algorithms are difficult to accurately detect pedestrians on the road, which leads to traffic accidents. To solve the above problems, this paper proposes an improved pedestrian detection and tracking algorithm using YOLOv8n and DeepSort. In the detection stage, the RC-YOLOv8n model is designed. Considering the high real-time requirement in driverless technology, to ensure that the system can quickly respond to a variety of complex road conditions and emergencies, the lightweight RepViT model is introduced to achieve efficient and accurate real-time detection. Meanwhile, the C2f-DCN (Deformable Convolutional Networks) module is proposed to improve the detection accuracy and speed of the model by using deformable convolution. In the tracking phase, the CA-DeepSort model is proposed. The model replaces the pedestrian re-recognition network in DeepSort with the CANet36 network, which captures the spatial location information of pedestrians more accurately by introducing the coordinate attention mechanism, thus improving the fineness and recognition of the feature representation. The CA coordinate attention mechanism is an attention mechanism that enhances the ability of convolutional neural networks to capture spatial and channel information. In addition, Wise-IoU is introduced to replace the traditional IoU for matching, which comprehensively takes into account the shape and position features of the target object, thus improving the matching accuracy. After conducting experiments on different datasets and analysing the experimental data, it is concluded that the RC-YOLOv8n algorithm improves the mAP by 1.6%. When combined with the CA-DeepSort algorithm for tracking, the MOTA reaches 73.2%, which is 12.8% higher than the original algorithm, and the MOTP is 81.9%, which is 1.4% higher than the original algorithm. These improvements significantly enhance the pedestrian detection and tracking performance of driverless vehicles.

The Practical Aapplication of the YOLOv3 Model from the Perspective of Machine Learning in Pedestrian Detection

Real-Time Pedestrian Detection and Tracking Based on YOLOv3

Mobile Robot Tracking Method Based on Improved YOLOv8 Pedestrian Detection Algorithm

Research on Pedestrian Object Detection and Trajectory Tracking Methods

An Improved YOLOv3 Algorithm for Pedestrian Detection on UAV Imagery

Research on Vision-based Pedestrian Detection and Tracking Algorithm

Pedestrian Multi-target Tracking Based on YOLOv3

Design and Construction of Video Image Pedestrian Detection System Based on Deep Learning Model

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Real-time Pedestrian Tracking Based on YOLOv3 and Prototype Clustering

Intelligent Vehicle Pedestrian Tracking Based on YOLOv3 and DASiamRPN

Using YOLO-based Pedestrian Detection for Monitoring UAV

Research on Pedestrian Detection and DeepSort Tracking in Front of Intelligent Vehicle Based on Deep Learning

Research on the Application of YOLOV4 Target Detection Network in Traffic Scenarios by Machine Vision Technology

Research on mine vehicle tracking and detection technology based on YOLOv5

Pedestrian Detection and Behavior Recognition Based on Vision.

Research on Pedestrian Tracking Technology for Autonomous Driving Scenarios

Design and Implementation of Human-Machine Safety System Based on Visual Perception

Pedestrian Detection and Tracking for Mobile Service Robots

YOLO-ABD: A Multi-Scale Detection Model for Pedestrian Anomaly Behavior Detection

Study on Pedestrian Detection and Tracking with Monocular Vision