Abstract:Pedestrian tracking is an important aspect of autonomous vehicles environment perception in a vehicle running environment. The performance of the existing pedestrian tracking algorithms is limited by the complex traffic environment, the changeable appearance characteristics of pedestrians and the frequent occlusion interaction, which leads to the insufficient accuracy and stability of tracking. Therefore, this paper proposes a detector–tracker integration framework for autonomous vehicle pedestrian tracking. Firstly, a pedestrian objects detector based on the improved YOLOv7 network was established. Space-to-Depth convolution layer was adopted to improve the backbone network of YOLOv7. Then, a novel appearance feature extraction network is proposed, which integrates the convolutional structural re-parameterization idea to construct a full-scale feature extraction block, which is the optimized DeepSORT tracker. Finally, experiments were carried out on MOT17 and MOT20 public datasets and driving video sequences, and the tracking performance of the proposed framework was evaluated by comparing it with the most advanced multi-object tracking algorithms. Quantitative analysis results show that the framework has high tracking accuracy. Compared with DeepSORT, MOTA improves by 2.3% in the MOT17 dataset and MOTA improves by 4.2% in the MOT20 dataset. Through qualitative evaluation on real driving video sequences, the framework proposed in this paper is robust in a variety of climate environments, and can be effectively applied to the pedestrian tracking of autonomous vehicles.

3-Layer Specific Pedestrian Continuous Tracking Framework

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

An Integrated Deep Learning Framework for Occluded Pedestrian Tracking.

Pedestrian Tracking Framework Based on Deep Convolution Network and SIFT

An Integrated Learning Framework For Pedestrian Tracking

Consecutive Pedestrian Tracking in Large Scale Space

Research on Pedestrian Tracking Algorithm Based on Deep Learning Framework

Robust Pedestrian Tracking in Video Sequences Using an Improved STF Module

A Multi-View Pedestrian Tracking Framework Based on Graph Matching

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Multi-pedestrian Tracking Based on Feature Learning Method with Lateral Inhibition.

Pedestrian movement trajectory reappearance and crossing feature expression based on video processing

Pedestrian Detection and Tracking Based on Fast HOG and Time Varying System Particle Filter

Pedestrian detection and tracking based on TLD framework

Detector-Tracker Integration Framework for Autonomous Vehicles Pedestrian Tracking.

Multiple Pedestrian Tracking Based on Multi-layer Graph with Tracklet Segmentation and Merging.

Real-Time RGB-D Pedestrian Tracking for Mobile Robot.

A Real-Time Active Pedestrian Tracking System Inspired by the Human Visual System

Effective multiple pedestrian tracking system in video surveillance with monocular stationary camera

Pedestrian Tracking Utilizing Scale Invariant Feature Transform and Particle Filter

Real-Time Multiple Pedestrians Tracking in Multi-camera System