Abstract:With the acceleration of urbanization and the growing demand for traffic safety, developing intelligent systems capable of accurately recognizing and tracking pedestrian trajectories at night or under low-light conditions has become a research focus in the field of transportation. This study aims to improve the accuracy and real-time performance of nighttime pedestrian-detection and -tracking. A method that integrates the multi-object detection algorithm YOLOP with the multi-object tracking algorithm DeepSORT is proposed. The improved YOLOP algorithm incorporates the C2f-faster structure in the Backbone and Neck sections, enhancing feature extraction capabilities. Additionally, a BiFormer attention mechanism is introduced to focus on the recognition of small-area features, the CARAFE module is added to improve shallow feature fusion, and the DyHead dynamic target-detection head is employed for comprehensive fusion. In terms of tracking, the ShuffleNetV2 lightweight module is integrated to reduce model parameters and network complexity. Experimental results demonstrate that the proposed FBCD-YOLOP model improves lane detection accuracy by 5.1%, increases the IoU metric by 0.8%, and enhances detection speed by 25 FPS compared to the baseline model. The accuracy of nighttime pedestrian-detection reached 89.6%, representing improvements of 1.3%, 0.9%, and 3.8% over the single-task YOLO v5, multi-task TDL-YOLO, and the original YOLOP models, respectively. These enhancements significantly improve the model's detection performance in complex nighttime environments. The enhanced DeepSORT algorithm achieved an MOTA of 86.3% and an MOTP of 84.9%, with ID switch occurrences reduced to 5. Compared to the ByteTrack and StrongSORT algorithms, MOTA improved by 2.9% and 0.4%, respectively. Additionally, network parameters were reduced by 63.6%, significantly enhancing the real-time performance of nighttime pedestrian-detection and -tracking, making it highly suitable for deployment on intelligent edge computing surveillance platforms.

Vehicle Tracking at Nighttime by Kernelized Experts with Channel-Wise and Temporal Reliability Estimation

A Vehicle Tracking Algorithm Combining Detector and Tracker

Robust Night Target Tracking Via Infrared and Visible Video Fusion

Robust Nighttime Vehicle Detection by Tracking and Grouping Headlights

Long-term Reliable Visual Tracking with UAVs.

Effective Real-Time Vehicle Tracking Using Discriminative Sparse Coding on Local Patches

Deformable Model-Based Vehicle Tracking and Recognition Using 3-D Constrained Multiple-Kernels and Kalman Filter

Adaptive Online Learning Based Robust Visual Tracking

Thermal infrared pedestrian tracking via fusion of features in driving assistance system of intelligent vehicles

Learning Multidimensional Spatial Attention for Robust Nighttime Visual Tracking

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Illumination-Adapted Long-Term Tracking Based on Multiple Correlation Framework

ADTrack: Target-Aware Dual Filter Learning for Real-Time Anti-Dark UAV Tracking

All-Day Object Tracking for Unmanned Aerial Vehicle

High Robustness Method of Nighttime Vehicle Location and Tracking

Nighttime Air Tracking Based on Improved Unsupervised Siamese Network

Night-Rider: Nocturnal Vision-aided Localization in Streetlight Maps Using Invariant Extended Kalman Filtering

Real-time Visual Tracking Via Robust Kernelized Correlation Filter

Tracker Meets Night: A Transformer Enhancer for UAV Tracking

Study on Nighttime Pedestrian Trajectory-Tracking from the Perspective of Driving Blind Spots

Visual Tracking Via Efficient Kernel Discriminant Subspace Learning