Abstract:With the acceleration of urbanization and the growing demand for traffic safety, developing intelligent systems capable of accurately recognizing and tracking pedestrian trajectories at night or under low-light conditions has become a research focus in the field of transportation. This study aims to improve the accuracy and real-time performance of nighttime pedestrian-detection and -tracking. A method that integrates the multi-object detection algorithm YOLOP with the multi-object tracking algorithm DeepSORT is proposed. The improved YOLOP algorithm incorporates the C2f-faster structure in the Backbone and Neck sections, enhancing feature extraction capabilities. Additionally, a BiFormer attention mechanism is introduced to focus on the recognition of small-area features, the CARAFE module is added to improve shallow feature fusion, and the DyHead dynamic target-detection head is employed for comprehensive fusion. In terms of tracking, the ShuffleNetV2 lightweight module is integrated to reduce model parameters and network complexity. Experimental results demonstrate that the proposed FBCD-YOLOP model improves lane detection accuracy by 5.1%, increases the IoU metric by 0.8%, and enhances detection speed by 25 FPS compared to the baseline model. The accuracy of nighttime pedestrian-detection reached 89.6%, representing improvements of 1.3%, 0.9%, and 3.8% over the single-task YOLO v5, multi-task TDL-YOLO, and the original YOLOP models, respectively. These enhancements significantly improve the model's detection performance in complex nighttime environments. The enhanced DeepSORT algorithm achieved an MOTA of 86.3% and an MOTP of 84.9%, with ID switch occurrences reduced to 5. Compared to the ByteTrack and StrongSORT algorithms, MOTA improved by 2.9% and 0.4%, respectively. Additionally, network parameters were reduced by 63.6%, significantly enhancing the real-time performance of nighttime pedestrian-detection and -tracking, making it highly suitable for deployment on intelligent edge computing surveillance platforms.

Multi-Field Depth Vehicle Headlight Detection by Model Construction and Long Trajectory Extraction in Nighttime City Traffic

Vehicles Detection and Tracking Based on the Sub-Feature

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Nighttime vehicle detection based on illumination visibility recognition

Real-time Vehicle Detection and Distance Measurement in Multi-Environment

Simultaneous detection and tracking using deep learning and integrated channel feature for ambint traffic light recognition

Leading vehicle detection at night based on millimeter-wave radar and machine vision

A Region Tracking-Based Vehicle Detection Algorithm in Nighttime Traffic Scenes.

Day and Night Vehicle Detection and Counting in Complex Environment.

Real-time vehicle detection and tracking based one traffic scene analysis

Vehicle detection algorithm based on light pairing and tracking at nighttime

Turn Signal Detection During Nighttime by CNN Detector and Perceptual Hashing Tracking

Preceding vehicle detection and tracking adaptive to illumination variation in night traffic scenes based on relevance analysis

Multi-View Vehicle Detection And Tracking In Crossroads

Design of a Robust System Architecture for Tracking Vehicle on Highway Based on Monocular Camera

Study on Nighttime Pedestrian Trajectory-Tracking from the Perspective of Driving Blind Spots

Application of Image Processing and Three-Dimensional Data Reconstruction Algorithm Based on Traffic Video in Vehicle Component Detection

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

Real-time multiple vehicles tracking with occlusion handling

Dual-Mode Serial Night Road Object Detection Model Based on Depthwise Separable and Self-Attention Mechanism