Abstract:With the acceleration of urbanization and the growing demand for traffic safety, developing intelligent systems capable of accurately recognizing and tracking pedestrian trajectories at night or under low-light conditions has become a research focus in the field of transportation. This study aims to improve the accuracy and real-time performance of nighttime pedestrian-detection and -tracking. A method that integrates the multi-object detection algorithm YOLOP with the multi-object tracking algorithm DeepSORT is proposed. The improved YOLOP algorithm incorporates the C2f-faster structure in the Backbone and Neck sections, enhancing feature extraction capabilities. Additionally, a BiFormer attention mechanism is introduced to focus on the recognition of small-area features, the CARAFE module is added to improve shallow feature fusion, and the DyHead dynamic target-detection head is employed for comprehensive fusion. In terms of tracking, the ShuffleNetV2 lightweight module is integrated to reduce model parameters and network complexity. Experimental results demonstrate that the proposed FBCD-YOLOP model improves lane detection accuracy by 5.1%, increases the IoU metric by 0.8%, and enhances detection speed by 25 FPS compared to the baseline model. The accuracy of nighttime pedestrian-detection reached 89.6%, representing improvements of 1.3%, 0.9%, and 3.8% over the single-task YOLO v5, multi-task TDL-YOLO, and the original YOLOP models, respectively. These enhancements significantly improve the model's detection performance in complex nighttime environments. The enhanced DeepSORT algorithm achieved an MOTA of 86.3% and an MOTP of 84.9%, with ID switch occurrences reduced to 5. Compared to the ByteTrack and StrongSORT algorithms, MOTA improved by 2.9% and 0.4%, respectively. Additionally, network parameters were reduced by 63.6%, significantly enhancing the real-time performance of nighttime pedestrian-detection and -tracking, making it highly suitable for deployment on intelligent edge computing surveillance platforms.

Adaptive Hysteresis Thresholding Based Pedestrian Detection in Nighttime Using A Normal Camera

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Nighttime Pedestrian Detection With A Normal Camera Using Svm Classifier

Nighttime Pedestrian Detection With Near Infrared Using Cascaded Classifiers

An Improved Pedestrian Detection Approach For Cluttered Background In Nighttime

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image

Transformer fusion and histogram layer multispectral pedestrian detection network

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Study on Nighttime Pedestrian Trajectory-Tracking from the Perspective of Driving Blind Spots

Nighttime Pedestrian Detection Based on a Fusion of Visual Information and Millimeter-Wave Radar

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Pedestrian Detection Based on Adaptive Selection of Visible Light or Far-Infrared Light Camera Image by Fuzzy Inference System and Convolutional Neural Network-Based Verification

Shape-based Pedestrian Detection in Infrared Images

Pedestrian detection by multiple decision-based neural networks

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection