Abstract:With the acceleration of urbanization and the growing demand for traffic safety, developing intelligent systems capable of accurately recognizing and tracking pedestrian trajectories at night or under low-light conditions has become a research focus in the field of transportation. This study aims to improve the accuracy and real-time performance of nighttime pedestrian-detection and -tracking. A method that integrates the multi-object detection algorithm YOLOP with the multi-object tracking algorithm DeepSORT is proposed. The improved YOLOP algorithm incorporates the C2f-faster structure in the Backbone and Neck sections, enhancing feature extraction capabilities. Additionally, a BiFormer attention mechanism is introduced to focus on the recognition of small-area features, the CARAFE module is added to improve shallow feature fusion, and the DyHead dynamic target-detection head is employed for comprehensive fusion. In terms of tracking, the ShuffleNetV2 lightweight module is integrated to reduce model parameters and network complexity. Experimental results demonstrate that the proposed FBCD-YOLOP model improves lane detection accuracy by 5.1%, increases the IoU metric by 0.8%, and enhances detection speed by 25 FPS compared to the baseline model. The accuracy of nighttime pedestrian-detection reached 89.6%, representing improvements of 1.3%, 0.9%, and 3.8% over the single-task YOLO v5, multi-task TDL-YOLO, and the original YOLOP models, respectively. These enhancements significantly improve the model's detection performance in complex nighttime environments. The enhanced DeepSORT algorithm achieved an MOTA of 86.3% and an MOTP of 84.9%, with ID switch occurrences reduced to 5. Compared to the ByteTrack and StrongSORT algorithms, MOTA improved by 2.9% and 0.4%, respectively. Additionally, network parameters were reduced by 63.6%, significantly enhancing the real-time performance of nighttime pedestrian-detection and -tracking, making it highly suitable for deployment on intelligent edge computing surveillance platforms.

A Novel Day-to-Night Obstacle Detection Method for Excavators Based on Image Enhancement and Multisensor Fusion

Active Pedestrian Detection for Excavator Robots Based on Multi-Sensor Fusion

3D Pedestrian Detection in Farmland by Monocular RGB Image and Far-Infrared Sensing

Nighttime Foreground Pedestrian Detection Based on Three-Dimensional Voxel Surface Model

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

Unmanned Driving-Oriented Underground Mine Pedestrian Detection Method

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Construction site safety monitoring and excavator activity analysis system

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

Dual-Mode Serial Night Road Object Detection Model Based on Depthwise Separable and Self-Attention Mechanism

Deep Learning-Based Pedestrian Detection Using RGB Images and Sparse LiDAR Point Clouds

Feature Enhancement Method for Multimodal Nighttime Pedestrian Detection

Adaptive Road Detection Method Combining Lane Line and Obstacle Boundary

Near-surface Pedestrian Detection Method Based on Deep Learning for UAVs in Low Illumination Environments

Using Context-Guided data Augmentation, lightweight CNN, and proximity detection techniques to improve site safety monitoring under occlusion conditions

Study on Nighttime Pedestrian Trajectory-Tracking from the Perspective of Driving Blind Spots

Detection of Pedestrians for Far-Infrared Automotive Night Vision Systems Using Learning-Based Method and Head Validation

Full-body pose estimation for excavators based on data fusion of multiple onboard sensors

Railway obstacle intrusion warning mechanism integrating YOLO-based detection and risk assessment

On-road multiple obstacles detection using color images and LiDAR point clouds

Cross-modality feature fusion for night pedestrian detection