Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

A Pedestrian Detection Method under Time-space Data Fusion Based on Laser and Video Information

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

A Pedestrian Detection Algorithm Based on Score Fusion for Multi-LiDAR Systems

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Pedestrian detection by radar vision data fusion

Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Pedestrian movement trajectory reappearance and crossing feature expression based on video processing

Transformer fusion and histogram layer multispectral pedestrian detection network

Pedestrian Recognition and Tracking of Dancing Robot Based on Laser Scanner

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Real-Time Pedestrian-Vehicle Conflict Detection Algorithm Using Video Data

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Detection and Tracking of Multiple Pedestrians by Using Laser Range Scanners

Pedestrian detection based on channel feature fusion and enhanced semantic segmentation

Nighttime Pedestrian Detection Based on a Fusion of Visual Information and Millimeter-Wave Radar

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Posterior Probability Based Multi-classifier Fusion in Pedestrian Detection.