Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

Survey on pedestrian detection technology for on-board vision systems

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

See Extensively While Focusing on the Core Area for Pedestrian Detection.

A Review on Vision-Based Pedestrian Detection for Intelligent Vehicles

Survey of Pedestrian Detection with Occlusion

A Monocular Vision Based Pedestrian Detection System for Intelligent Vehicles

An On-Board Pedestrian Detection and Warning System with Features of Side Pedestrian

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Research, Applications and Prospects of Event-Based Pedestrian Detection: A Survey

Research on Pedestrian Detection Algorithm Based on Deep Learning

The study of the detection of pedestrian and bicycle using image processing

Occlusion and multi-scale pedestrian detection A review

Shape-based Pedestrian/Bicyclist Detection via Onboard Stereo Vision

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

From Handcrafted to Deep Features for Pedestrian Detection: A Survey

On-Board Pedestrian and Cyclist Recognition Using Deep Learning Methods

Research Advanced in Pedestrian Detection Based on Deep Learning

Research on Athlete Detection Method Based on Visual Image and Artificial Intelligence System

A Review of Intelligent Driving Pedestrian Detection Based on Deep Learning

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Efficient And Real-Time Pedestrian Detection At Night-Time Environments