Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

Research on Pedestrian Detection Algorithm Based on Deep Learning

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Research Advanced in Pedestrian Detection Based on Deep Learning

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

A pedestrian detection algorithm based on deep learning

Survey of Pedestrian Detection with Occlusion

Occlusion and multi-scale pedestrian detection A review

A Review of Intelligent Driving Pedestrian Detection Based on Deep Learning

Research on Pedestrian Detection and Head Counting Algorithm Based on Computer Vision

Deep convolutional neural networks for pedestrian detection

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Pedestrian Detection in Crowded Crowd Scene Based on Deep Learning

Deep Learning-Based Pedestrian Detection in Autonomous Vehicles: Substantial Issues and Challenges

Design and Construction of Video Image Pedestrian Detection System Based on Deep Learning Model

Research on Deep Learning Detection Model for Pedestrian Objects in Complex Scenes Based on Improved YOLOv7

Research on Pedestrian Detection and DeepSort Tracking in Front of Intelligent Vehicle Based on Deep Learning

Pedestrian Target Recognition Algorithm in Public Places Based on Representation Learning and Similarity Learning

Pedestrian detection in video of outdoor condition

Deep Forest with Local Experts Based on ELM for Pedestrian Detection.