Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

Multi-scale Pedestrian Detection in Infrared Images with Salient Background-awareness

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Characterization of colony-stimulating activity in medium conditioned by a human cell line (KSNY).

Deep saliency detection-based pedestrian detection with multispectral multi-scale features fusion network

An infrared pedestrian detection method based on segmentation and domain adaptation learning

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

IPD-Net: Infrared Pedestrian Detection Network via Adaptive Feature Extraction and Coordinate Information Fusion

Multi-Grained Deep Feature Learning for Pedestrian Detection

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

Robust Pedestrian Detection Based on Multi-Spectral Image Fusion and Convolutional Neural Networks

Lightweight Spatial Sliced-Concatenate-Multireceptive-Field Enhance and Joint Channel Attention Mechanism for Infrared Object Detection

A Method of Infrared Image Pedestrian Detection with Improved YOLOv3 Algorithm

RCSLFNet: a novel real-time pedestrian detection network based on re-parameterized convolution and channel-spatial location fusion attention for low-resolution infrared image

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Improving Multispectral Pedestrian Detection with Scale‐aware Permutation Attention and Adjacent Feature Aggregation

Box-level Segmentation Supervised Deep Neural Networks for Accurate and Real-time Multispectral Pedestrian Detection

An Efficient Pedestrian Detection for Realtime Surveillance Systems Based on Modified YOLOv3

Pedestrian detection based on channel feature fusion and enhanced semantic segmentation