Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

A Low-Cost Pedestrian Detection System with a Single Optical Camera

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

Pedestrian detection in video of outdoor condition

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

A Monocular Vision Based Pedestrian Detection System for Intelligent Vehicles

A Real-Time Pedestrian Counting System Based on RGB-D

YOLOv8-CB: Dense Pedestrian Detection Algorithm Based on In-Vehicle Camera

Pedestrian Detection Optimization Algorithm Based on Low-Altitude UAV

An Efficient Pedestrian Detection for Realtime Surveillance Systems Based on Modified YOLOv3

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

REAL-TIME SIDE PEDESTRIAN DETECTION FOR DRIVER ASSISTANCE SYSTEMS

Detection and Tracking of Multiple Pedestrians by Using Laser Range Scanners

Near-Chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection

Nighttime Pedestrian Detection With A Normal Camera Using Svm Classifier

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

A novel visible spectrum images-based pedestrian detection and tracking system for surveillance in non-controlled environments