Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.

Parallel Binocular Stereo-Vision-based GPU Accelerated Pedestrian Detection and Distance Computation

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

High-Performance Visual Odometry with Two-Stage Local Binocular Ba and Gpu

Deep convolutional neural networks for pedestrian detection

FPGA-Based Pedestrian Detection for Collision Prediction System

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

Keypoint-based binocular distance measurement for pedestrian detection system

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Real-Time Rendering Based on GPU for Binocular Stereo System

Parallel Pipeline Implementation for Moving Objects Detection in Traffic Video Analysis on a Heterogeneous Platform

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Shape-based Pedestrian/Bicyclist Detection via Onboard Stereo Vision

Intelligent vehicle visual pose estimation algorithm based on deep learning and parallel computing for dynamic scenes

Near-Chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

GPU accelerated face detection

MambaST: A Plug-and-Play Cross-Spectral Spatial-Temporal Fuser for Efficient Pedestrian Detection