Abstract:Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all pedestrian detection methods, vision-based detection method is demonstrated to be the most effective in previous studies. However, the existing vision-based pedestrian detection algorithms still have two limitations that restrict their implementations, those being real-time performance as well as the resistance to the impacts of environmental factors, e.g., low illumination conditions. To address these issues, this study proposes a lightweight Illumination and Temperature-aware Multispectral Network (IT-MN) for accurate and efficient pedestrian detection. The proposed IT-MN is an efficient one-stage detector. For accommodating the impacts of environmental factors and enhancing the sensing accuracy, thermal image data is fused by the proposed IT-MN with visual images to enrich useful information when visual image quality is limited. In addition, an innovative and effective late fusion strategy is also developed to optimize the image fusion performance. To make the proposed model implementable for edge computing, the model quantization is applied to reduce the model size by 75% while shortening the inference time significantly. The proposed algorithm is evaluated by comparing with the selected state-of-the-art algorithms using a public dataset collected by in-vehicle cameras. The results show that the proposed algorithm achieves a low miss rate and inference time at 14.19% and 0.03 seconds per image pair on GPU. Besides, the quantized IT-MN achieves an inference time of 0.21 seconds per image pair on the edge device, which also demonstrates the potentiality of deploying the proposed model on edge devices as a highly efficient pedestrian detection algorithm.

Real-Time Pedestrian Detection Based on Improved Gaussian Mixture Model

Multiple Pedestrians Tracking Based on Gaussian Probability Model

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Pedestrian Detection Using a Mixture Mask Model

Representation and Analysis of Pedestrian Crossing States Based on Video Tracking

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Pedestrian Detection by Learning a Mixture Mask Model and Its Implementation

An Improved Gaussian Mixture Modeling Algorithm Combining Foreground Matching and Short-Term Stability Measure for Motion Detection

Real-Time Pedestrian-Vehicle Conflict Detection Algorithm Using Video Data

Vision-Based Moving Objects Detection with Background Modeling

Background extraction model and shadow detection algorithm in traffic flow video detection

Adaptive moving target detection algorithm based on Gaussian mixture model

Pedestrian-vehicle Detection and Classification Based on Video

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

An Improved Particle Filter Approach for Real-time Pedestrian Tracking in Surveillance Video

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

A Pedestrian-Detection Method Based on Heterogeneous Features and Ensemble of Multi-View–Pose Parts

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Pedestrian Detection Via Part-Based Topology Model