Abstract:Multispectral pedestrian detection is a technology designed to detect and locate pedestrians in Color and Thermal images, which has been widely used in automatic driving, video surveillance, etc. So far most available multispectral pedestrian detection algorithms only achieved limited success in pedestrian detection because of the lacking take into account the confusion of pedestrian information and background noise in Color and Thermal images. Here we propose a multispectral pedestrian detection algorithm, which mainly consists of a cascaded information enhancement module and a cross-modal attention feature fusion module. On the one hand, the cascaded information enhancement module adopts the channel and spatial attention mechanism to perform attention weighting on the features fused by the cascaded feature fusion block. Moreover, it multiplies the single-modal features with the attention weight element by element to enhance the pedestrian features in the single-modal and thus suppress the interference from the background. On the other hand, the cross-modal attention feature fusion module mines the features of both Color and Thermal modalities to complement each other, then the global features are constructed by adding the cross-modal complemented features element by element, which are attentionally weighted to achieve the effective fusion of the two modal features. Finally, the fused features are input into the detection head to detect and locate pedestrians. Extensive experiments have been performed on two improved versions of annotations (sanitized annotations and paired annotations) of the public dataset KAIST. The experimental results show that our method demonstrates a lower pedestrian miss rate and more accurate pedestrian detection boxes compared to the comparison method. Additionally, the ablation experiment also proved the effectiveness of each module designed in this paper.

A Combination of Cascade Differences Support Vector Machines Algorithm for Pedestrian Detection

Pedestrain Detection Method Based on Partition Ensemble

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Research on Hierarchical Pedestrian Detection Based on SVM Classifier with Improved Kernel Function

Pedestrian Detection Based on Merged Cascade Classifier.

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

A pedestrian detection method based on boosted MQDF classifiers

Double-pedestrian deformable part model and its application in pedestrian detection

Pedestrian Detection Using a Mixture Mask Model

AdaBoost Pedestrian Detection Algorithm Based on Dual-Threshold Motion Area Segmentation

Multi Features Combination for Pedestrian Detection.

Adaptive Pedestrian Detection by Predicting Classifier

Cascaded information enhancement and cross-modal attention feature fusion for multispectral pedestrian detection

Fast Pedestrian Detection Using a Cascade of Boosted Covariance Features.

Posterior Probability Based Multi-classifier Fusion in Pedestrian Detection.

Real-time Pedestrian Detection Using a Boosted Multi-layer Classifier

Pedestrian-vehicle Detection and Classification Based on Video

Pedestrian Detection by Learning a Mixture Mask Model and Its Implementation

A pedestrian detection algorithm based on deep learning