Abstract:RGB-Thermal pedestrian detection has shown many notable advantages in various lighting and weather conditions by combining the information from RGB-T images. Due to distinct imaging principles, RGB-T modalities consist of modality-specific and modality-consistent information. However, most existing RGB-T pedestrian detection methods indiscriminately integrate these two types of information, which leads to the pollution of modality information. To address this issue, we propose a novel mask-guided multi-level fusion network (M2FNet) for RGB-T pedestrian detection. M2FNet independently explores consistent and specific features in RGB-T modalities at three different levels, utilizing pixel-level positional information in masks to exclusively focus on pedestrian-related features. Specifically, at the feature extraction level, we selectively embed cross-modality differential compensation (CDC) modules and design the bidirectional multiscale fusion (BMF) module to fully utilize the complementary modality-specific information and enhance the precision of predicted pedestrian masks. At the feature fusion level, the mask-guided global consistency mining (MGCM) module is introduced to capture intra-modal and inter-modal consistent information of pedestrians, which generates highly discriminative RGB-T features. Finally, to further reduce inter-modal differences, we propose a mask-guided pixel-level decision fusion (MPDF) strategy to dynamically weight the RGB-T predictions. Extensive experiments and comparisons demonstrate that our proposed M2FNet, with different backbones, outperforms the state-of-the-art detectors on both publicly available KAIST and CVC-14 RGB-T pedestrian detection datasets.

Mask-streaming CNN for Pedestrian Detection.

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Mask-Guided Attention Network for Occluded Pedestrian Detection

Count- and Similarity-Aware R-CNN for Pedestrian Detection

Deep Convolutional Neural Networks For Pedestrian Detection With Skip Pooling

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Robust multi-modal pedestrian detection using deep convolutional neural network with ensemble learning model

Pedestrian Detection Aided by Scale-Discriminative Network.

Collaborative Deep Networks for Pedestrian Detection

Pedestrian Detection by Learning a Mixture Mask Model and Its Implementation

Guided Attention in CNNs for Occluded Pedestrian Detection and Re-identification

Part-Level Convolutional Neural Networks for Pedestrian Detection Using Saliency and Boundary Box Alignment

Pedestrian Detection Using a Mixture Mask Model

PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes

SAM-RCNN: Scale-Aware Multi-Resolution Multi-Channel Pedestrian Detection

Pushing the Limits of Deep CNNs for Pedestrian Detection

M2FNet: Mask-guided Multi-level Fusion for RGB-T Pedestrian Detection

Pedestrian Detection Based on Region Proposal Fusion.

Asymmetric multi-stage CNNs for small-scale pedestrian detection