Abstract:A novel real-time infrared pedestrian detection algorithm is introduced in this study. The proposed approach leverages re-parameterized convolution and channel-spatial location fusion attention to tackle the difficulties presented by low-resolution, partial occlusion, and environmental interference in infrared pedestrian images. These factors have historically hindered the accurate detection of pedestrians using traditional algorithms. First, to tackle the problem of weak feature representation of infrared pedestrian targets caused by low resolution and partial occlusion, a new attention module that integrates channel and spatial is devised and introduced to CSPDarkNet53 to design a new backbone CSLF-DarkNet53. The designed attention model can enhance the feature expression ability of pedestrian targets and make pedestrian targets more prominent in complex backgrounds. Second, to enhance the efficiency of detection and accelerate convergence, a multi-branch decoupled detector head is designed to operate the classification and location of infrared pedestrians separately. Finally, to improve poor real-time without losing precision, we introduce the re-parameterized convolution (Repconv) using parameter identity transformation to decouple the training process and detection process. During the training procedure, to enhance the fitting ability of small convolution kernels, a multi-branch structure with convolution kernels of different scales is designed. Compared with the nice classical detection algorithms, the results of the experiment show that the proposed RCSLFNet not only detects partial occlusion infrared pedestrians in complex environments accurately but also has better real-time performance on the KAIST dataset. The mAP@0.5 reaches 86% and the detection time is 0.0081 s, 2.9% higher than the baseline.

Multi-scale cross-layer fusion and center position network for pedestrian detection

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Transformer fusion and histogram layer multispectral pedestrian detection network

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

PFEL-Net: A lightweight network to enhance feature for multi-scale pedestrian detection

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Multi ROI and Multi Map Networks for Accurate and Efficient Pedestrian Detection

A Unified Multi-Task Learning Architecture for Fast and Accurate Pedestrian Detection

RCSLFNet: a novel real-time pedestrian detection network based on re-parameterized convolution and channel-spatial location fusion attention for low-resolution infrared image

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Robust Pedestrian Detection Based on Multi-Spectral Image Fusion and Convolutional Neural Networks

Multispectral Deep Neural Networks for Pedestrian Detection

Pedestrian detection based on channel feature fusion and enhanced semantic segmentation

Pedestrian As Points: an Improved Anchor-Free Method for Center-Based Pedestrian Detection.

Pedestrian Detection Aided by Scale-Discriminative Network.

MFMANet: a multispectral pedestrian detection network using multi-resolution RGB feature reuse with multi-scale FIR attentions

Asymmetric multi-stage CNNs for small-scale pedestrian detection

Improving Multispectral Pedestrian Detection with Scale‐aware Permutation Attention and Adjacent Feature Aggregation