Abstract:A novel real-time infrared pedestrian detection algorithm is introduced in this study. The proposed approach leverages re-parameterized convolution and channel-spatial location fusion attention to tackle the difficulties presented by low-resolution, partial occlusion, and environmental interference in infrared pedestrian images. These factors have historically hindered the accurate detection of pedestrians using traditional algorithms. First, to tackle the problem of weak feature representation of infrared pedestrian targets caused by low resolution and partial occlusion, a new attention module that integrates channel and spatial is devised and introduced to CSPDarkNet53 to design a new backbone CSLF-DarkNet53. The designed attention model can enhance the feature expression ability of pedestrian targets and make pedestrian targets more prominent in complex backgrounds. Second, to enhance the efficiency of detection and accelerate convergence, a multi-branch decoupled detector head is designed to operate the classification and location of infrared pedestrians separately. Finally, to improve poor real-time without losing precision, we introduce the re-parameterized convolution (Repconv) using parameter identity transformation to decouple the training process and detection process. During the training procedure, to enhance the fitting ability of small convolution kernels, a multi-branch structure with convolution kernels of different scales is designed. Compared with the nice classical detection algorithms, the results of the experiment show that the proposed RCSLFNet not only detects partial occlusion infrared pedestrians in complex environments accurately but also has better real-time performance on the KAIST dataset. The mAP@0.5 reaches 86% and the detection time is 0.0081 s, 2.9% higher than the baseline.

Context aware Pedestrian Detection with Salient Region Self growing in Far infrared Images

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Multi-scale Pedestrian Detection in Infrared Images with Salient Background-awareness

An infrared pedestrian detection method based on segmentation and domain adaptation learning

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

RCSLFNet: a novel real-time pedestrian detection network based on re-parameterized convolution and channel-spatial location fusion attention for low-resolution infrared image

Shape-based Pedestrian Detection in Infrared Images

Overview of Pedestrian Detection Based on Infrared Image

Pedestrian detection with unsupervised multispectral feature learning using deep neural networks

Feature Channel Expansion and Background Suppression as the Enhancement for Infrared Pedestrian Detection

Deep saliency detection-based pedestrian detection with multispectral multi-scale features fusion network

Improving Small-Scale Pedestrian Detection Using Informed Context

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Multispectral pedestrian detection based on feature complementation and enhancement

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Box-level Segmentation Supervised Deep Neural Networks for Accurate and Real-time Multispectral Pedestrian Detection

3D Pedestrian Detection in Farmland by Monocular RGB Image and Far-Infrared Sensing

A Method of Infrared Image Pedestrian Detection with Improved YOLOv3 Algorithm

Contour Information-Guided Multi-Scale Feature Detection Method for Visible-Infrared Pedestrian Detection

A Fast RetinaNet Fusion Framework for Multi-Spectral Pedestrian Detection

Robust Pedestrian Detection Based on Multi-Spectral Image Fusion and Convolutional Neural Networks