Abstract:Pedestrian detection has become an important branch in the field of object detection. However, pedestrian detection algorithms based on visible imagery meet many challenges under low lighting or no lighting conditions. Thermal imagery can effectively compensate the information loss of visible imagery in the night environment. In order to solve the problem of pedestrian detection at night or in other bad conditions with limited vision, a pedestrian detection method based on center, temperature, scale and ratio prediction in thermal imagery is proposed. The proposed method contains two parts: (1) feature extraction part; and (2) center, temperature, scale and ratio prediction part. The feature extraction part uses ResNet-101 network to extract high-level semantic features from input thermal imagery. In the center, temperature, scale and ratio prediction part, the center branch is to determine whether there is a target center point in each position of feature map, which is a binary classification problem. The temperature branch is to determine whether the center point is a pedestrian target radiating heat or the background. Scale prediction branch and aspect ratio prediction branch are to determine the size of the target, which is a regression problem. We test the proposed detection method in FLIR advanced driver assistance system (ADAS) dataset. Experimental results show that the proposed method can effectively deal with pedestrian detection in low light and dark environment, and its detection performance is better than that of the baseline of nighttime pedestrian detection methods.

Robust pedestrian detection in thermal infrared imagery using a shape distribution histogram feature and modified sparse representation classification

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Research on Hierarchical Pedestrian Detection Based on SVM Classifier with Improved Kernel Function

Shape-based Pedestrian Detection in Infrared Images

Robust Pedestrian Classification Based on Hierarchical Kernel Sparse Representation

Contour Information-Guided Multi-Scale Feature Detection Method for Visible-Infrared Pedestrian Detection

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Contour-motion Feature (CMF): A Space-Time Approach for Robust Pedestrian Detection

Robust Thermal Infrared Pedestrian Detection By Associating Visible Pedestrian Knowledge

Learning Cross-Modal Deep Representations for Robust Pedestrian Detection

Improved Human Detection and Classification in Thermal Images.

A new thermal infrared and visible spectrum images-based pedestrian detection system

A pedestrian detection method based on boosted MQDF classifiers

Efficient Pedestrian Detection via Rectangular Features Based on a Statistical Shape Model

Multi-scale Pedestrian Detection in Infrared Images with Salient Background-awareness

Effective Pedestrian Detection Using Center-symmetric Local Binary/Trinary Patterns

A Method of Infrared Image Pedestrian Detection with Improved YOLOv3 Algorithm

Deep saliency detection-based pedestrian detection with multispectral multi-scale features fusion network