Abstract:Visible-range camera sensors have been widely used for pedestrian detection. However, most of the methods, which employ visible-range color cameras, do not perform well under low-light and no-light conditions, e.g. during night time. Since the working principle of thermal camera sensors is mainly based on temperature and not light, they have been employed for person detection to overcome the drawbacks of visible-range sensors under these conditions. Every object gives off thermal energy, which is captured by a thermal camera sensor. When an object becomes hotter, it emits more thermal energy, and is therefore captured as much brighter or vice versa. Yet, compared to visible-range cameras, there are many additional challenges that need to be addressed when detecting pedestrians from thermal camera images. These challenges include bright hot objects close to humans, similar pixel values in an image due to weather conditions, or objects that block thermal cameras such as concrete or glass. Glass acts like a mirror for infrared radiation and reflects whatever is in front of the camera. Thus, novel methods are still required to accomplish pedestrian detection task from thermal camera images. To contribute to these efforts, we propose a new method and a modified object detection network incorporating saliency maps of thermal camera images. The features obtained from thermal images and their corresponding saliency maps are combined to obtain richer representations of pedestrian regions, and better detection performance. We perform extensive evaluations on five different datasets to compare the performance of the proposed approach with two baselines. Moreover, we evaluate and compare the transferability of these approaches by doing leave-one-out cross validation across different datasets. The results show that the proposed approach outperforms the baselines, and has better transferability properties across different thermal image datasets.

A new thermal infrared and visible spectrum images-based pedestrian detection system

A novel visible spectrum images-based pedestrian detection and tracking system for surveillance in non-controlled environments

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Robust Thermal Infrared Pedestrian Detection By Associating Visible Pedestrian Knowledge

The Use of Thermal Cameras for Pedestrian Detection

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image

A Monocular Vision Based Pedestrian Detection System for Intelligent Vehicles

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

A Method of Infrared Image Pedestrian Detection with Improved YOLOv3 Algorithm

Shape-based Pedestrian Detection in Infrared Images

Efficient And Real-Time Pedestrian Detection At Night-Time Environments

Hybrid Attention for Robust RGB-T Pedestrian Detection in Real-World Conditions

Robust pedestrian detection in thermal infrared imagery using a shape distribution histogram feature and modified sparse representation classification

Robust pedestrian detection in thermal imagery using synthesized images

Contour Information-Guided Multi-Scale Feature Detection Method for Visible-Infrared Pedestrian Detection

Thermal imaging pedestrian detection algorithm based on attention guidance and local cross-level network

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Optimal Fusion-based Asymmetric Two-stream Networks for Multispectral Image Pedestrian Detection

Learning Cross-Modal Deep Representations for Robust Pedestrian Detection