Abstract:A thermal camera captures the temperature distribution of a scene as a thermal image. In thermal images, facial appearances of different people under different lighting conditions are similar. This is because facial temperature distribution is generally constant and not affected by lighting condition. This similarity in face appearances is advantageous for face detection. To detect faces in thermal images, cascade classifiers with Haar-like features are generally used. However, there are few studies exploring the local features for face detection in thermal images. In this paper, we introduce two approaches relying on local features for face detection in thermal images. First, we create new feature types by extending Multi-Block LBP. We consider a margin around the reference and the generally constant distribution of facial temperature. In this way, we make the features more robust to image noise and more effective for face detection in thermal images. Second, we propose an AdaBoost-based training method to get cascade classifiers with multiple types of local features. These feature types have different advantages. In this way we enhance the description power of local features. We did a hold-out validation experiment and a field experiment. In the hold-out validation experiment, we captured a dataset from 20 participants, comprising 14 males and 6 females. For each participant, we captured 420 images with 10 variations in camera distance, 21 poses, and 2 appearances (participant with/without glasses). We compared the performance of cascade classifiers trained by different sets of the features. The experiment results showed that the proposed approaches effectively improve the performance of face detection in thermal images. In the field experiment, we compared the face detection performance in realistic scenes using thermal and RGB images, and gave discussion based on the results.

Detection of Human Face by Thermal Infrared Camera Using MPI model and Feature Extraction Method

Image Stitching and Partitioning Algorithms for Infrared Thermal Human-Body Images

Thermal Human face recognition based on Haar wavelet transform and series matching technique

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Histogram Matched Visible and Infrared Image Registration for Face Detection

Automated Thermal Face recognition based on Minutiae Extraction

Face Authentication Using Thermal Imaging

A novel face detection algorithm using thermal imaging

Minutiae Based Thermal Human Face Recognition using Label Connected Component Algorithm

Face emotion recognition based on infrared thermal imagery by applying machine learning and parallelism

Human Detection for Night Surveillance using Adaptive Background Subtracted Image

Infrared Thermal Imaging Face Recognition Method Based on Temperature Block Feature

A comparison of thermal image descriptors for face analysis

Objects and Action Detection of Human Faces through Thermal Images Using ANU-Net

Hallucinating Faces From Thermal Infrared Images

Adapting Local Features for Face Detection in Thermal Image

A unified framework for thermal face recognition

Image Pixel Fusion for Human Face Recognition

A novel saliency detection framework for infrared thermal images

Minutiae Based Thermal Face Recognition using Blood Perfusion Data

A deep learning model for classifying human facial expressions from infrared thermal images