Abstract:A thermal camera captures the temperature distribution of a scene as a thermal image. In thermal images, facial appearances of different people under different lighting conditions are similar. This is because facial temperature distribution is generally constant and not affected by lighting condition. This similarity in face appearances is advantageous for face detection. To detect faces in thermal images, cascade classifiers with Haar-like features are generally used. However, there are few studies exploring the local features for face detection in thermal images. In this paper, we introduce two approaches relying on local features for face detection in thermal images. First, we create new feature types by extending Multi-Block LBP. We consider a margin around the reference and the generally constant distribution of facial temperature. In this way, we make the features more robust to image noise and more effective for face detection in thermal images. Second, we propose an AdaBoost-based training method to get cascade classifiers with multiple types of local features. These feature types have different advantages. In this way we enhance the description power of local features. We did a hold-out validation experiment and a field experiment. In the hold-out validation experiment, we captured a dataset from 20 participants, comprising 14 males and 6 females. For each participant, we captured 420 images with 10 variations in camera distance, 21 poses, and 2 appearances (participant with/without glasses). We compared the performance of cascade classifiers trained by different sets of the features. The experiment results showed that the proposed approaches effectively improve the performance of face detection in thermal images. In the field experiment, we compared the face detection performance in realistic scenes using thermal and RGB images, and gave discussion based on the results.

Multiple Thermal Face Detection in Unconstrained Environments Using Fully Convolutional Networks.

End-to-End Spatial Transform Face Detection and Recognition

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Enhancing thermal facial recognition leveraging large datasets and hybrid algorithms

Acceleration of multi-task cascaded convolutional networks

Multi-face detection and alignment using multiple kernels

Feature Agglomeration Networks for Single Stage Face Detection

Face Detection With End-To-End Integration Of A Convnet And A 3d Model

Multi-spectral Facial Landmark Detection

Two-stage Convolutional Neural Network for Joint Removal of Sensor Noise and Background Interference in Lock-in Thermography

Multi-face detection algorithm suitable for video surveillance

Robust Face Detector with Fully Convolutional Networks

Face Detection Using R-FCN Based Deformable Convolutional Networks

Multi-channel Deep 3D Face Recognition

A fast face detection method via convolutional neural network

Adapting Local Features for Face Detection in Thermal Image

A novel face detection algorithm using thermal imaging

Multi-Path Region-Based Convolutional Neural Network for Accurate Detection of Unconstrained "Hard Faces"

Deep features class activation map for thermal face detection and tracking

Real-time detection tracking and recognition algorithm based on multi-target faces

An Automatic System for Unconstrained Video-Based Face Recognition