Abstract:In recent years, visible-spectrum face verification systems have been shown to match the performance of experienced forensic examiners. However, such systems are ineffective in low-light and nighttime conditions. Thermal face imagery, which captures body heat emissions, effectively augments the visible spectrum, capturing discriminative facial features in scenes with limited illumination. Due to the increased cost and difficulty of obtaining diverse, paired thermal and visible spectrum datasets, not many algorithms and large-scale benchmarks for low-light recognition are available. This paper presents an algorithm that achieves state-of-the-art performance on both the ARL-VTF and TUFTS multi-spectral face datasets. Importantly, we study the impact of face alignment, pixel-level correspondence, and identity classification with label smoothing for multi-spectral face synthesis and verification. We show that our proposed method is widely applicable, robust, and highly effective. In addition, we show that the proposed method significantly outperforms face frontalization methods on profile-to-frontal verification. Finally, we present MILAB-VTF(B), a challenging multi-spectral face dataset that is composed of paired thermal and visible videos. To the best of our knowledge, with face data from 400 subjects, this dataset represents the most extensive collection of indoor and long-range outdoor thermal-visible face imagery. Lastly, we show that our end-to-end thermal-to-visible face verification system provides strong performance on the MILAB-VTF(B) dataset.

Two-directional two-dimensional modified Fisher principal component analysis: An efficient approach for thermal face verification

Spectral analysis for face recognition

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

A robust feature extraction algorithm based on class-Modular Image Principal Component Analysis for face verification

An ICA-Based Other-Race Effect Elimination for Facial Expression Recognition.

Two-Dimensional Euler PCA for Face Recognition

(2D)(2)pca: Two-Directional Two-Dimensional Pca for Efficient Face Representation and Recognition

Advanced Variations of Two-Dimensional Principal Component Analysis for Face Recognition

Bilateral Two-Dimensional Principal Component Analysis with its Application to Face Recognition

Improved kernel direct Fisher discriminant analysis and face recognition

( 2 D ) 2 PCA : 2-Directional 2-Dimensional PCA for Efficient Face Representation and Recognition

A Synthesis-Based Approach for Thermal-to-Visible Face Verification

Video Based Face Verification

The Equivalence of Two-Dimensional PCA to Line-Based PCA

Diagonal principal component analysis for face recognition

Rapid and brief communication: Diagonal principal component analysis for face recognition

A face recognition software framework based on principal component analysis

Two-Stage Block-Based Whitened Principal Component Analysis with Application to Single Sample Face Recognition.

Principal component net analysis for face recognition

Improved Principal Component Analysis for Face Image Recognition

Unified Principal Component Analysis With Generalized Covariance Matrix For Face Recognition