Abstract:As automated face recognition applications tend towards ubiquity, there is a growing need to secure the sensitive face data used within these systems. This paper presents a survey of biometric template protection (BTP) methods proposed for securing face templates (images/features) in neural-network-based face recognition systems. The BTP methods are categorised into two types: Non-NN and NN-learned. Non-NN methods use a neural network (NN) as a feature extractor, but the BTP part is based on a non-NN algorithm, whereas NN-learned methods employ a NN to learn a protected template from the unprotected template. We present examples of Non-NN and NN-learned face BTP methods from the literature, along with a discussion of their strengths and weaknesses. We also investigate the techniques used to evaluate these methods in terms of the three most common BTP criteria: recognition accuracy, irreversibility, and renewability/unlinkability. The recognition accuracy of protected face recognition systems is generally evaluated using the same (empirical) techniques employed for evaluating standard (unprotected) biometric systems. However, most irreversibility and renewability/unlinkability evaluations are found to be based on theoretical assumptions/estimates or verbal implications, with a lack of empirical validation in a practical face recognition context. So, we recommend a greater focus on empirical evaluations to provide more concrete insights into the irreversibility and renewability/unlinkability of face BTP methods in practice. Additionally, an exploration of the reproducibility of the studied BTP works, in terms of the public availability of their implementation code and evaluation datasets/procedures, suggests that it would be difficult to faithfully replicate most of the reported findings. So, we advocate for a push towards reproducibility, in the hope of advancing face BTP research.

Attention-Based Template Adaptation for Face Verification.

Template adaptation for face verification and identification

Selective Domain-Invariant Feature Alignment Network for Face Anti-Spoofing.

A Good Practice Towards Top Performance of Face Recognition: Transferred Deep Feature Fusion

Improving face recognition with domain adaptation

Deep Heterogeneous Feature Fusion for Template-Based Face Recognition

Are Adaptive Face Recognition Systems still Necessary? Experiments on the APE Dataset

Face Detection Based on Template Matching and Neural Network Verification

Learning accurate template matching with differentiable coarse-to-fine correspondence refinement

Learning Compact Feature Descriptor and Adaptive Matching Framework for Face Recognition

Face Recognition Based On Binary Template Matching

Learning shared template representation with augmented feature for multi-object pose estimation

Dependency-Aware Attention Control for Image Set-Based Face Recognition

Transferable Attention for Domain Adaptation

Attention Control with Metric Learning Alignment for Image Set-based Recognition

Biometric Template Protection for Neural-Network-based Face Recognition Systems: A Survey of Methods and Evaluation Techniques

A Convolutional Neural Network Face Recognition Method Based on BiLSTM and Attention Mechanism

A Novel Approach For Generating Face Template Using Bda

Effective Adapter for Face Recognition in the Wild

Template-based Multi-Domain Face Recognition

OGCTL: Occlusion-guided compact template learning for ensemble deep network-based pose-invariant face recognition