Abstract:The open-set problem is among the problems that have significantly changed the performance of face recognition algorithms in real-world scenarios. Open-set operates under the supposition that not all the probes have a pair in the gallery. Most face recognition systems in real-world scenarios focus on handling pose, expression and illumination problems on face recognition. In addition to these challenges, when the number of subjects is increased for face recognition, these problems are intensified by look-alike faces for which there are two subjects with lower intra-class variations. In such challenges, the inter-class similarity is higher than the intra-class variation for these two subjects. In fact, these look-alike faces can be created as intrinsic, situation-based and also by facial plastic surgery. This work introduces three real-world open-set face recognition methods across facial plastic surgery changes and a look-alike face by 3D face reconstruction and sparse representation. Since some real-world databases for face recognition do not have multiple images per person in the gallery, with just one image per subject in the gallery, this paper proposes a novel idea to overcome this challenge by 3D modeling from gallery images and synthesizing them for generating several images. Accordingly, a 3D model is initially reconstructed from frontal face images in a real-world gallery. Then, each 3D reconstructed face in the gallery is synthesized to several possible views and a sparse dictionary is generated based on the synthesized face image for each person. Also, a likeness dictionary is defined and its optimization problem is solved by the proposed method. Finally, the face recognition is performed for open-set face recognition using three proposed representation classifications. Promising results are achieved for face recognition across plastic surgery and look-alike faces on three databases including the plastic surgery face, look-alike face and LFW databases compared to several state-of-the-art methods. Also, several real-world and open-set scenarios are performed to evaluate the proposed method on these databases in real-world scenarios.

Open-Set Face Identification on Few-Shot Gallery by Fine-Tuning

Open-set Face Recognition using Ensembles trained on Clustered Data

Open-set Face Recognition for Small Galleries Using Siamese Networks

Enhancing Open-Set Face Recognition by Closing It with Cluster-Inferred Gallery Augmentation

Open-set face identification with automatic detection of out-of-distribution images

Multifaceted Analysis of Fine-Tuning in Deep Model for Visual Recognition

Open-Set Face Recognition with Maximal Entropy and Objectosphere Loss

Improvised contrastive loss for improved face recognition in open-set nature

Toward Open-Set Face Recognition

Feature Learning for One-Shot Face Recognition.

One-Shot Face Recognition Based on Multiple Classifiers Training

Open set face recognition using adaboost and geometric transformation

Open-Set Biometrics: Beyond Good Closed-Set Models

Open-set face recognition across look-alike faces in real-world scenarios

FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network

Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment

Effective Domain Knowledge Transfer with Soft Fine-tuning

Open-set Face Recognition with Neural Ensemble, Maximal Entropy Loss and Feature Augmentation

Multi-task pose-invariant face recognition.

Neural Fine-Tuning Search for Few-Shot Learning

Face Recogntion in Open World Environment