Abstract:Mugshots while routinely acquired by law enforcement agencies are under utilized by automated face recognition systems. In this paper, we propose a regression based approach to reconstruct textured full 3D face models from multi-view mugshot images. Using landmarks from the input frontal and profile mugshots of a subject, our method reconstructs his<math>⧹</math>her 3D face shape via either linear or nonlinear regressors. The texture of the mugshot images is mapped to the reconstructed 3D face shape via an efficient seamless texture recovery scheme. Compared with existing 3D face reconstruction methods, the proposed method more effectively utilizes the three-view mugshot face images collected during booking. The reconstructed 3D faces are used to generate realistic multi-view face images to enlarge the gallery and facilitate arbitrary view face recognition. Evaluation experiments have been done on BFM and Bosphorus databases in terms of reconstruction accuracy, and on Multi-PIE and Color FERET databases in terms of recognition accuracy. The results show that the proposed method can reduce the 3D face reconstruction error of the best competitive method from <math>2.31mm</math> to <math>1.88mm</math>, and improve the recognition accuracy of state-of-the-art deep learning based face matchers by as much as <math>∼4%</math> on Multi-PIE and <math>∼2%</math> on Color FERET despite the high baseline set by them.

Identifying Faces Using Multiple Retrievals

Content-based suspect identification system

Face identification using reference-based features with message passing model

Learning to Name Faces

Where is who: large-scale photo retrieval by facial attributes and canvas layout.

3D face recognition based on multiple keypoint descriptors and sparse representation.

Large Scale Identity Deduplication Using Face Recognition Based on Facial Feature Points

Face detection and retrieval

Face Indexing And Retrieval In Personal Digital Album

Detecting Facial Features On Images With Multiple Faces

Research of Face Sketch Recognition

Face Recognition Based on Possibilistic Partition and Fuzzy Integral

Face Identification using Local Ternary Tree Pattern based Spatial Structural Components

Image-to-Set Face Recognition Using Locality Repulsion Projections and Sparse Reconstruction-Based Similarity Measure

Face Album: Towards Automatic Photo Management Based on Person Identity on Mobile Phones

A Single Gallery-Based Face Recognition Using Extended Joint Sparse Representation.

A high performance face recognition system based on a huge face database

An efficient data dimensionality reduction scheme based on SIFT for face recognition

DocFace: Matching ID Document Photos to Selfies

3D face reconstruction from mugshots: Application to arbitrary view face recognition

Face recognition using part-based dense sampling local features