Abstract:A multi-to-one frontal view face synthesizing strategy, and how it could be utilized to improve traditional face recognition algorithms on pose variant problems, is introduced in this paper. The word multi-to-one means more than one input source images and one output synthetic image, and this is an information selection procedure. Through picking up the gray intensity most similar with that of frontal view face from multiple non-frontal input images, proposed algorithm tries to simulate real natural pose variance of human face. The similarity is evaluated according to the magnitude of non-rigid bending deformation involved during synthesizing, the underlying observation of which is, the more the bending deformation are utilized, the less natural the synthesized image looks like. The specific approach is realized based on Moving Least Squares (MLS). Besides synthesizing frontal faces, our Minimum Bending Synthesizing (MBS) strategy could also be utilized to unify the poses of both gallery and probe images, and hence effectively reduce the influence of variant pose to 2D face recognition. From experiments on the CMU PIE and FERET databases, it could be observed that the frontal view faces synthesized by MBS could effectively approximate the real ground truth frontal faces, and MBS could greatly improve the performance of classic face recognition algorithms, PCA and LDA, on pose variant problems. Apart from specific algorithms, the idea of synthesizing frontal face according to more than one input images, is much valuable as well.

Review of frontal face image synthesis methods

Recent Progress of Face Image Synthesis

A Review and Comparison Study on Face Sketch Synthesis

Sparse frontal face image synthesis from an arbitrary profile image

Review on methods of facial synthesis

Synthesis of Face Image with Pose Variations

Frontal Face Synthesizing According to Multiple Non-Frontal Inputs and Its Application in Face Recognition.

Multi‐view frontal face image generation: A survey

An experimental facial synthesis system using graph cut and gradient domain fusion

Automatic frontal view face image synthesis

Frontal Face Synthesis Based on Multiple Pose-Variant Images for Face Recognition.

Face Frontalization with Inpainting Method

A Comparative Study on Face Sketch Synthesis

Evaluation on Synthesized Face Sketches

Synthesizing For Face Recognition

Frontal View Synthesis Based on a Novel GAN with Global and Local Discriminators

Image synthesis: a review of methods, datasets, evaluation metrics, and future outlook

A novel frontal view synthesis method based on neighbor embedding

Multi-View Representation Based Face Sketch Synthesis

Face Photo–sketch Synthesis Via Intra-Domain Enhancement

Multi-View Face Image Synthesis Using Factorization Model