A Compositional and Dynamic Model for Face Aging

SuoJinli,ZhuSong-Chun,ShanShiguang,ChenXilin

IF: 23.6

2010-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:In this paper, we present a compositional and dynamic model for face aging. The compositional model represents faces in each age group by a hierarchical And-Or graph, in which And nodes decompose a...

What problem does this paper attempt to address?

A Compositional and Dynamic Model for Face Aging

Jinli Suo,Song-Chun Zhu,Shiguang Shan,Xilin Chen

DOI: https://doi.org/10.1109/tpami.2009.39

IF: 23.6

2010-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:In this paper, we present a compositional and dynamic model for face aging. The compositional model represents faces in each age group by a hierarchical And-or graph, in which And nodes decompose a face into parts to describe details (e.g., hair, wrinkles, etc.) crucial for age perception and Or nodes represent large diversity of faces by alternative selections. Then a face instance is a transverse of the And-or graph-parse graph. Face aging is modeled as a Markov process on the parse graph representation. We learn the parameters of the dynamic model from a large annotated face data set and the stochasticity of face aging is modeled in the dynamics explicitly. Based on this model, we propose a face aging simulation and prediction algorithm. Inversely, an automatic age estimation algorithm is also developed under this representation. We study two criteria to evaluate the aging results using human perception experiments: (1) the accuracy of simulation: whether the aged faces are perceived of the intended age group, and (2) preservation of identity: whether the aged faces are perceived as the same person. Quantitative statistical analysis validates the performance of our aging model and age estimation algorithm.
A Multi-Resolution Dynamic Model for Face Aging Simulation

Jin-li Suo,Feng Min,Song Chun Zhu,Shiguang Shan,Xilin Chen

DOI: https://doi.org/10.1109/CVPR.2007.383055

2007-01-01

Abstract:In this paper we present a dynamic model for simulating face aging process. We adopt a high resolution grammatical face model [1] and augment it with age and hair features. This model represents all face images by a multi-layer and-or graph and integrates three most prominent aspects related to aging changes: global appearance changes in hair style and shape, deformations and aging effects of facial components, and wrinkles appearance at various facial zones. Then face aging is modeled as a dynamic Markov process on this graph representation which is learned from a large dataset. Given an input image, we firstly compute the graph representation, and then sample the graph structures over various age groups according to the learned dynamic model. Finally we generate new face images with the sampled graphs. Our approach has three novel aspects: (1) the aging model is learned from a dataset of 50,000 adult faces at different ages; (2) we explicitly model the uncertainty in face aging andean sample multiple plausible aged faces for an input image; and (3) we conduct a simple human experiment to validate the simulated aging process.
An And-Or Graph Model for Face Representation, Sketching and Aging

Feng Min,Jinli Suo,Song-Chun Zhu

2007-01-01

Abstract:For face modeling, an And-Or graph model was first proposed in [9] as a compositional representation for high resolution face images. In an And-Or graph, the And nodes represent coarse-to-fine decompositions and the Or-nodes represent alternative components for diversity. The And-Or graph face model, as Fig.1 illustrates, has three levels: the first level describes the general appearance of global face and hair; the second level refines the representation of the facial components (eyes, eye brows, nose, mouth) by modeling the variations of their shapes and subtle appearance; and the third level provides further details of the face components and divides the face skin into 9 zones where the wrinkles and speckles are represented. The And-Or graph provides a expressive model for face diversity and details, and thus is found to be especially efficient for applications in face sketching generation and face aging simulation.
A Concatenational Graph Evolution Aging Model

Jinli Suo,Xilin Chen,Shiguang Shan,Wen Gao,Qionghai Dai

DOI: https://doi.org/10.1109/tpami.2012.22

IF: 23.6

2012-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Modeling the long-term face aging process is of great importance for face recognition and animation, but there is a lack of sufficient long-term face aging sequences for model learning. To address this problem, we propose a CONcatenational GRaph Evolution (CONGRE) aging model, which adopts decomposition strategy in both spatial and temporal aspects to learn long-term aging patterns from partially dense aging databases. In spatial aspect, we build a graphical face representation, in which a human face is decomposed into mutually interrelated subregions under anatomical guidance. In temporal aspect, the long-term evolution of the above graphical representation is then modeled by connecting sequential short-term patterns following the Markov property of aging process under smoothness constraints between neighboring short-term patterns and consistency constraints among subregions. The proposed model also considers the diversity of face aging by proposing probabilistic concatenation strategy between short-term patterns and applying scholastic sampling in aging prediction. In experiments, the aging prediction results generated by the learned aging models are evaluated both subjectively and objectively to validate the proposed model.
A hierarchical compositional model for face representation and sketching.

Zijian Xu,Hong Chen,Song-Chun Zhu,Jiebo Luo

DOI: https://doi.org/10.1109/TPAMI.2008.50

IF: 23.6

2008-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:We present a hierarchical-compositional face model as a three-layer And-Or graph to account for the structural variabilities over multiple resolutions. In the And-Or graph, an And-node represents a decomposition of certain graphical structure expanding to a set of Or-nodes with associated relations; an Or-node functions as a switch variable pointing to alternative And-nodes. Faces are represented hierarchically: layer one treats each face as a whole; layer two refines the local facial parts jointly as a set of individual templates; layer three divides face into 15 zones and models facial features like eyecorners or wrinkles. Transitions between layers are realized by measuring the minimum-description-length given the face image complexity. Diverse face representations are formed by drawing from hierarchical dictionaries of faces, parts and skin features. A sketch captures the most informative part of a face in a concise and potentially robust representation. However, generating good facial sketches is challenging because of the rich facial details and large structural variations, especially in the high-resolution images. The representing power of our generative model is demonstrated by reconstructing high-resolution face images and generating cartoon sketches. Our model is useful for applications such as face recognition, non-photo-realistic rendering, super-resolution, and low-bit rate face coding.
Learning long term face aging patterns from partially dense aging databases

Jin-Li Suo,Xilin Chen,Shiguang Shan,Wen Gao

DOI: https://doi.org/10.1109/ICCV.2009.5459181

2009-01-01

Abstract:Studies on face aging are handicapped by lack of long term dense aging sequences for model training. To handle this problem, we propose a new face aging model, which learns long term face aging patterns from partially dense aging databases. The learning strategy is based on two assumptions: (i) short term face aging pattern is relatively simple and is possible to be learned from currently available databases; (ii) long term face aging is a continuous and smooth Markov process. Adopting a compositional face representation, our aging algorithm learns a function-based short term aging model from real aging sequences to infer facial parameters within a short age span. Based on the predefined smoothness criteria between two overlapping short term aging patterns, we concatenate these learned short term aging patterns to build the long term aging patterns. Both the subjective assessment and objective evaluations of synthetic aging sequences validate the effectiveness of the proposed model.
Simulation of Aging Effects in Face Images

Junyan Wang,Yan Shang,Guangda Su,Xinggang Lin

DOI: https://doi.org/10.1007/978-3-540-37258-5_53

2006-01-01

Abstract:In this paper a method of simulating aging effects automatically in face images is proposed. The first step of the method is to represent a facial image by a pair of shape and texture vectors which are extracted by projecting its shape and texture in the eigenspaces of shape or texture separately. The second is estimating the age of face image by Intelligence Increasing Neural Network. After this, the synthesized shape and texture vectors at target age are generated by using typical vector creating function, estimated age and the feature vector of the original test image. At last the synthesized shape and texture vectors at target age are reconstructed in eigenspaces to get the shape and texture at target age which are combined to synthesize facial image at target age. Experiments show that the proposed method can effectively "change" the age of face images.
Longitudinal Face Modeling via Temporal Deep Restricted Boltzmann Machines

Chi Nhan Duong,Khoa Luu,Kha Gia Quach,Tien D. Bui

DOI: https://doi.org/10.48550/arXiv.1606.02254

2016-06-07

Computer Vision and Pattern Recognition

Abstract:Modeling the face aging process is a challenging task due to large and non-linear variations present in different stages of face development. This paper presents a deep model approach for face age progression that can efficiently capture the non-linear aging process and automatically synthesize a series of age-progressed faces in various age ranges. In this approach, we first decompose the long-term age progress into a sequence of short-term changes and model it as a face sequence. The Temporal Deep Restricted Boltzmann Machines based age progression model together with the prototype faces are then constructed to learn the aging transformation between faces in the sequence. In addition, to enhance the wrinkles of faces in the later age ranges, the wrinkle models are further constructed using Restricted Boltzmann Machines to capture their variations in different facial regions. The geometry constraints are also taken into account in the last step for more consistent age-progressed results. The proposed approach is evaluated using various face aging databases, i.e. FG-NET, Cross-Age Celebrity Dataset (CACD) and MORPH, and our collected large-scale aging database named AginG Faces in the Wild (AGFW). In addition, when ground-truth age is not available for input image, our proposed system is able to automatically estimate the age of the input face before aging process is employed.
Face Aging by Sparse Representation

Heng Huang,Yuxu Lin,Mingli Song,Jiajun Bu,Chun Chen

DOI: https://doi.org/10.1007/978-3-642-15696-0_53

2010-01-01

Abstract:Face aging aims at synthesizing one's face at different ages which interests many researchers in Fields of cartoon animation, age estimation, face recognition, etc. However, modelling aging process is still challenging clue to lack of robust features and a reasonable training set. In this paper we propose a novel automatic face aging approach through Maximum A Posteriori (MAP), a face is firstly warped by global geometric transformation, and then elder skin is locally synthesized by sparse coding. Our contribution includes an aging model both for children growth and adults aging, and high-level features by sparse representation aiming at a small training set while not downgrading the quality of synthesis. Moreover, the newly proposed features simplify the algorithm and lead to a fast implementation. Experiments show the proposed approach outperforms the existing methods.
Estimating Aging Pattern by Aging Increment Distribution for Re-rendering of Facial Age Effects

Jianyi Liu,Nanning Zheng,Bo Chen,Jishang Wei

DOI: https://doi.org/10.1007/978-3-540-74171-8_78

2007-01-01

Abstract:Simulating facial aging effects is a challenge task because of the difficulties in understanding and modeling the aging pattern. In this paper, a novel aging model called Aging Increment Distribution Function was proposed to model the age progression in the statistical appearance model space. The trajectory of face samples is learned to build the distribution function with free shape. So it has finer resolution to reveal the underlying aging pattern. Based on modeling the increment of appearance parameter, an analytical framework was formulated to re-render the given face image onto any other age within the maximum age span of training samples. In experiment, the MORPH face database was used to train the aging model, which has been further applied to re-rendering of age effects. Both aging and rejuvenating simulation results presented similar effects comparing to the real images, which verified the effectiveness of proposed method.
Design sparse features for age estimation using hierarchical face model

Jin-li Suo,Tianfu Wu,Song Chun Zhu,Shiguang Shan,Xilin Chen,Wen Gao

DOI: https://doi.org/10.1109/AFGR.2008.4813314

2008-01-01

Abstract:A key point in automatic age estimation is to design feature set essential to age perception. To achieve this goal, this paper builds up a hierarchical graphical face model for faces appearing at low, middle and high resolution respectively. Along the hierarchy, a face image is decomposed into detailed parts from coarse to fine. Then four types of features are extracted from this graph representation guided by the priors of aging process embedded in the graphical model: topology, geometry, photometry and configuration. On age estimation, this paper follows the popular regression formulation for mapping feature vectors to its age label. The effectiveness of the presented feature set is justified by testing results on two datasets using different kinds of regression methods. The experimental results in this paper show that designing feature set for age estimation under the guidance of hierarchical face model is a promising method and a flexible framework as well.
Facial Expression Transformation, Aging and Invisible View Reconstruction (1)

ZHENG Nan-ning,FU Yun,ZHANG Ting,ZHUO Feng

DOI: https://doi.org/10.3321/j.issn:0372-2112.2003.z1.004

2003-01-01

Abstract:Facial expression synthesis,facial aging and the reconstruction of the invisible facial views are important research contents in the computer vision and computer graphics fields.This paper addresses the statistical model-based techniques of facial image transformation and processing.With the pixel-wise correspondence computing,the facial image is represented as coupled shape-texture vectors.Based on the quotient image of Lambertian surface classes,an algorithm for realistic expression synthesis and clone is first proposed.Then,the new technique for face juvenility transformation from average face,according to the related hypotheses for face attractiveness in Psychology,is presented.Finally,an ageing transformation algorithm is proposed from merging the age template mapping and the distinctiveness caricaturing methods.With the examples of MPI Caucasian Face and AIAR Asian Face databases,realistic and natural experimental results validate the approaches for the facial expression synthesis and facial age transformation.
Personalized Age Progression with Aging Dictionary

Xiangbo Shu,Jinhui Tang,Hanjiang Lai,Luoqi Liu,Shuicheng Yan

DOI: https://doi.org/10.1109/iccv.2015.452

2015-12-01

Abstract:In this paper, we aim to automatically render aging faces in a personalized way. Basically, a set of age-group specific dictionaries are learned, where the dictionary bases corresponding to the same index yet from different dictionaries form a particular aging process pattern cross different age groups, and a linear combination of these patterns expresses a particular personalized aging process. Moreover, two factors are taken into consideration in the dictionary learning process. First, beyond the aging dictionaries, each subject may have extra personalized facial characteristics, e.g. mole, which are invariant in the aging process. Second, it is challenging or even impossible to collect faces of all age groups for a particular subject, yet much easier and more practical to get face pairs from neighboring age groups. Thus a personality-aware coupled reconstruction loss is utilized to learn the dictionaries based on face pairs from neighboring age groups. Extensive experiments well demonstrate the advantages of our proposed solution over other state-of-the-arts in term of personalized aging progression, as well as the performance gain for cross-age face verification by synthesizing aging faces.
Age Synthesis and Estimation via Faces: A Survey

Yun Fu,Guodong Guo,Thomas S. Huang,T S Huang

DOI: https://doi.org/10.1109/tpami.2010.36

IF: 23.6

2010-11-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Human age, as an important personal trait, can be directly inferred by distinct patterns emerging from the facial appearance. Derived from rapid advances in computer graphics and machine vision, computer-based age synthesis and estimation via faces have become particularly prevalent topics recently because of their explosively emerging real-world applications, such as forensic art, electronic customer relationship management, security control and surveillance monitoring, biometrics, entertainment, and cosmetology. Age synthesis is defined to rerender a face image aesthetically with natural aging and rejuvenating effects on the individual face. Age estimation is defined to label a face image automatically with the exact age (year) or the age group (year range) of the individual face. Because of their particularity and complexity, both problems are attractive yet challenging to computer-based application system designers. Large efforts from both academia and industry have been devoted in the last a few decades. In this paper, we survey the complete state-of-the-art techniques in the face image-based age synthesis and estimation topics. Existing models, popular algorithms, system performances, technical difficulties, popular face aging databases, evaluation protocols, and promising future directions are also provided with systematic discussions.

computer science, artificial intelligence,engineering, electrical & electronic
Semi-supervised Face Aging and Rejuvenating

Wanyue Ma,Yuan Zhou,Jun He

DOI: https://doi.org/10.1117/1.jei.30.2.023003

IF: 0.829

2021-01-01

Journal of Electronic Imaging

Abstract:Face aging and rejuvenating aim to generate an individual face with aging and rejuvenating effect while retaining identity information. We can analyze a given face image to estimate a past look or predict a future look of the person. The research on face aging and rejuvenating has important application value in the fields of cross-age recognition,1 public security, and entertainment, for example, changing the appearance of actors at different ages in a movie or finding missing persons in forensic applications. Although this area has attracted much attention of the researchers, there are still many challenges, especially in lack of accurate and sufficient dataset, low aging effect, and bad identity preservation. Previous face aging and rejuvenating methods are split into two main categories: physical model-based methods2,3 and prototype-based methods.4-6 The physical model-based methods describe the alteration in muscle, wrinkle, skin, etc., which can get a good result but suffer from complex modeling. The prototype-based methods try to learn the transformation between different age groups. Due to the development of generative adversarial network (GAN),7 state-of-theart methods8-10 that use the technology of deep learning show impressive success in this field. Face aging and rejuvenating work effectively in public security criminal investigation, cross-age recognition, and entertainment. However, three main problems still exist: the lack of accurate and sufficient dataset, low aging effect, and poor preservation of personal information. We propose a semi-supervised face aging and rejuvenating method for face aging and rejuvenating. In particular, a conditional encoder is utilized to map an input face into a latent vector, which is used by the generator network with age conditions to produce a new face. The latent vector preserves identity information, whereas the age label controls face aging or rejuvenating. To make generated features closer to prior features, the discriminator network is designed to assist the generator network. In addition, a cycle optimized method is utilized to preserve the personal information of the generated face. Experimental results demonstrate that our network can generate more realistic faces, both in personal identity and age consistency. (c) 2021 SPIE and IS&T [DOI: 10.1117/1.JEI.30.2.023003]
Age Progression and Regression with Spatial Attention Modules

Qi Li,Yunfan Liu,Zhenan Sun

DOI: https://doi.org/10.48550/arXiv.1903.02133

2019-10-07

Abstract:Age progression and regression refers to aesthetically render-ing a given face image to present effects of face aging and rejuvenation, respectively. Although numerous studies have been conducted in this topic, there are two major problems: 1) multiple models are usually trained to simulate different age mappings, and 2) the photo-realism of generated face images is heavily influenced by the variation of training images in terms of pose, illumination, and background. To address these issues, in this paper, we propose a framework based on conditional Generative Adversarial Networks (cGANs) to achieve age progression and regression simultaneously. Particularly, since face aging and rejuvenation are largely different in terms of image translation patterns, we model these two processes using two separate generators, each dedicated to one age changing process. In addition, we exploit spatial attention mechanisms to limit image modifications to regions closely related to age changes, so that images with high visual fidelity could be synthesized for in-the-wild cases. Experiments on multiple datasets demonstrate the ability of our model in synthesizing lifelike face images at desired ages with personalized features well preserved, and keeping age-irrelevant regions unchanged.

Computer Vision and Pattern Recognition
Face Age Progression With Attribute Manipulation

Sinzith Tatikonda,Athira Nambiar,Anurag Mittal

DOI: https://doi.org/10.48550/arXiv.2106.07696

2021-06-15

Abstract:Face is one of the predominant means of person recognition. In the process of ageing, human face is prone to many factors such as time, attributes, weather and other subject specific variations. The impact of these factors were not well studied in the literature of face aging. In this paper, we propose a novel holistic model in this regard viz., ``Face Age progression With Attribute Manipulation (FAWAM)", i.e. generating face images at different ages while simultaneously varying attributes and other subject specific characteristics. We address the task in a bottom-up manner, as two submodules i.e. face age progression and face attribute manipulation. For face aging, we use an attribute-conscious face aging model with a pyramidal generative adversarial network that can model age-specific facial changes while maintaining intrinsic subject specific characteristics. For facial attribute manipulation, the age processed facial image is manipulated with desired attributes while preserving other details unchanged, leveraging an attribute generative adversarial network architecture. We conduct extensive analysis in standard large scale datasets and our model achieves significant performance both quantitatively and qualitatively.

Computer Vision and Pattern Recognition,Artificial Intelligence
Piecewise linear aging function for facial age estimation

Shenglan Ben,Jiansheng Chen,Guangda Su

DOI: https://doi.org/10.1109/ICIP.2009.5414142

2009-01-01

ICIP

Abstract:Instead of constructing a complex aging model on the whole age space, a piecewise linear aging function is proposed to approximate the ground truth aging function locally. To handle the `regression toward the mean' problem of local aging function regression, a weighting strategy is used to assign larger weights to the samples near typical aging appearance of each age. In age estimation step, a global aging function is used to predict the test sample's rough age range and the local linear aging function on that range is then used to give a final result. Experimental results show that our method can get more accuracy results in facial age estimation.
A hierarchical approach to facial aging

Amrutha Sethuram,Karl Ricanek,Eric Patterson

DOI: https://doi.org/10.1109/cvprw.2010.5543611

2010-06-01

Abstract:Active Appearance Models (AAMs) have been used as a promising tool in the field of synthetic age progression. However, they are yet to be demonstrated on a large human population with wide variation. This paper presents a novel AAM-based hierarchical approach to facial aging. This work is motivated from studies in medical and anthropological literature on classification of human faces based on gender, ethnic and age groups. The proposed hierarchical model approach is a ethnicity and gender specific aging paradigm. Specifically, the Caucasian (European descent) and African American ethnic groups are considered. This work will further show that using individual hierarchical models generate better age-progressed synthetic images when compared to a general model approach. The results are evaluated by visual perception of the intended age group and preservation of identity. Also, a quantitative evaluation was performed using FaceVACS, a commercial face recognition system, as a surrogate measure. Higher match scores for synthetic images generated by hierarchical models when compared to those generated by a general model suggests the efficiency of the proposed hierarchical model approach.
Facial beautification method based on age evolution

Yan CHEN,Shou-hong DING,Gan-le HU,Li-zhuang MA

DOI: https://doi.org/10.19583/j.1003-4951.2013.04.002

2013-01-01

Abstract:This paper proposes a new facial beautification method using facial rejuvenation based on the age evolution. Traditional facial beautification methods only focus on the color of skin and deformation and do the transformation based on an experimental standard of beauty. Our method achieves the beauty effect by making facial image looks younger, which is different from traditional methods and is more reasonable than them. Firstly, we decompose the image into different layers and get a detail layer. Secondly, we get an age-related parameter: the standard deviation of the Gaussian distribution that the detail layer follows, and the support vector machine (SVM) regression is used to fit a function about the age and the standard deviation. Thirdly, we use this function to estimate the age of input image and generate a new detail layer with a new standard deviation which is calculated by decreasing the age. Lastly, we combine the original layers and the new detail layer to get a new face image. Experimental results show that this algorithm can make facial image become more beautiful by facial rejuvenation. The proposed method opens up a new way about facial beautification, and there are great potentials for applications.

A Compositional and Dynamic Model for Face Aging

A Compositional and Dynamic Model for Face Aging

A Multi-Resolution Dynamic Model for Face Aging Simulation

An And-Or Graph Model for Face Representation, Sketching and Aging

A Concatenational Graph Evolution Aging Model

A hierarchical compositional model for face representation and sketching.

Learning long term face aging patterns from partially dense aging databases

Simulation of Aging Effects in Face Images

Longitudinal Face Modeling via Temporal Deep Restricted Boltzmann Machines

Face Aging by Sparse Representation

Estimating Aging Pattern by Aging Increment Distribution for Re-rendering of Facial Age Effects

Design sparse features for age estimation using hierarchical face model

Facial Expression Transformation, Aging and Invisible View Reconstruction (1)

Personalized Age Progression with Aging Dictionary

Age Synthesis and Estimation via Faces: A Survey

Semi-supervised Face Aging and Rejuvenating

Age Progression and Regression with Spatial Attention Modules

Face Age Progression With Attribute Manipulation

Piecewise linear aging function for facial age estimation

A hierarchical approach to facial aging

Facial beautification method based on age evolution