Analysis-by-synthesis Approach for Facial Modeling Based on Orthogonal Images

SU Cong-yong,ZHUANG Yue-ting,HUANG Li,WU Fei
DOI: https://doi.org/10.3785/j.issn.1008-973x.2005.02.002
2005-01-01
Abstract:Some residual ghosting or blurring artifacts may be visible in 3D facial model synthesized by the image-based facial modeling algorithms. This work proposed an analysis-by-synthesis approach for image-based personalized 3D facial modeling. Starting from two orthogonal face images of an individual, synthesis technique was employed to obtain its initial 3D facial model. A color histogram based technique was then used to measure the mis-registration error between the synthesized texture and the original orthogonal images' texture. Through using this error to guide the local and adaptive subdivision step, the 3D facial mesh model was refined to better preserve fine facial features. Experimental results show that the artifacts are reduced after the feedback and local adaptive subdivision steps; and that the output texture is more photo-realistic.
What problem does this paper attempt to address?