An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model

Ziqi Tu,Dongdong Weng,Dewen Cheng,Yihua Bao,Bin Liang,Le Luo
DOI: https://doi.org/10.1007/978-3-030-34110-7_19
2019-01-01
Abstract:In order to give a virtual human rich and realistic facial expression in the film production process, a good blendshape model is needed. But selecting and capturing base expressions for blendshape model requires a lot of manual work, time and effort, and the model also lacks expressiveness. A method for automatically selecting a set of base expressions from a sequence of facial motions is proposed in this paper. In this method, the Procrustes analysis is used to estimate the difference between face meshes and determine the composition of the base expressions. And the base expressions are used to build a local blendshape model which can enhance expressiveness. The results of reconstructing facial expressions by the local blendshape model are shown in this paper. By this method, the base expressions can be automatically selected from the expression sequence, reducing the manual operation.
What problem does this paper attempt to address?