Abstract:Existing 3D face reconstruction methods can recover geometric faces in the general case. However, they ignore the impact of expression variation on shape capturing. To the best of our knowledge, this is the first work that refines the shape from the coupled relationship of expression and shape. We design a Shape Attention Module to extract the shape information in the high-dimension space, which is then remapped back to a lower-dimension space. In addition, we propose Confidence Landmarks Loss based on the fact that different face landmarks have different confidence levels. Lastly, we design an auxiliary network to regress the confidence values of 68 landmarks. We qualitatively and quantitatively test our method on NoW and AFLW2000-3D datasets. Extensive experimental results demonstrate that our method achieves better performance than prior arts.

Shape Attention Module for Regularizing 3D Face Reconstruction