Abstract:Background The existing face matching method requires a point cloud to be drawn on the real face for registration, which results in low registration accuracy due to the irregular deformation of the patient's skin that makes the point cloud have many outlier points. Methods This work proposes a non-contact pose estimation method based on similarity aspect graph hierarchical optimization. The proposed method constructs a distance-weighted and triangular-constrained similarity measure to describe the similarity between views by automatically identifying the 2D and 3D feature points of the face. A mutual similarity clustering method is proposed to construct a hierarchical aspect graph with 3D pose as nodes. A Monte Carlo tree search strategy is used to search the hierarchical aspect graph for determining the optimal pose of the facial 3D model, so as to realize the accurate registration of the facial 3D model and the real face. Results The proposed method was used to conduct accuracy verification experiments on the phantoms and volunteers, which were compared with four advanced pose calibration methods. The proposed method obtained average fusion errors of 1.13 ± 0.20 mm and 0.92 ± 0.08 mm in head phantom and volunteer experiments, respectively, which exhibits the best fusion performance among all comparison methods. Conclusions Our experiments proved the effectiveness of the proposed pose estimation method in facial augmented reality.

Face alignment based on high order markov random field

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Cascade of Forests for Face Alignment

Accurate Face Alignment Using Shape Constrained Markov Network

Unsupervised Face Alignment by Robust Nonrigid Mapping

Collaborative 3D face alignment and head pose estimation with frontal face constraint based on RGB and sparse depth

Pose-Invariant 3D Face Alignment

3D Face Alignment Through Fusion of Head Pose Information and Features

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Multiscale recurrent regression networks for face alignment

Face Alignment Across Large Poses: A 3D Solution

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Facial Augmented Reality based on Hierarchical Optimization of Similarity Aspect Graph

Robust Face Recognition by Constrained Part-based Alignment.

An integrated model for accurate shape alignment

Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network

Multi-view face alignment guided by several facial feature points

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

Multi-view face alignment using 3D shape model for view estimation

Face alignment under various poses and expressions