Facial Augmented Reality based on Hierarchical Optimization of Similarity Aspect Graph
Long Shao,Tianyu Fu,Yucong Lin,Deqiang Xiao,Danni Ai,Tao Zhang,Jingfan Fan,Hong Song,Jian Yang
DOI: https://doi.org/10.1016/j.cmpb.2024.108108
IF: 6.1
2024-03-09
Computer Methods and Programs in Biomedicine
Abstract:Background The existing face matching method requires a point cloud to be drawn on the real face for registration, which results in low registration accuracy due to the irregular deformation of the patient's skin that makes the point cloud have many outlier points. Methods This work proposes a non-contact pose estimation method based on similarity aspect graph hierarchical optimization. The proposed method constructs a distance-weighted and triangular-constrained similarity measure to describe the similarity between views by automatically identifying the 2D and 3D feature points of the face. A mutual similarity clustering method is proposed to construct a hierarchical aspect graph with 3D pose as nodes. A Monte Carlo tree search strategy is used to search the hierarchical aspect graph for determining the optimal pose of the facial 3D model, so as to realize the accurate registration of the facial 3D model and the real face. Results The proposed method was used to conduct accuracy verification experiments on the phantoms and volunteers, which were compared with four advanced pose calibration methods. The proposed method obtained average fusion errors of 1.13 ± 0.20 mm and 0.92 ± 0.08 mm in head phantom and volunteer experiments, respectively, which exhibits the best fusion performance among all comparison methods. Conclusions Our experiments proved the effectiveness of the proposed pose estimation method in facial augmented reality.
engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods