Automated 3D Perioral Landmark Detection Using High-Resolution Network: Artificial Intelligence-Based Anthropometric Analysis

Yuyan Yang,Mengyuan Zhang,Yicheng An,Qi Huang,Yongwang Shi,Lin Jin,Ang Zeng,Xiao Long,Nanze Yu,Xiaojun Wang
DOI: https://doi.org/10.1093/asj/sjae103
2024-04-25
Aesthetic Surgery Journal
Abstract:Abstract Background 3D facial stereophotogrammetry, as a convenient, non-invasive and highly reliable evaluation tool, has shown great potential in pre-operative planning and treatment efficacy evaluation of plastic surgery in recent years. However, it requires manual identification of facial landmarks by trained evaluators to obtain anthropometric data, which consumes large amount of time and effort. Automatic 3D facial landmark localization may facilitate fast data acquisition and eliminate evaluator error. Objectives In this paper, we propose a novel deep-learning method based on dimension-transformation and key-point detection for automated 3D perioral landmark annotation. Methods The 3D facial model is transformed into 2D images on which High-Resolution Network is implemented for key point detection. The 2D coordinates of key points are then mapped back to the 3D model using mathematical methods to obtain the 3D landmark coordinates. This program was trained with 120 facial models and validated in 50 facial models. Results Our approach achieved satisfactory accuracy of 1.30 ± 0.68 mm error in landmark detection with an average processing time of 5.2 ± 0.21 seconds per model. And subsequent analysis based on these landmarks showed an error of 0.87 ± 1.02 mm for linear measurements and 5.62 ± 6.61° for angular measurements. Conclusions This automated 3D perioral landmarking method could serve as an effective tool that enables fast and accurate anthropometric analysis of lip morphology for plastic surgery and aesthetic procedures.
surgery
What problem does this paper attempt to address?