Abstract:Background and Objective Accurate and repeatable detection of craniofacial landmarks is crucial for automated quantitative evaluation of head development anomalies. Since traditional imaging modalities are discouraged in pediatric patients, 3D photogrammetry has emerged as a popular and safe imaging alternative to evaluate craniofacial anomalies. However, traditional image analysis methods are not designed to operate on unstructured image data representations. Methods We present a fully automated pipeline to identify craniofacial landmarks in real time, and we use it to assess the head shape of patients with craniosynostosis using 3D photogrammetry. To detect craniofacial landmarks, we propose a novel geometric convolutional neural network based on Chebyshev polynomials that exploits the point connectivity information in 3D photogrammetry to quantify multi-resolution spatial features. We propose a landmark-specific trainable scheme that aggregates the multi-resolution geometric and texture features quantified at every vertex of a 3D photogram. Then, we embed a new probabilistic distance regressor module that leverages the integrated features at every point to predict landmark locations without assuming correspondences with specific vertices in the original 3D photogram. In addition, we use the detected landmarks to segment the calvaria from the 3D photograms of children with craniosynostosis, and we derive a new statistical index of head shape anomaly to quantify head shape improvements after surgical treatment. Results We achieved an average error of 2.74 ± 2.70 mm identifying Bookstein Type I craniofacial landmarks, which is a significant improvement compared to other state-of-the-art methods. Our experiments also demonstrated a higher robustness to spatial resolution variability in the 3D photograms. Finally, our head shape anomaly index quantified a significant reduction of our head shape anomaly index as a consequence of surgical treatment. Conclusion Our fully automated framework provides real-time craniofacial landmark detection from 3D photogrammetry with state-of-the-art accuracy. In addition, our new head shape anomaly index can quantify significant head phenotype changes and can be used to quantitatively evaluate surgical treatment in patients with craniosynostosis.

Atypical Facial Landmark Localisation with Stacked Hourglass Networks: A Study on 3D Facial Modelling for Medical Diagnosis

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model.

3-D Facial Landmarks Detection for Intelligent Video Systems

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Automated 3D Perioral Landmark Detection Using High-Resolution Network: Artificial Intelligence-Based Anthropometric Analysis

3D facial landmark localization via a local surface descriptor HoSNI

Geometric learning and statistical modeling for surgical outcomes evaluation in craniosynostosis using 3D photogrammetry.

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

Stack of Heatmap Hourglass Network for Face Alignment

A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks

Automatic landmark annotation and dense correspondence registration for 3D human facial images

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Toward an Automatic System for Computer-Aided Assessment in Facial Palsy

Fully automated landmarking and facial segmentation on 3D photographs

Automatic 3D modelling of craniofacial form

Extra Facial Landmark Localization Via Global Shape Reconstruction.

Limitations and Biases in Facial Landmark Detection -- An Empirical Study on Older Adults with Dementia

3D-Aware Facial Landmark Detection Via Multi-View Consistent Training on Synthetic Data