Abstract:Background and Objective Accurate and repeatable detection of craniofacial landmarks is crucial for automated quantitative evaluation of head development anomalies. Since traditional imaging modalities are discouraged in pediatric patients, 3D photogrammetry has emerged as a popular and safe imaging alternative to evaluate craniofacial anomalies. However, traditional image analysis methods are not designed to operate on unstructured image data representations. Methods We present a fully automated pipeline to identify craniofacial landmarks in real time, and we use it to assess the head shape of patients with craniosynostosis using 3D photogrammetry. To detect craniofacial landmarks, we propose a novel geometric convolutional neural network based on Chebyshev polynomials that exploits the point connectivity information in 3D photogrammetry to quantify multi-resolution spatial features. We propose a landmark-specific trainable scheme that aggregates the multi-resolution geometric and texture features quantified at every vertex of a 3D photogram. Then, we embed a new probabilistic distance regressor module that leverages the integrated features at every point to predict landmark locations without assuming correspondences with specific vertices in the original 3D photogram. In addition, we use the detected landmarks to segment the calvaria from the 3D photograms of children with craniosynostosis, and we derive a new statistical index of head shape anomaly to quantify head shape improvements after surgical treatment. Results We achieved an average error of 2.74 ± 2.70 mm identifying Bookstein Type I craniofacial landmarks, which is a significant improvement compared to other state-of-the-art methods. Our experiments also demonstrated a higher robustness to spatial resolution variability in the 3D photograms. Finally, our head shape anomaly index quantified a significant reduction of our head shape anomaly index as a consequence of surgical treatment. Conclusion Our fully automated framework provides real-time craniofacial landmark detection from 3D photogrammetry with state-of-the-art accuracy. In addition, our new head shape anomaly index can quantify significant head phenotype changes and can be used to quantitatively evaluate surgical treatment in patients with craniosynostosis.

Digital facial dysmorphology for genetic screening: Hierarchical constrained local model using ICA

Hierarchical constrained local model using ICA and its application to Down syndrome detection.

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Constrained Local Model with Independent Component Analysis and Kernel Density Estimation: Application to Down Syndrome Detection

Identification of Dysmorphic Syndromes Using Landmark-Specific Local Texture Descriptors

Analysis of 3D Facial Dysmorphology in Genetic Syndromes from Unconstrained 2D Photographs.

Convolutional mesh autoencoders for the 3-dimensional identification of FGFR-related craniosynostosis

Diagnosis and Screening of Velocardiofacial Syndrome by Evaluating Facial Photographs Using a Deep Learning-Based Algorithm

Automated Down Syndrome Detection Using Facial Photographs

Detecting Genetic Association of Common Human Facial Morphological Variation Using High Density 3D Image Registration.

Geometric learning and statistical modeling for surgical outcomes evaluation in craniosynostosis using 3D photogrammetry.

Down syndrome detection from facial photographs using machine learning techniques

An automatic facial landmarking for children with rare diseases

Quantitative Evaluation of Local Head Malformations from 3 Dimensional Photography: Application to Craniosynostosis.

Statistical and Individual Characteristics-Based Reconstruction for Craniomaxillofacial Surgery

Ensemble Learning for the Detection of Facial Dysmorphology

A Bayesian hierarchical model for classifying craniofacial malformations from CT imaging

A PCA-Based Method for Determining Craniofacial Relationship and Sexual Dimorphism of Facial Shapes.

Describing Crouzon and Pfeiffer syndrome based on principal component analysis

Orthodontic Craniofacial Pattern Diagnosis: Cephalometric Geometry and Machine Learning.

A computerized craniofacial reconstruction method for an unidentified skull based on statistical shape models