Abstract:Background and Objective Accurate and repeatable detection of craniofacial landmarks is crucial for automated quantitative evaluation of head development anomalies. Since traditional imaging modalities are discouraged in pediatric patients, 3D photogrammetry has emerged as a popular and safe imaging alternative to evaluate craniofacial anomalies. However, traditional image analysis methods are not designed to operate on unstructured image data representations. Methods We present a fully automated pipeline to identify craniofacial landmarks in real time, and we use it to assess the head shape of patients with craniosynostosis using 3D photogrammetry. To detect craniofacial landmarks, we propose a novel geometric convolutional neural network based on Chebyshev polynomials that exploits the point connectivity information in 3D photogrammetry to quantify multi-resolution spatial features. We propose a landmark-specific trainable scheme that aggregates the multi-resolution geometric and texture features quantified at every vertex of a 3D photogram. Then, we embed a new probabilistic distance regressor module that leverages the integrated features at every point to predict landmark locations without assuming correspondences with specific vertices in the original 3D photogram. In addition, we use the detected landmarks to segment the calvaria from the 3D photograms of children with craniosynostosis, and we derive a new statistical index of head shape anomaly to quantify head shape improvements after surgical treatment. Results We achieved an average error of 2.74 ± 2.70 mm identifying Bookstein Type I craniofacial landmarks, which is a significant improvement compared to other state-of-the-art methods. Our experiments also demonstrated a higher robustness to spatial resolution variability in the 3D photograms. Finally, our head shape anomaly index quantified a significant reduction of our head shape anomaly index as a consequence of surgical treatment. Conclusion Our fully automated framework provides real-time craniofacial landmark detection from 3D photogrammetry with state-of-the-art accuracy. In addition, our new head shape anomaly index can quantify significant head phenotype changes and can be used to quantitatively evaluate surgical treatment in patients with craniosynostosis.

Computerized extraction of craniofacial anatomical structures for orthodontic analysis

[Oral Panorama Reconstruction Method Based on Pre-Segmentation and Bezier Function].

Automated 2-D cephalometric analysis on X-ray images by a model-based approach.

Locating large-scale craniofacial feature points on X-ray images for automated cephalometric analysis

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Modeling Of Craniofacial Soft And Hard Tissues For Prediction Of Orthodontic Treatment

3D human mandible reconstruction from CT data

Orthodontic Craniofacial Pattern Diagnosis: Cephalometric Geometry and Machine Learning.

A novel approach to craniofacial analysis using automated 3D landmarking of the skull

Automatic analysis method for cone beam CT image three-dimensional craniofacial structure

[Automated Recognition and Identification of Soft Tissue Landmarks in Cephalematric Analysis]

Automatic 3D modelling of craniofacial form

Automatic craniomaxillofacial landmarks detection in CT images of individuals with dentomaxillofacial deformities by a two-stage deep learning model

Geometric learning and statistical modeling for surgical outcomes evaluation in craniosynostosis using 3D photogrammetry.

Oral-3D: Reconstructing the 3D Bone Structure of Oral Cavity from 2D Panoramic X-ray

Automated 3D Landmarking of the Skull: A Novel Approach for Craniofacial Analysis

Automatic Landmark Annotation and Measurement of 3D Mandibular Morphology Using Non-Rigid Registration: A Preliminary Exploration and Accuracy Assessment

Development of a Computerized Automatic Identification System for Use in Cephalometry

Temporal Consistent 2D-3D Registration of Lateral Cephalograms and Cone-Beam Computed Tomography Images.

Anatomical Structure Sketcher for Cephalograms by Bimodal Deep Learning.

Machine Learning in Orthodontics: Introducing a 3d Auto-segmentation and Auto-landmark Finder of Cbct Images to Assess Maxillary Constriction in Unilateral Impacted Canine Patients