Abstract:Two to three thousand syndromes modify facial features: their screening requires the eye of an expert in dysmorphology. A widely used tool in shape characterization is geometric morphometrics based on landmarks, which are precise and reproducible anatomical points. Landmark positioning is user dependent and time consuming. Many automatic landmarking tools are currently available but do not work for children, because they have mainly been trained using photographic databases of healthy adults. Here, we developed a method for building an automatic landmarking pipeline for frontal and lateral facial photographs as well as photographs of external ears. We evaluated the algorithm on patients diagnosed with Treacher Collins (TC) syndrome as it is the most frequent mandibulofacial dysostosis in humans and is clinically recognizable although highly variable in severity. We extracted photographs from the photographic database of the maxillofacial surgery and plastic surgery department of Hôpital Necker-Enfants Malades in Paris, France with the diagnosis of TC syndrome. The control group was built from children admitted for craniofacial trauma or skin lesions. After testing two methods of object detection by bounding boxes, a Haar Cascade-based tool and a Faster Region-based Convolutional Neural Network (Faster R-CNN)-based tool, we evaluated three different automatic annotation algorithms: the patch-based active appearance model (AAM), the holistic AAM, and the constrained local model (CLM). The final error corresponding to the distance between the points placed by automatic annotation and those placed by manual annotation was reported. We included, respectively, 1664, 2044, and 1375 manually annotated frontal, profile, and ear photographs. Object recognition was optimized with the Faster R-CNN-based detector. The best annotation model was the patch-based AAM (p < 0.001 for frontal faces, p = 0.082 for profile faces and p < 0.001 for ears). This automatic annotation model resulted in the same classification performance as manually annotated data. Pretraining on public photographs did not improve the performance of the model. We defined a pipeline to create automatic annotation models adapted to faces with congenital anomalies, an essential prerequisite for research in dysmorphology.

An interactive atlas of three-dimensional syndromic facial morphology

Automated syndrome diagnosis by three-dimensional facial imaging

A 3D Clinical Face Phenotype Space of Genetic Syndromes using a Triplet-Based Singular Geometric Autoencoder

Analysis of 3D Facial Dysmorphology in Genetic Syndromes from Unconstrained 2D Photographs.

Toward 3D facial analysis for recognizing Mendelian causes of autism spectrum disorder

An automatic facial landmarking for children with rare diseases

Detecting Genetic Association of Common Human Facial Morphological Variation Using High Density 3D Image Registration.

AI-based diagnosis and phenotype – Genotype correlations in syndromic craniosynostoses

Facilitating the Molecular Diagnosis of Rare Genetic Disorders Through Facial Phenotypic Scores

Digital facial dysmorphology for genetic screening: Hierarchical constrained local model using ICA

Automated three-dimensional analysis of facial asymmetry in patients with syndromic coronal synostosis: A retrospective study

GestaltMatcher Database - A global reference for facial phenotypic variability in rare human diseases

Syndrome-informed phenotyping identifies a polygenic background for achondroplasia-like facial variation in the general population

Mapping genes for human face shape: exploration of univariate phenotyping strategies

Validation of 3 Computer-Aided Facial Phenotyping Tools (DeepGestalt, GestaltMatcher, and D-Score): Comparative Diagnostic Accuracy Study

Novel Genetic Loci Affecting Facial Shape Variation in Humans

Facial Asymmetry Assessment in Skeletal Class III Patients with Spatially-Dense Geometric Morphometrics

Convolutional mesh autoencoders for the 3-dimensional identification of FGFR-related craniosynostosis

Diseaseatlas: Multi-Facet Visual Analytics for Online Disease Articles

The 3D Facial Norms Database: Part 1. A Web-Based Craniofacial Anthropometric and Image Repository for the Clinical and Research Community

Automatic 3D modelling of craniofacial form