Abstract:Background While characteristic facial features provide important clues for finding the correct diagnosis in genetic syndromes, valid assessment can be challenging. The next-generation phenotyping algorithm DeepGestalt analyzes patient images and provides syndrome suggestions. GestaltMatcher matches patient images with similar facial features. The new D-Score provides a score for the degree of facial dysmorphism. Objective We aimed to test state-of-the-art facial phenotyping tools by benchmarking GestaltMatcher and D-Score and comparing them to DeepGestalt. Methods Using a retrospective sample of 4796 images of patients with 486 different genetic syndromes (London Medical Database, GestaltMatcher Database, and literature images) and 323 inconspicuous control images, we determined the clinical use of D-Score, GestaltMatcher, and DeepGestalt, evaluating sensitivity; specificity; accuracy; the number of supported diagnoses; and potential biases such as age, sex, and ethnicity. Results DeepGestalt suggested 340 distinct syndromes and GestaltMatcher suggested 1128 syndromes. The top-30 sensitivity was higher for DeepGestalt (88%, SD 18%) than for GestaltMatcher (76%, SD 26%). DeepGestalt generally assigned lower scores but provided higher scores for patient images than for inconspicuous control images, thus allowing the 2 cohorts to be separated with an area under the receiver operating characteristic curve (AUROC) of 0.73. GestaltMatcher could not separate the 2 classes (AUROC 0.55). Trained for this purpose, D-Score achieved the highest discriminatory power (AUROC 0.86). D-Score’s levels increased with the age of the depicted individuals. Male individuals yielded higher D-scores than female individuals. Ethnicity did not appear to influence D-scores. Conclusions If used with caution, algorithms such as D-score could help clinicians with constrained resources or limited experience in syndromology to decide whether a patient needs further genetic evaluation. Algorithms such as DeepGestalt could support diagnosing rather common genetic syndromes with facial abnormalities, whereas algorithms such as GestaltMatcher could suggest rare diagnoses that are unknown to the clinician in patients with a characteristic, dysmorphic face.

Automated syndrome diagnosis by three-dimensional facial imaging

A 3D Clinical Face Phenotype Space of Genetic Syndromes using a Triplet-Based Singular Geometric Autoencoder

DeepGestalt - Identifying Rare Genetic Syndromes Using Deep Learning

Analysis of 3D Facial Dysmorphology in Genetic Syndromes from Unconstrained 2D Photographs.

ASDFace: Face-based Autism Diagnosis Via Heterogeneous Domain Adaptation

Toward 3D facial analysis for recognizing Mendelian causes of autism spectrum disorder

AI-based diagnosis and phenotype – Genotype correlations in syndromic craniosynostoses

Deep Learning-Based Analysis of Face Images as a Screening Tool for Genetic Syndromes

An interactive atlas of three-dimensional syndromic facial morphology

Simulated multimodal deep facial diagnosis

Validation of 3 Computer-Aided Facial Phenotyping Tools (DeepGestalt, GestaltMatcher, and D-Score): Comparative Diagnostic Accuracy Study

The Discovery of a LEMD2-Associated Nuclear Envelopathy with Early Progeroid Appearance Suggests Advanced Applications for AI-Driven Facial Phenotyping

Convolutional mesh autoencoders for the 3-dimensional identification of FGFR-related craniosynostosis

Approximating facial expression effects on diagnostic accuracy via generative AI in medical genetics

Facilitating the Molecular Diagnosis of Rare Genetic Disorders Through Facial Phenotypic Scores

Diagnosis and Screening of Velocardiofacial Syndrome by Evaluating Facial Photographs Using a Deep Learning-Based Algorithm

Mapping genes for human face shape: exploration of univariate phenotyping strategies

GestaltMatcher Database - A global reference for facial phenotypic variability in rare human diseases

Automated Multi-Class Facial Syndrome Classification Using Transfer Learning Techniques

Combining deep learning with 3D stereophotogrammetry for craniosynostosis diagnosis

Syndrome-informed phenotyping identifies a polygenic background for achondroplasia-like facial variation in the general population