Abstract:Background While characteristic facial features provide important clues for finding the correct diagnosis in genetic syndromes, valid assessment can be challenging. The next-generation phenotyping algorithm DeepGestalt analyzes patient images and provides syndrome suggestions. GestaltMatcher matches patient images with similar facial features. The new D-Score provides a score for the degree of facial dysmorphism. Objective We aimed to test state-of-the-art facial phenotyping tools by benchmarking GestaltMatcher and D-Score and comparing them to DeepGestalt. Methods Using a retrospective sample of 4796 images of patients with 486 different genetic syndromes (London Medical Database, GestaltMatcher Database, and literature images) and 323 inconspicuous control images, we determined the clinical use of D-Score, GestaltMatcher, and DeepGestalt, evaluating sensitivity; specificity; accuracy; the number of supported diagnoses; and potential biases such as age, sex, and ethnicity. Results DeepGestalt suggested 340 distinct syndromes and GestaltMatcher suggested 1128 syndromes. The top-30 sensitivity was higher for DeepGestalt (88%, SD 18%) than for GestaltMatcher (76%, SD 26%). DeepGestalt generally assigned lower scores but provided higher scores for patient images than for inconspicuous control images, thus allowing the 2 cohorts to be separated with an area under the receiver operating characteristic curve (AUROC) of 0.73. GestaltMatcher could not separate the 2 classes (AUROC 0.55). Trained for this purpose, D-Score achieved the highest discriminatory power (AUROC 0.86). D-Score’s levels increased with the age of the depicted individuals. Male individuals yielded higher D-scores than female individuals. Ethnicity did not appear to influence D-scores. Conclusions If used with caution, algorithms such as D-score could help clinicians with constrained resources or limited experience in syndromology to decide whether a patient needs further genetic evaluation. Algorithms such as DeepGestalt could support diagnosing rather common genetic syndromes with facial abnormalities, whereas algorithms such as GestaltMatcher could suggest rare diagnoses that are unknown to the clinician in patients with a characteristic, dysmorphic face.

The point‐of‐care use of a facial phenotyping tool in the genetics clinic: Enhancing diagnosis and education with machine learning

Evaluating Face2Gene as a Tool to Identify Cornelia de Lange Syndrome by Facial Phenotypes

Facilitating the Molecular Diagnosis of Rare Genetic Disorders Through Facial Phenotypic Scores

A Robust Phenotype-Driven Likelihood Ratio Analysis Approach Assisting Interpretable Clinical Diagnosis of Rare Diseases.

Evaluation of Face2Gene using facial images of patients with congenital dysmorphic syndromes recruited in Japan

Validation of 3 Computer-Aided Facial Phenotyping Tools (DeepGestalt, GestaltMatcher, and D-Score): Comparative Diagnostic Accuracy Study

DeepGestalt - Identifying Rare Genetic Syndromes Using Deep Learning

Deep Learning-Based Analysis of Face Images as a Screening Tool for Genetic Syndromes

GestaltMML: Enhancing Rare Genetic Disease Diagnosis through Multimodal Machine Learning Combining Facial Images and Clinical Texts

Diagnostic performance of artificial intelligence to detect genetic diseases with facial phenotypes: A protocol for systematic review and meta analysis

Next-generation phenotyping in Nigerian children with Cornelia de Lange Syndrome

PhenoScore quantifies phenotypic variation for rare genetic diseases by combining facial analysis with other clinical features using a machine-learning framework

A 3D Clinical Face Phenotype Space of Genetic Syndromes using a Triplet-Based Singular Geometric Autoencoder

Standards-Based Clinical Decision Support Platform to Manage Patients Who Meet Guideline-Based Criteria for Genetic Evaluation of Familial Cancer

Automated syndrome diagnosis by three-dimensional facial imaging

Next‐generation phenotyping in Nigerian children with Cornelia de Lange syndrome

Genetic Testing in Craniofacial Care: Development of Algorithms for Testing Patients with Orofacial Clefting, Branchial Arch Anomalies, and Craniosynostosis

Approximating facial expression effects on diagnostic accuracy via generative AI in medical genetics

An automatic diagnostic system for pediatric genetic disorders developed by linking genotype and phenotype information

Novel phenotype–disease matching tool for rare genetic diseases

Multiple Genetic Syndromes Recognition Based on a Deep Learning Framework and Cross-Loss Training