Abstract:Two to three thousand syndromes modify facial features: their screening requires the eye of an expert in dysmorphology. A widely used tool in shape characterization is geometric morphometrics based on landmarks, which are precise and reproducible anatomical points. Landmark positioning is user dependent and time consuming. Many automatic landmarking tools are currently available but do not work for children, because they have mainly been trained using photographic databases of healthy adults. Here, we developed a method for building an automatic landmarking pipeline for frontal and lateral facial photographs as well as photographs of external ears. We evaluated the algorithm on patients diagnosed with Treacher Collins (TC) syndrome as it is the most frequent mandibulofacial dysostosis in humans and is clinically recognizable although highly variable in severity. We extracted photographs from the photographic database of the maxillofacial surgery and plastic surgery department of Hôpital Necker-Enfants Malades in Paris, France with the diagnosis of TC syndrome. The control group was built from children admitted for craniofacial trauma or skin lesions. After testing two methods of object detection by bounding boxes, a Haar Cascade-based tool and a Faster Region-based Convolutional Neural Network (Faster R-CNN)-based tool, we evaluated three different automatic annotation algorithms: the patch-based active appearance model (AAM), the holistic AAM, and the constrained local model (CLM). The final error corresponding to the distance between the points placed by automatic annotation and those placed by manual annotation was reported. We included, respectively, 1664, 2044, and 1375 manually annotated frontal, profile, and ear photographs. Object recognition was optimized with the Faster R-CNN-based detector. The best annotation model was the patch-based AAM (p < 0.001 for frontal faces, p = 0.082 for profile faces and p < 0.001 for ears). This automatic annotation model resulted in the same classification performance as manually annotated data. Pretraining on public photographs did not improve the performance of the model. We defined a pipeline to create automatic annotation models adapted to faces with congenital anomalies, an essential prerequisite for research in dysmorphology.

Spectral Correspondence Framework For Building A 3d Baby Face Model

A synthesis method for personalized 3D face reconstruction

Reconstruction of the fetus face from three-dimensional ultrasound using a newborn face statistical shape model

BabyNet: Reconstructing 3D faces of babies from uncalibrated photographs

Analysis of 3D Facial Dysmorphology in Genetic Syndromes from Unconstrained 2D Photographs.

Fetal face shape analysis from prenatal 3D ultrasound images

Establishing Point Correspondence of 3D Faces Via Sparse Facial Deformable Model

A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

BioFace3D: A fully automatic pipeline for facial biomarkers extraction of 3D face reconstructions segmented from MRI

“Edutainment 2017” a Visual and Semantic Representation of 3D Face Model for Reshaping Face in Images

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Automatic facial axes standardization of 3D fetal ultrasound images

Automatic Fetal Face Detection from Ultrasound Volumes Via Learning 3D and 2D Information

Towards Semantically-Consistent Deformable 2D-3D Registration for 3D Craniofacial Structure Estimation from A Single-View Lateral Cephalometric Radiograph

A Modeling Method for the Human Body Model with Facial Morphology

Reshaping 3D Facial Scans for Facial Appearance Modeling and 3D Facial Expression Analysis

Correspondence attention for facial appearance simulation

Novel Framework: Face Feature Selection Algorithm for Neonatal Facial and Related Attributes Recognition

A Hierarchical Dense Deformable Model for 3D Face Reconstruction from Skull.

An automatic facial landmarking for children with rare diseases

On Learning 3D Face Morphable Model from In-the-wild Images