Abstract:Objectives Three-dimensional (3D) facial symmetry analysis is based on the 3D symmetry reference plane (SRP). Artificial intelligence is widely used in the dental and oral sciences. This study developed a novel deep learning model called the facial planar reflective symmetry net (FPRS-Net) to automatically construct an SRP and established a method for defining a 3D point-cloud region of interest (ROI) and high-dimensional feature computations suitable for this network model. Methods Overall, 240 patients were enrolled. The deep learning model was trained and predicted using 200 samples, and its clinical suitability was evaluated with 40 samples. Four FPRS-Net models were prepared, each using supervised and unsupervised learning approaches based on full facial and ROI data (FPRS-Net S , FPRS-Net SR , FPRS-Net U , and FPRS-Net UR ). These models were trained on 160 3D facial datasets, validated on 20 cases, and tested on another 20 cases. The model predictions were evaluated using an additional 40 clinical 3D facial datasets by comparing the mean square error of the SRP between the parameters predicted by the four FPRS-Net models and the truth plane. The clinical suitability of FPRS-Net models was evaluated by measuring the angle error between the predicted and ground-truth planes; experts evaluated the predicted SRP of the four FPRS-Net models using the visual analogue scales (VAS) method. Results The FPRS-Net SR and FPRS-Net U models achieved an average angle error of 0.84° and 0.99° in predicting 3D facial SRP, respectively, with a VAS value of >8. Using the four FPRS-Net models to create an SRP in 40 cases of 3D facial data required <4 s. Conclusions Our study demonstrated a new solution for automatically constructing oral clinical 3D facial SRPs. Clinical significance This study proposes an innovative deep learning algorithm (FPRS-Net) to construct a symmetry reference plane that can reduce workload, shorten the time required for digital design, reduce dependence on expert experience, and improve therapeutic efficiency and effectiveness in dental clinics.

Finding Symmetry Plane of 3D Face Shape

3D Symmetry Detection by a Single Image and Geometric Transformation

Nose detection based feature extraction on both normal and abnormal 3D faces

Symmetrical Singular Value Decomposition Representation for Pattern Recognition

Symmetry-Aware Semantic Segmentation of a 3D Human Body Model

Multiresolution Rotational Symmetry Detection Via Radius-Based Frieze-Expansion.

Reconstructing Symmetry Plane by Feature Matching

Accurate 3D Face Registration Based on the Symmetry Plane Analysis on Nose Regions.

3D Face Recognition from Range Data.

PRS-Net: Planar Reflective Symmetry Detection Net for 3D Models

3D Face Recognition using Mapped Depth Images

Symmetry-aware Kinematic Skeleton Generation of a 3D Human Body Model.

Automatic three-dimensional facial symmetry reference plane construction based on facial planar reflective symmetry net

Symmetry-based 3-D Reconstruction from Perspective Images

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

A mathematical algorithm of the facial symmetry plane: Application to mandibular deformity 3D facial data

A Hierarchical Symmetry Detection Algorithm Based on Voxelization

Robust Face Detection and Analysis

Recurrently Estimating Reflective Symmetry Planes from Partial Pointclouds

Using Facial Symmetry in the Illumination Cone Based 3D Face Reconstruction

A Fast and Efficient 3D Reflection Symmetry Detector Based on Neural Networks.