Abstract:Statement of problem: The development of facial scanners has improved capabilities to create three-dimensional (3D) virtual patients for accurate facial and smile analysis. However, most of these scanners are expensive, stationary and involve a significant clinical footprint. The use of the Apple iPhone and its integrated "TrueDepth" near-infrared (NIR) scanner combined with an image processing application (app) offers the potential to capture and analyze the unique 3D nature of the face; the accuracy and reliability of which are yet to be established for use in clinical dentistry. Purpose: This study was designed to validate both the trueness and precision of the iPhone 11 Pro smartphone TrueDepth NIR scanner in conjunction with the Bellus3D Face app in capturing 3D facial images in a sample of adult participants in comparison to the conventional 3dMDface stereophotogrammetry system. Material and methods: Twenty-nine adult participants were prospectively recruited. Eighteen soft tissue landmarks were marked on each participant's face before imaging. 3D facial images were captured using a 3dMDface system and the Apple iPhone TrueDepth NIR scanner combined with the Bellus3D Face app respectively. The best fit of each experimental model to the 3dMD scan was analyzed using Geomagic Control X software. The root mean square (RMS) was used to measure the "trueness" as the absolute deviation of each TrueDepth scan from the reference 3dMD image. Individual facial landmark deviations were also assessed to evaluate the reliability in different craniofacial regions. The "precision" of the smartphone was tested by taking 10 consecutive scans of the same subject and comparing those to the reference scan. Intra-observer and inter-observer reliabilities were assessed using the intra-class correlation coefficient (ICC). Results: Relative to the 3dMDface system, the mean RMS difference of the iPhone/Bellus3D app was 0.86 ± 0.31 mm. 97% of all the landmarks were within 2 mm of error compared with the reference data. The ICC for intra-observer reproducibility or precision of the iPhone/Bellus3D app was 0.96, which was classified as excellent. The ICC for inter-observer reliability was 0.84, which was classified as good. Conclusions: These results suggest that 3D facial images acquired with this system, the iPhone TrueDepth NIR camera in conjunction with the Bellus3D Face app, are clinically accurate and reliable. Judicious use is advised in clinical situations that require high degrees of detail due to a lack of image resolution and a longer acquisition time. Generally, this system possesses the potential to serve as a practical alternative to conventional stereophotogrammetry systems for use in a clinical setting due to its accessibility and relative ease of use and further research is planned to appraise its updated clinical use.

Novel evaluation method for facial nerve palsy using 3D facial recognition system in iPhone

Evaluation of Facial Paralysis Degree Based on Regions

Toward an application of automatic evaluation system for central facial palsy using two simple evaluation indices in emergency medicine

Deep Learning for the Assessment of Facial Nerve Palsy: Opportunities and Challenges

Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system

Facia-fix: mobile application for bell's palsy diagnosis and assessment using computer vision and deep learning

Development of a smartphone app for neuromuscular facial training

Region Based Parallel Hierarchy Convolutional Neural Network for Automatic Facial Nerve Paralysis Evaluation

[Development of a smartphone app for neuromuscular facial training. German Version]

Machine Learning Methods to Track Dynamic Facial Function in Facial Palsy

Automatic Facial Paralysis Assessment via Computational Image Analysis

Prognostic value of a three-dimensional dynamic quantitative analysis system to measure facial motion in acute facial paralysis patients

Validity and reliability of a novel iPhone method to rapidly measure cervical sagittal parameters

Toward an Automatic System for Computer-Aided Assessment in Facial Palsy

Validation of a new graphic facial nerve grading system: FAME scale

Introduction of a Low-Cost and Automated Four-Dimensional Assessment System of the Face

Assessing 3D volumetric asymmetry in facial palsy patients via advanced multi-view landmarks and radial curves

The Validity of a Smartphone-Based Method for Acquiring 3D Images of the Face

An Intelligent Augmented Lifelike Avatar App for Virtual Physical Examination of Suspected Strokes

Artificial Intelligence-based Facial Palsy Evaluation: A Survey

A smartphone application for personalized facial aesthetic monitoring