Abstract:Introduction: Multiple tools have been developed for facial feature measurements and analysis using facial recognition machine learning techniques. However, several challenges remain before these will be useful in the clinical context for reconstructive and aesthetic plastic surgery. Smartphone-based applications utilizing open-access machine learning tools can be rapidly developed, deployed, and tested for use in clinical settings. This research compares a smartphone-based facial recognition algorithm to direct and digital measurement performance for use in facial analysis. Methods: Facekit is a camera application developed for Android that utilizes ML Kit, an open-access computer vision Application Programing Interface developed by Google. Using the facial landmark module, we measured 4 facial proportions in 15 healthy subjects and compared them to direct surface and digital measurements using intraclass correlation (ICC) and Pearson correlation. Results: Measurement of the naso-facial proportion achieved the highest ICC of 0.321, where ICC > 0.75 is considered an excellent agreement between methods. Repeated measures analysis of variance of proportion measurements between ML Kit, direct and digital methods, were significantly different (F[2,14] = 6-26, P<<.05). Facekit measurements of orbital, orbitonasal, naso-oral, and naso-facial ratios had overall low correlation and agreement to both direct and digital measurements (R<<0.5, ICC<<0.75). Conclusion: Facekit is a smartphone camera application for rapid facial feature analysis. Agreement between Facekit's machine learning measurements and direct and digital measurements was low. We conclude that the chosen pretrained facial recognition software is not accurate enough for conducting a clinically useful facial analysis. Custom models trained on accurate and clinically relevant landmarks may provide better performance.

Facial Feature Recognition System Development for Enhancing Customer Experience in Cosmetics

Unconstrained Face Detection and Recognition Based on Rgb-D Camera for the Visually Impaired

Developing an Artificial Intelligence (A.I)-based descriptor of facial appearance that fits with the assessments of makeup experts

Cosmetic Suggestion based on Skin Condition using Artificial Intelligence

Identifying People's Faces in Smart Banking Systems Using Artificial Neural Networks

Application Design Study of Chinese Female Makeup Recommendations

"Facekit"-Toward an Automated Facial Analysis App Using a Machine Learning-Derived Facial Recognition Algorithm

A Discriminative Face Geometric Feature-Based Face Recognition

Detection, Segmentation and Recognition of Face and its Features Using Neural Network

Automatic Facial Skin Feature Detection for Everyone

A smartphone application for personalized facial aesthetic monitoring

Optimized face recognition algorithm using radial basis function neural networks and its practical applications

Research on Intelligent Algorithm of Identity Authentication Based on Facial Features

ARCosmetics: a Real-Time Augmented Reality Cosmetics Try-on System.

Face Recognition System for Real Life Applications using Augmentation Techniques

Machine Learning-Based Facial Beauty Prediction and Analysis of Frontal Facial Images Using Facial Landmarks and Traditional Image Descriptors

Exploring the Application of Artificial Intelligence in Cosmetics and Beauty Industry

Human-computer Interaction Based on Face Feature Localization.

A novel facial attractiveness evaluation system based on face shape, facial structure features and skin

Advancements in Face Recognition: From Feature Extraction to Deep Learning Models and Integrated Biometric Solutions

Automated facial characterization and image retrieval by convolutional neural networks