Abstract 65: Automated Detection of Facial Droop: Ml/AI Based Tool for Early Detection of Stroke

Connor J McGuffey,Ishmeet Singh,Alper Yilmaz,Deepak Gulati
DOI: https://doi.org/10.1161/str.55.suppl_1.65
IF: 10.17
2024-02-01
Stroke
Abstract:Introduction: Facial droop (FD) is a common symptom (45-60%) of stroke so early detection is critical for timely treatment. FD is a part of almost all stroke scales. Our study is to develop a machine learning (ML)/AI based tool that uses an automated detection of FD as one of the components. Our approach uses a normalized value of minor facial expressions called a blendshape. Methods: Google’s Mediapipe was used to create 52 different blendshape values (e.g., left eyebrow raised, right mouth lowered, etc.) from an input image, which were then used as inputs for a simple deep neural network (DNN). We trained this DNN using the blendshapes from 872 images of people with symptoms of facial palsy (FP) and 872 images of people without symptoms exhibiting multiple emotions (neutral, smiling, frowning, etc.). Results: The proposed approach was evaluated on a dataset of facial images of patients with FD and strokes. Our model showed promising results with over 91% test accuracy. This result suggests that the proposed approach is a promising new method for the early detection of FP with high accuracy. The approach is integrated in our ML/AI based tool to replicate different stroke scales. Conclusions: Our model shows that the use of Blendshapes as features in a ML classifier can produce great results in the detection of FP. For greater accuracy, a better dataset with higher quality images as well as unilateral facial expressions (winking, smirks, etc.) should be used. In a future study, a ML model that uses Blendshapes as inputs could be used to classify FP on a scale.
peripheral vascular disease,clinical neurology
What problem does this paper attempt to address?