Decoding of facial strains via conformable piezoelectric interfaces

Tao Sun,Farita Tasnim,Rachel T. McIntosh,Nikta Amiri,Dana Solav,Mostafa Tavakkoli Anbarani,David Sadat,Lin Zhang,Yuandong Gu,M. Amin Karami,Canan Dagdeviren
DOI: https://doi.org/10.1038/s41551-020-00612-w
IF: 28.1
2020-10-01
Nature Biomedical Engineering
Abstract:Devices that facilitate nonverbal communication typically require high computational loads or have rigid and bulky form factors that are unsuitable for use on the face or on other curvilinear body surfaces. Here, we report the design and pilot testing of an integrated system for decoding facial strains and for predicting facial kinematics. The system consists of mass-manufacturable, conformable piezoelectric thin films for strain mapping; multiphysics modelling for analysing the nonlinear mechanical interactions between the conformable device and the epidermis; and three-dimensional digital image correlation for reconstructing soft-tissue surfaces under dynamic deformations as well as for informing device design and placement. In healthy individuals and in patients with amyotrophic lateral sclerosis, we show that the piezoelectric thin films, coupled with algorithms for the real-time detection and classification of distinct skin-deformation signatures, enable the reliable decoding of facial movements. The integrated system could be adapted for use in clinical settings as a nonverbal communication technology or for use in the monitoring of neuromuscular conditions.
engineering, biomedical
What problem does this paper attempt to address?