Deep‐Learning‐Enabled MXene‐Based Artificial Throat: Toward Sound Detection and Speech Recognition
Yukun Jin,Bo Wen,Zixiong Gu,Xiantao Jiang,Xiaolan Shu,Zhenping Zeng,Yupeng Zhang,Zhinan Guo,Yun Chen,Tingting Zheng,Yutao Yue,Han Zhang,Huijun Ding
DOI: https://doi.org/10.1002/admt.202000262
IF: 6.8
2020-07-06
Advanced Materials Technologies
Abstract:<p>Wearable sound detectors require strain sensors that are stretchable, sensitive, and capable of adhering conformably to the skin, and toward this end, 2D materials hold great promise. However, the vibration of vocal cords and muscle contraction are complex and changeable, which can compromise the sensing performance of devices. By combining deep learning and 2D MXenes, an MXene‐based sound detector is prepared successfully with improved recognition and sensitive response to pressure and vibration, which facilitate the production of a high‐recognition and resolution sound detector. By training and testing the deep learning network model with large amounts of data obtained by the MXene‐based sound detector, the long vowels and short vowels of human pronunciation are successfully recognized. The proposed scheme accelerates the application of artificial throat devices in biomedical fields and opens up practical applications in voice control, motion monitoring, and many other fields.</p>
materials science, multidisciplinary
What problem does this paper attempt to address?
The paper attempts to address the development of a wearable artificial larynx device based on MXene materials to improve the speech recognition and pronunciation abilities of patients with vocal cord diseases. Specifically, the objectives of the paper include:
1. **Developing a high-sensitivity sound detector**: By combining MXene materials and deep learning technology, prepare a sound detector (MXSD) that is sensitive to pressure and vibration, used to detect muscle movements and sound signals in the human throat.
2. **Achieving speech recognition**: Utilize a deep learning network model (SR-CNN) to train and test a large amount of resistance data detected by MXSD, in order to accurately recognize long and short vowels.
3. **Improving patient communication convenience**: Develop a thin, flexible, and wearable artificial larynx device to increase patient willingness to use it and promote communication convenience.
4. **Exploring the application of MXene materials in the biomedical field**: By combining MXene materials with deep learning technology, accelerate the application of artificial larynx devices in the biomedical field and explore their practical applications in voice control, motion monitoring, and other areas.
Overall, the paper aims to address the communication barriers faced by current patients with vocal cord diseases through advanced materials science and deep learning technology, thereby improving their quality of life.