Multi-Modal Wireless Flexible Gel-Free Sensors with Edge Deep Learning for Detecting and Alerting Freezing of Gait in Parkinson's Patients

Yuhan Hou,Jack Ji,Yi Zhu,Thomas Dell,Xilin Liu
2023-05-28
Abstract:Freezing of gait (FoG) is a debilitating symptom of Parkinson's disease (PD). This work develops flexible wearable sensors that can detect FoG and alert patients and companions to help prevent falls. FoG is detected on the sensors using a deep learning (DL) model with multi-modal sensory inputs collected from distributed wireless sensors. Two types of wireless sensors are developed, including: (1) a C-shape central node placed around the patient's ears, which collects electroencephalogram (EEG), detects FoG using an on-device DL model, and generates auditory alerts when FoG is detected; (2) a stretchable patch-type sensor attached to the patient's legs, which collects electromyography (EMG) and movement information from accelerometers. The patch-type sensors wirelessly send collected data to the central node through low-power ultra-wideband (UWB) transceivers. All sensors are fabricated on flexible printed circuit boards. Adhesive gel-free acetylene carbon black and polydimethylsiloxane electrodes are fabricated on the flexible substrate to allow conformal wear over the long term. Custom integrated circuits (IC) are developed in 180 nm CMOS technology and used in both types of sensors for signal acquisition, digitization, and wireless communication. A novel lightweight DL model is trained using multi-modal sensory data. The inference of the DL model is performed on a low-power microcontroller in the central node. The DL model achieves a high detection sensitivity of 0.81 and a specificity of 0.88. The developed wearable sensors are ready for clinical experiments and hold great promise in improving the quality of life of patients with PD. The proposed design methodologies can be used in wearable medical devices for the monitoring and treatment of a wide range of neurodegenerative diseases.
Signal Processing
What problem does this paper attempt to address?
This paper attempts to address the real-time detection and alerting of freezing of gait (FoG) symptoms in patients with Parkinson's disease (PD). Specifically: 1. **Problem Background**: - Parkinson's disease is a common neurological disorder affecting over 10 million patients worldwide. - Freezing of gait (FoG) is one of the most common symptoms in Parkinson's disease patients, characterized by sudden, brief, and temporary inability to move the feet despite the intention to walk. - Over 79.2% of late-stage Parkinson's disease patients experience freezing of gait. - Real-time detection and alerting of freezing of gait can help prevent falls, thereby significantly improving the quality of life for patients. 2. **Research Objectives**: - Develop a flexible wearable sensor system capable of real-time detection and alerting of freezing of gait. - The system includes two types of wireless sensors: - A C-shaped central node placed around the patient's ear to collect electroencephalogram (EEG) signals and detect freezing of gait using an on-device deep learning (DL) model, generating auditory alerts when freezing of gait is detected. - A stretchable patch-type sensor attached to the patient's leg to collect electromyogram (EMG) and leg movement information, wirelessly transmitting data to the central node via a low-power ultra-wideband (UWB) transceiver. 3. **Technical Challenges**: - Existing deep learning models typically have high computational demands, making them difficult to deploy on low-power wearable devices. - The device needs to be comfortable, easy to wear for long periods, and capable of executing algorithms on the device. - Issues such as data transmission latency, offline usage, and network security during data transmission need to be addressed. 4. **Solutions**: - Developed a lightweight edge deep learning model using multimodal sensor inputs for freezing of gait detection. - The model achieved real-time prediction on a low-power microcontroller with high detection sensitivity (0.81) and specificity (0.88). - All sensors were manufactured using commercial flexible printed circuit board (F-PCB) technology. - Used adhesive-free acetylene black (AB) and polydimethylsiloxane (PDMS) electrodes, allowing for comfortable long-term wear. - Custom integrated circuit (IC) design for signal acquisition, digitization, and wireless communication, achieving high-precision signal acquisition and low-power wireless data transmission. 5. **Innovations**: - Developed the first flexible wireless sensor network for freezing of gait detection and closed-loop auditory alerting. - Proposed a novel lightweight edge deep learning model suitable for multimodal signal input. - Designed and validated custom integrated circuit and adhesive-free AB/PDMS electrode manufacturing technology for wearable sensors. This research provides important technical support for validating the clinical efficacy of freezing of gait and other neurodegenerative disease detection in future clinical trials.