RespEar: Earable-Based Robust Respiratory Rate Monitoring

Yang Liu,Kayla-Jade Butkow,Jake Stuchbury-Wass,Adam Pullin,Dong Ma,Cecilia Mascolo
2024-07-09
Abstract:Respiratory rate (RR) monitoring is integral to understanding physical and mental health and tracking fitness. Existing studies have demonstrated the feasibility of RR monitoring under specific user conditions (e.g., while remaining still, or while breathing heavily). Yet, performing accurate, continuous and non-obtrusive RR monitoring across diverse daily routines and activities remains challenging. In this work, we present RespEar, an earable-based system for robust RR monitoring. By leveraging the unique properties of in-ear microphones in earbuds, RespEar enables the use of Respiratory Sinus Arrhythmia (RSA) and Locomotor Respiratory Coupling (LRC), physiological couplings between cardiovascular activity, gait and respiration, to indirectly determine RR. This effectively addresses the challenges posed by the almost imperceptible breathing signals under daily activities. We further propose a suite of meticulously crafted signal processing schemes to improve RR estimation accuracy and robustness. With data collected from 18 subjects over 8 activities, RespEar measures RR with a mean absolute error (MAE) of 1.48 breaths per minutes (BPM) and a mean absolute percent error (MAPE) of 9.12% in sedentary conditions, and a MAE of 2.28 BPM and a MAPE of 11.04% in active conditions, respectively, which is unprecedented for a method capable of generalizing across conditions with a single modality.
Human-Computer Interaction,Sound,Audio and Speech Processing
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the issue of continuous, non-invasive respiratory rate (RR) monitoring during daily activities. While existing studies have demonstrated the feasibility of monitoring respiratory rate under specific conditions (such as at rest or during intense breathing), achieving accurate and continuous respiratory rate monitoring in diverse daily activities and environments remains challenging. Specifically: 1. **Limitations of Existing Technologies**: - Current respiratory rate monitoring solutions typically rely on three principles: monitoring body movements caused by breathing using IMUs in smartwatches, smartphones, or earbuds; monitoring airflow through the nose or mouth using nasal sensors, microphones on smartphones, or microphones in earbuds; and indirectly estimating respiratory rate using behavioral or physiological coupling. These methods perform well under specific conditions but integrating these technologies across various daily activities is very difficult. 2. **Proposed New System RespEar**: - This paper proposes the RespEar system, which uses built-in microphones in earbuds for respiratory rate monitoring. RespEar can achieve reliable respiratory rate monitoring under resting conditions (such as sitting, standing, working, etc.) and active conditions (such as walking, running, rowing, etc.). By leveraging respiratory sinus arrhythmia (RSA) and locomotor-respiratory coupling (LRC), RespEar can indirectly determine the respiratory rate, addressing the issue of nearly imperceptible respiratory signals during daily activities. 3. **Technical Challenges and Solutions**: - In designing RespEar, the main challenges faced by the authors include weak breathing sounds and how to accurately and reliably estimate respiratory rate in different environments and user behaviors. To overcome these challenges, the authors proposed a series of optimization solutions, such as indirectly estimating respiratory rate based on heart rate variability (HRV) on the basis of RSA and combining gait rhythm to estimate respiratory rate based on LRC. Through these methods, RespEar achieved a mean absolute error (MAE) of 1.71 breaths per minute (BPM) and a mean absolute percentage error (MAPE) of 9.68% under different activity conditions, outperforming existing ear-worn devices and other solutions, and maintaining robustness under various real-world conditions such as different noise levels, music playback, indoor and outdoor environments.