Abstract:Respiratory pattern is a representation of human breathing activity, which can reflect people's physical and psychological condition. Capturing the unexpected abnormal respiratory pattern unobtrusively of the patient or the potential patient has great significance. In the current work, we attempt to capitalize on depth camera and deep learning architecture to achieve the accurate and unobtrusive measurement of abnormal respiratory patterns, and the whole system can classify multiple people's respiratory patterns in a real-time manner. The challenges in this task are threefold: 1) the real-time online system means that the Region of Interest (ROI) needs to be located and tracked automatically; 2) the amount of real-world data is not enough for training to obtain the robust deep neural network; and 3) the intraclass variation is large and the outer class variation is small. Consequently, human joints tracking is applied to determine the location of subjects shoulder and chest. Based on the characteristics of actual respiratory signals, a novel and efficient respiratory simulation model (RSM) is proposed to generate abundant and high-quality training data. Finally, we apply a gated recurrent unit (GRU) neural network with bidirectional and attentional mechanisms (BI-AT-GRU) to classify six clinically significant respiratory patterns (Eupnea, Tachypnea, Bradypnea, Biots, Cheyne-Stokes, and Central-Apnea). The performance of the obtained BI-AT-GRU is tested by the data that is actually measured by the depth camera. The experimental results demonstrate that the proposed model can classify six different respiratory patterns with the accuracy, precision, recall, and F1 of 94.5%, 94.4%, 95.1%, and 94.8%, respectively. In comparative experiments, the obtained BI-AT-GRU specific to respiratory pattern classification outperforms the existing state-of-the-art, viz., BI-AT-LSTM, GRU, long short-term memory (LSTM), and BI-AT-GRU. Moreover, other experimental results indicate that the proposed online measuring system, deep neural network, and the modeling ideas have the potential to be extended to the large-scale applications, such as public places, sleep scenario, and office environment. The demo videos of the proposed system are available at: https://doi.org/10.6084/m9.figshare.11493666.v1.

A Contactless Breathing Pattern Recognition System Using Deep Learning and WiFi Signal

Contactless Respiration Monitoring Via Off-the-Shelf WiFi Devices.

Wi-Tracker: Monitoring Breathing Airflow with Acoustic Signals

Wi-Breath: A WiFi-Based Contactless and Real-Time Respiration Monitoring Scheme for Remote Healthcare

Wireless Channel Modelling for Identifying Six Types of Respiratory Patterns With SDR Sensing and Deep Multilayer Perceptron

Contactless Respiration Monitoring During Sleep with a Pair of Wi-Fi Devices

UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator

Contact-Free In-Home Health Monitoring System with Commodity Wi-Fi.

A Deep Learning Framework using Passive WiFi Sensing for Respiration Monitoring

Contactless Breathing Airflow Detection on Smartphone

BreatheBand: A Fine-grained and Robust Respiration Monitor System Using WiFi Signals

Breathing-based Continuous Non-Intrusive User Verification Leveraging Commodity WiFi

Contactless Respiration Monitoring Using Wi-Fi and Artificial Neural Network Detection Method

Ubiquitous Smartphone-Based Respiration Sensing with Wi-Fi Signal

Unobtrusive and Automatic Classification of Multiple People's Abnormal Respiratory Patterns in Real Time Using Deep Neural Network and Depth Camera.

Multi-Person Breathing Detection with Switching Antenna Array Based on WiFi Signal

Human Biometric Signals Monitoring based on WiFi Channel State Information using Deep Learning

In-Home Monitoring Sleep Turnover Activities and Breath Rate Via WiFi Signals

A Deep‐Learning‐Assisted On‐Mask Sensor Network for Adaptive Respiratory Monitoring

Breathing Rhythm Analysis in Body Centric Networks.

Noncontact Respiratory Anomaly Detection Using Infrared Light-Wave Sensing