Abstract:Respiratory pattern is a representation of human breathing activity, which can reflect people's physical and psychological condition. Capturing the unexpected abnormal respiratory pattern unobtrusively of the patient or the potential patient has great significance. In the current work, we attempt to capitalize on depth camera and deep learning architecture to achieve the accurate and unobtrusive measurement of abnormal respiratory patterns, and the whole system can classify multiple people's respiratory patterns in a real-time manner. The challenges in this task are threefold: 1) the real-time online system means that the Region of Interest (ROI) needs to be located and tracked automatically; 2) the amount of real-world data is not enough for training to obtain the robust deep neural network; and 3) the intraclass variation is large and the outer class variation is small. Consequently, human joints tracking is applied to determine the location of subjects shoulder and chest. Based on the characteristics of actual respiratory signals, a novel and efficient respiratory simulation model (RSM) is proposed to generate abundant and high-quality training data. Finally, we apply a gated recurrent unit (GRU) neural network with bidirectional and attentional mechanisms (BI-AT-GRU) to classify six clinically significant respiratory patterns (Eupnea, Tachypnea, Bradypnea, Biots, Cheyne-Stokes, and Central-Apnea). The performance of the obtained BI-AT-GRU is tested by the data that is actually measured by the depth camera. The experimental results demonstrate that the proposed model can classify six different respiratory patterns with the accuracy, precision, recall, and F1 of 94.5%, 94.4%, 95.1%, and 94.8%, respectively. In comparative experiments, the obtained BI-AT-GRU specific to respiratory pattern classification outperforms the existing state-of-the-art, viz., BI-AT-LSTM, GRU, long short-term memory (LSTM), and BI-AT-GRU. Moreover, other experimental results indicate that the proposed online measuring system, deep neural network, and the modeling ideas have the potential to be extended to the large-scale applications, such as public places, sleep scenario, and office environment. The demo videos of the proposed system are available at: https://doi.org/10.6084/m9.figshare.11493666.v1.

Deep Learning versus Professional Healthcare Equipment: A Fine-Grained Breathing Rate Monitoring Model.

Wireless Earphone-based Real-Time Monitoring of Breathing Exercises: A Deep Learning Approach

On the effectiveness of smartphone IMU sensors and Deep Learning in the detection of cardiorespiratory conditions

Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning

Lightweight End-to-End Deep Learning Solution for Estimating the Respiration Rate from Photoplethysmogram Signal

Internet of things-enabled real-time health monitoring system using deep learning

Detection of COVID-19 in smartphone-based breathing recordings: A pre-screening deep learning tool

Deep learning-based lung sound analysis for intelligent stethoscope

Intelligent Respiratory Status Monitoring via a 1DCNN-Assisted Microfiber Sensor

Efficient Deep Learning-based Estimation of the Vital Signs on Smartphones

Unobtrusive and Automatic Classification of Multiple People's Abnormal Respiratory Patterns in Real Time Using Deep Neural Network and Depth Camera.

Abnormal respiratory patterns classifier may contribute to large-scale screening of people infected with COVID-19 in an accurate and unobtrusive manner

Machine learning-based algorithms for at-home respiratory disease monitoring and respiratory assessment

Lightweight Video-Based Respiration Rate Detection Algorithm: an Application Case on Intensive Care

A 1D-CNN Based Deep Learning Technique for Sleep Apnea Detection in IoT Sensors

Multitask Network for Respiration Rate Estimation -- A Practical Perspective

Contrasting Deep Learning Models for Direct Respiratory Insufficiency Detection Versus Blood Oxygen Saturation Estimation

Detection and severity assessment of obstructive sleep apnea according to deep learning of single‐lead electrocardiogram signals

A Novel Respiratory Rate Estimation Algorithm from Photoplethysmogram Using Deep Learning Model

RespiroDynamics: A Multifaceted Dataset for Enhanced Lung Health Assessment Using Deep Learning

Respiratory Consultant by Your Side: Affordable and Remote Intelligent Respiratory Rate and Respiratory Pattern Monitoring System