Abstract:Continuous monitoring of vital signs such as respiration and heart rate is essential to detect and predict conditions that may affect the patient's well‐being. To detect these vital signs most medical systems use contact sensors. They are not feasible for long term monitoring and are not repeatable. Vital signs using facial video‐noncontact monitoring are becoming increasingly important. Researchers in the last few years although considerable progress has been made, challenging datasets absence timing of assessment process and the technology still has some limitations such as time consuming nature and lack of computer portability. To solve those problems, we propose a contactless video based vital signs detection framework for continuous health monitoring using feature optimization and hybrid neural network. In the proposed technique, modified war strategy optimization algorithm is proposed to segment the face portion from the input video frames. Then, we utilize the known data acquisition models to extract vital signs from the segmented face portions are heart rate, blood pressure, respiratory rate and oxygen saturation. An improved neural network structure (Lifting Net) is further used to achieve the adaptive extraction of deep hidden features for specific signs, for realizing the high precision of human health monitoring. The Hughes effect or dimensionality issue affects detection accuracy in sign classification when there are fewer training instances relative to the number of spectral features. The problem can be overcome through feature optimization here Northern goshawk optimization algorithm is used to select optimal best features which reduces the data dimensionality issue. Furthermore, hybrid deep ensemble reinforcement learning classifier is proposed for the human vital sign detection and classification which ensures the early detection of patient abnormality. Finally, we validate our framework using benchmark video datasets such as TokyoTechrPPG, PURE and COHFACE. To proves the effectiveness of proposed technique using simulation results and comparative analysis.

In Search of Life: Learning from Synthetic Data to Detect Vital Signs in Videos

Revisiting Motion-Based Respiration Measurement from Videos

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

SiNC+: Adaptive Camera-Based Vitals with Unsupervised Learning of Periodic Signals

Contactless face video based vital signs detection framework for continuous health monitoring using feature optimization and hybrid neural network

ECG Signal Reconstruction Based on Facial Videos Via Combined Explicit and Implicit Supervision.

Remote Heart Rate Measurement from Face Videos under Realistic Situations

Estimation of vital signs from facial videos via video magnification and deep learning

Respiratory Rate Estimation from Thermal Video Data Using Spatio-Temporal Deep Learning

A Skeleton-based Action Recognition System for Medical Condition Detection

Deep-HR: Fast Heart Rate Estimation from Face Video under Realistic Conditions

Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark

Training Robust Deep Physiological Measurement Models with Synthetic Video-based Data

A Supervised Learning Approach for Robust Health Monitoring using Face Videos

Using High-Fidelity Avatars to Advance Camera-based Cardiac Pulse Measurement

An Intelligent Signal Processing Method for Motional Vital Signs Detection System Based on Deep Learning

A Study of Machine Learning Regression Techniques for Non-Contact SpO2 Estimation from Infrared Motion-Magnified Facial Video

Video-Based Multiphysiological Disentanglement and Remote Robust Estimation for Respiration

Lightweight Video-Based Respiration Rate Detection Algorithm: an Application Case on Intensive Care

Thermal Image Processing for Respiratory Estimation from Cubical Data with Expandable Depth

Edge Artificial Intelligence: Real-Time Noninvasive Technique for Vital Signs of Myocardial Infarction Recognition Using Jetson Nano