Abstract:Hand hygiene plays a crucial role in healthcare environments which can cease infections and diseases from spreading. It is also regarded as the second most effective way to control the transmission of COVID-19. The World Health Organization (WHO) recommends a 12-step guideline for alcohol-based hand rubbing. Compliance with this guideline is vital in order to clean the hands thoroughly. Hence, an automated system can help to improve the quality of this procedure. In this study, a large-scale and diverse dataset for both real and fake hand rubbing motions is collected as the first stage of building a reliable hand hygiene system. In the next stage, various pre-trained networks were analyzed and compared using a swift version of the Separation Index (SI) method. The proposed Swift SI method facilitates choosing the best pre-trained network without fine-tuning them on the whole dataset. Accordingly, the Inception-ResNet architecture achieved the highest SI among Inception, ResNet, Xception, and MobileNet networks. Fine-tuning the Inception-ResNet model led to an accuracy of 98% on the test dataset, which is the highest score in the literature. Therefore, from the proposed approach, a lightweight version of this model with fewer layers but almost the same accuracy is produced and examined. In the final stage, a novel metric, called Feature-Based Confidence (FBC), is devised for estimating the confidence of models in prediction. The proposed confidence measure is able to profoundly differentiate models with similar accuracy and determine the superior one. Based on the metrics results, the Inception-ResNet model is about 2x slower but 5% more confident than its lightweight version. Putting all together, by addressing the real-time application concerns, a Deep Learning based method is offered to qualify the hand rubbing process. The model is also employed in a commercial machine, called DeepHARTS, to estimate the quality of the hand rubbing procedure in different organizations and healthcare environments.

A Pilot Study of Deep Learning Models for Camera based Hand Hygiene Monitoring in ICU

Exploiting CCTV Cameras for Hand Hygiene Recognition in ICU

Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer

Surveillance Camera-based Cardio-respiratory Monitoring for Critical Patients in ICU

A Deep Learning Based Automated Hand Hygiene Training System

Video-based automatic hand hygiene detection for operating rooms using 3D convolutional neural networks

Camera based Eye State Estimation for ICU Patients: A Pilot Clinical Study.

Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network

Contactless Patient Care Using Hospital IoT: CCTV Camera Based Physiological Monitoring in ICU

Reducing environment exposure to COVID-19 by IoT sensing and computing with deep learning

You Can Wash Hands Better: Accurate Daily Handwashing Assessment with Smartwatches

Real-time hand rubbing quality estimation using deep learning enhanced by separation index and feature-based confidence metric

A Comparison of Deep Learning Models for the Prediction of Hand Hygiene Videos

Hand Hygiene Video Classification Based on Deep Learning

Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliance

IoT‐Based Hand Hygiene Compliance Monitoring System and Validation of Its Effectiveness in Hospital Environments

Unstructured Handwashing Recognition Using Smartwatch to Reduce Contact Transmission of Pathogens

Pilot evaluation of a ward-based automated hand hygiene training system.

Deep Representation for Connected Health: Semi-supervised Learning for Analysing the Risk of Urinary Tract Infections in People with Dementia

The Intelligent ICU Pilot Study: Using Artificial Intelligence Technology for Autonomous Patient Monitoring

Deep Learning for Video-Based Assessment of Endotracheal Intubation Skills