Abstract:Background: Thanks to the increased interest towards health and lifestyle, a larger adoption in wearable devices for activity tracking is present among the general population. Wearable devices such as smart wristbands integrate inertial units, including accelerometers and gyroscopes, which can be utilised to perform automatic classification of hand gestures. This technology could also find an important application in automatic medication adherence monitoring. Accordingly, this study aims at comparing the performance of several Machine-Learning (ML) and Deep-Learning (DL) approaches for the automatic identification of hand gestures, with a specific focus on the drinking gesture, commonly associated to the action of oral intake of a pill-packed medication. Methods: A method to automatically recognize hand gestures in daily living is proposed in this work. The method relies on a commercially available wristband sensor (MetaMotionR, MbientLab Inc.) integrating tri-axial accelerometer and gyroscope. Both ML and DL algorithms were evaluated for both multi-gesture (drinking, eating, pouring water, opening a bottle, typing, answering a phone, combing hair, and cutting) and binary gesture (drinking versus other gestures) classification from wristband sensor signals. Twenty-two participants were involved in the experimental analysis, performing a 10 min acquisition in a laboratory setting. Leave-one-subject-out cross validation was performed for robust performance assessment. Results: The highest performance was achieved using a convolutional neural network with long- short term memory (CNN-LSTM), with a median f1-score of 90.5 [first quartile: 84.5; third quartile: 92.5]% and 92.5 [81.5;98.0]% for multi-gesture and binary classification, respectively. Conclusions: Experimental results showed that hand gesture classification with ML/DL from wrist accelerometers and gyroscopes signals can be performed with reasonable accuracy in laboratory settings, paving the way for a new generation of medical devices for monitoring medical adherence.

Recognition of Smoking Gesture Using Smart Watch Technology

Ubi-Asthma: Toward Ubiquitous Asthma Detection Using the Smartwatch

Smoking Cessation System for Preemptive Smoking Detection

A Bottom-up method Towards the Automatic and Objective Monitoring of Smoking Behavior In-the-wild using Wrist-mounted Inertial Sensors

CigTrak: Smartwatch-Based Accurate Online Smoking Puff & Episode Detection with Gesture-Focused Windowing for CNN

A Survey on Hand-based Behavioral Activity Recognition

Real-time prediction of smoking activity using machine learning based multi-class classification model

SmokeMon

Finger Gesture Recognition Using a Smartwatch with Integrated Motion Sensors.

MedSensor: Medication Adherence Monitoring Using Neural Networks on Smartwatch Accelerometer Sensor Data

An Audio-based Hierarchical Smoking Behavior Detection System Based on A Smart Neckband Platform

Control with Gestures: A Hand Gesture Recognition System Using Off-the-Shelf Smartwatch.

Smoking Behavior Detection Based on Hand Trajectory Tracking and Mouth Saturation Changes

Smart Rings vs. Smartwatches: Utilizing Motion Sensors for Gesture Recognition

Using Smartwatches to Detect Face Touching

Classification of Aggressive Movements Using Smartwatches

Automated classification of hand gestures using a wristband and machine learning for possible application in pill intake monitoring

Detection of Gestures Associated With Medication Adherence Using Smartwatch-Based Inertial Sensors

An End-to-end Energy-efficient Approach for Intake Detection With Low Inference Time Using Wrist-worn Sensor

Toward Concurrent Identification of Human Activities with a Single Unifying Neural Network Classification: First Step