Abstract:Automated detection of intake gestures with wearable sensors has been a critical area of research for advancing our understanding and ability to intervene in people's eating behavior. Numerous algorithms have been developed and evaluated in terms of accuracy. However, ensuring the system is not only accurate in making predictions but also efficient in doing so is critical for real-world deployment. Despite the growing research on accurate detection of intake gestures using wearables, many of these algorithms are often energy inefficient, impeding on-device deployment for continuous and real-time monitoring of diet. This paper presents a template-based optimized multicenter classifier that enables accurate intake gesture detection while maintaining low-inference time and energy consumption using a wrist-worn accelerometer and gyroscope. We designed an Intake Gesture Counter smartphone application (CountING) and validated the practicality of our algorithm against seven state-of-the-art approaches on three public datasets (In-lab FIC, Clemson, and OREBA). Compared with other methods, we achieved optimal accuracy (81.60% F1 score) and very low inference time (15.97 msec per 2.20-sec data sample) on the Clemson dataset, and among the top performing algorithms, we achieve comparable accuracy (83.0% F1 score compared with 85.6% in the top performing algorithm) but superior inference time (13.8x faster, 33.14 msec per 2.20-sec data sample) on the In-lab FIC dataset and comparable accuracy (83.40% F1 score compared with 88.10% in the top-performing algorithm) but superior inference time (33.9x faster, 16.71 msec inference time per 2.20-sec data sample) on the OREBA dataset. On average, our approach achieved a 25-hour battery lifetime (44% to 52% improvement over state-of-the-art approaches) when tested on a commercial smartwatch for continuous real-time detection. Our approach demonstrates an effective and efficient method, enabling real-time intake gesture detection using wrist-worn devices in longitudinal studies.

FaceTouch: Practical Face Touch Detection with a Multimodal Wearable System for Epidemiological Surveillance

Ubi-Fatigue: Toward Ubiquitous Fatigue Detection Via Contactless Sensing

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

FaceOff: Detecting Face Touching with a Wrist-Worn Accelerometer

Using Smartwatches to Detect Face Touching

An End-to-end Energy-efficient Approach for Intake Detection With Low Inference Time Using Wrist-worn Sensor

A new finger touch detection algorithm and prototype system architecture for pervasive bare-hand human computer interaction

InMyFace: Inertial and mechanomyography-based sensor fusion for wearable facial activity recognition

SmartAct: Energy Efficient and Real-Time Hand-to-Mouth Gesture Detection Using Wearable RGB-T

ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection

Hand Gesture Recognition on a Resource-Limited Interactive Wristband

Efficient High Cross-User Recognition Rate Ultrasonic Hand Gesture Recognition System

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing

MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities

Hand Gesture Recognition by a MMG-Based Wearable Device

A wearable assistive system for the visually impaired using object detection, distance measurement and tactile presentation

Machine learning-assisted wearable sensing for high-sensitivity gesture recognition

Ipand: Accurate Gesture Input with Ambient Acoustic Sensing on Hand.

Acoustic Sensing-based Hand Gesture Detection for Wearable Device Interaction

Hand Gesture Recognition With Flexible Capacitive Wristband Using Triplet Network in Inter-Day Applications

Design of A Compact Low-Power Human-Computer Interaction Equipment for Hand Motion