Abstract:Proper and effective toothbrushing technique is crucial for maintaining oral health. However, there are often limited opportunities for individuals to receive specific training in toothbrushing posture in their daily lives. In this article, we propose Hygiea+, a convenient, energy-efficient, and highly accurate toothbrushing monitoring system based on wrist-worn wearables. By leveraging inertial measurement units (IMUs) in wrist-worn devices for gesture sensing, Hygiea+ enables users to accurately and efficiently monitor their toothbrushing activities without any modifications to the toothbrush. We propose a number of novel techniques to achieve the goal of high sensing accuracy and energy efficiency. To reduce the energy consumption of continuous IMU sampling, we model the sensing problem as a Markov process and design a partially observable Markov decision process (POMDP)-based adaptive sampling strategy to dynamically adjust the sampling frequency. To achieve high sensing accuracy, we first propose a novel signal preprocessing method to mitigate variations resulting from different toothbrush types and user habits. Then, we propose a deep reinforcement learning-based data distillation mechanism to extract key segments from continuous toothbrushing actions, thus reducing the impact of redundant data and noise. In the classification stage, we design an attention-based long short-term memory (AT-LSTM) network for fine-grained toothbrushing posture recognition. In addition, to address the accuracy degradation of new users, we adopt the common but effective fine-tuning method to alleviate the data collection burden on new users. Finally, we connect advanced large language models (LLMs) to provide users with necessary feedback on toothbrushing behavior and health recommendations. Extensive experiments using both manual and electric toothbrushes demonstrate Hygiea+ achieves up to 98.8% accuracy in toothbrushing posture recognition while maintaining superior energy efficiency.

TeethFa: Real-time, Hand-Free Teeth Gestures Interaction Using Fabric Sensors

TeethTap: Recognizing Discrete Teeth Gestures Using Motion and Acoustic Sensing on an Earpiece

Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks

Shoes++: A Smart Detachable Sole for Social Foot-to-foot Interaction.

Mmjaw: Remote Jaw Gesture Recognition with COTS Mmwave Radar

Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera

3D Intuitive Gesture Interaction via Motion Sensing

Finger Gesture Recognition Using a Smartwatch with Integrated Motion Sensors.

A Wearable Gesture Recognition System with Ultra-high Accuracy and Robustness Enabled by the Synergy of Multiple Fabric Sensing Devices

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing

FaceSight: Enabling Hand-to-Face Gesture Interaction on AR Glasses with a Downward-Facing Camera Vision

FaceLooks: A Smart Headband for Signaling Face-to-Face Behavior

Understanding the Design Space of Mouth Microgestures

MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities

IOTeeth: Intra-Oral Teeth Sensing System for Dental Occlusal Diseases Recognition

ToothFairy: Real-time Tooth-by-tooth Brushing Monitor Using Earphone Reversed Signals

Anatomically Designed Triboelectric Wristbands with Adaptive Accelerated Learning for Human–Machine Interfaces

Hygiea+: Toward Energy-Efficient and Highly Accurate Toothbrushing Monitoring via Wrist-Worn Gesture Sensing

Your Glasses Know Your Diet: Dietary Monitoring Using Electromyography Sensors.

Control with Gestures: A Hand Gesture Recognition System Using Off-the-Shelf Smartwatch.

eGlove: Designing Interactive Fabric Sensor for Enhancing Contact-Based Interactions