Abstract:This article proposes a finger state capture and recognition system based on near-field coil coupling and multifrequency resonance. Finger state capture is realized by load coils mounted on the fingers that form coupling resonance at multiple frequencies under sweep frequency excitations. The motions of the finger joints lead to changes of the distance and angle between the load coils, which further affect the amplitude and frequency of the resonance through mutual inductances. These features are extracted from the measurements of reflected signals for finger state recognition. The process of a finger from full flexion to full extension is approximately evenly divided into 20 states. A weighted parallel amplitude and phase (WPAP) classification method is proposed based on the support vector machine (SVM) algorithm. This method processes the amplitude and phase of the complex reflected signal separately in parallel, and then combines their classification results by assigning weights to the output. The experimental results verify the effectiveness of finger state recognition from the reflected signals. The classification result and performance evaluation demonstrate that the proposed method outperforms the two SVM classifiers trained on amplitude data and phase individually. The classification accuracies of the 20 states of the index finger and the thumb are 96.92% and 83.58%, respectively. Moreover, four hand gestures are selected and tested using the measurements of the thumb and the index finger. All gestures are correctly recognized. This work achieves accurate finger state recognition without using additional active sensors on the fingers, which largely preserves the finger flexibility. It has potential applications in finger tracking and manipulator monitoring.

Transferring Interference into Reference: A Finger-input Approach Using Acoustic Signals

Device-Free and Training-Free Hand Gesture Recognition with Acoustic Signal

Ipand: Accurate Gesture Input with Ambient Acoustic Sensing on Hand.

Poster - Sonicnect: Accurate Hands-Free Gesture Input System With Smart Acoustic Sensing

HCI on the Table: Robust Gesture Recognition Using Acoustic Sensing in Your Hand

3D Intuitive Gesture Interaction via Motion Sensing

Airfinger: Micro Finger Gesture Recognition Via NIR Light Sensing for Smart Devices

Device-Free Gesture Tracking Using Acoustic Signals

SpeciFingers: Finger Identification and Error Correction on Capacitive Touchscreens

SignID: Acoustic-based Identification with Single Sign Gesture

WiMorse: A Contactless Morse Code Text Input System Using Ambient WiFi Signals

HeadText: Exploring Hands-free Text Entry Using Head Gestures by Motion Sensing on a Smart Earpiece

ALTo: Ad Hoc High-Accuracy Touch Interaction Using Acoustic Localization

Finger Gesture Recognition Based on Wireless Coupling Resonance

Decoding Silent Speech Commands from Articulatory Movements Through Soft Magnetic Skin and Machine Learning

WiFinger

Training-Free Acoustic-Based Hand Gesture Tracking on Smart Speakers

Multi-Touch in the Air: Concurrent Micromovement Recognition Using RF Signals.

Noncontact human-machine interaction for air-writing with ultrasound technology

SoundWrite II: Ambient Acoustic Sensing for Noise Tolerant Device-Free Gesture Recognition

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing