Abstract:Gesture recognition is key to enabling natural human-computer interactions. Existing approaches based on wireless sensing focus on accurate identification of arm gesture types. It remains a challenge to recognize and profile the details of arm gestures for precise interaction control. In addition, current approaches have strict positioning requirements between radars and users, making them difficult for real-world deployment. In this article, we adopt the multisensor approach and present gesture-radar-a dual Doppler radar-based gesture recognition and profiling system, which can capture subtle arm gestures with less positioning or environmental dependence. Gesture-radar uses two vertically placed Doppler radars to collect complementary sensing data of gestures, based on which cross-analysis can be performed for gesture recognition and profiling. Specifically, we first propose a two-stage classification model and enhance the signal proximity matching method by applying constraint functions to the DTW algorithm, aiming to improve the accuracy of gesture type recognition. Afterward, we establish and analyze unique features from the time-frequency spectrogram, which can be used to characterize in-depth gesture details, e.g., the angle or range of an arm movement. Experimental results show that gesture-radar achieves up to 93.5% average accuracy for gesture type recognition, and over 80% precision for profiling gesture details. This proves that the proposed approach is viable and can work in real-world environments.

Dynamic Hand Gesture Classification Based On Radar Micro-Doppler Signatures

Dynamic Hand Gesture Recognition Based on Micro-Doppler Radar Signatures Using Hidden Gauss–Markov Models

Hand Gesture Recognition for Smart Devices by Classifying Deterministic Doppler Signals

Sparsity-Based Dynamic Hand Gesture Recognition Using Micro-Doppler Signatures

Hand gesture recognition scheme based on millimeter-wave radar with convolutional neural network

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Sparsity Aware Dynamic Gesture Classification Using Dual-Band Radar

Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors

Effect of Sparsity‐aware Time–frequency Analysis on Dynamic Hand Gesture Classification with Radar Micro‐doppler Signatures

Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition.

Hand Gesture Recognition Based on Radar Micro-Doppler Signature Envelopes

Enhanced Hand Gesture Recognition Using Continuous Wave Interferometric Radar

Dynamic Hand Gesture Classification Based on Multistatic Radar Micro-Doppler Signatures Using Convolutional Neural Network

Gesture-Radar: A Dual Doppler Radar Based System for Robust Recognition and Quantitative Profiling of Human Gestures

Automatic Arm Gesture Recognition using Information Gleaned from Maximum Instantaneous Doppler Frequencies

Dynamic Hand Gesture Recognition Using FMCW Radar Sensor for Driving Assistance.

Clustering-Driven DGS-Based Micro-Doppler Feature Extraction for Automatic Dynamic Hand Gesture Recognition

Blind Separation of Doppler Human Gesture Signals Based on Continuous-Wave Radar Sensors

Recognition of dynamic hand gesture based on mm-wave fmcw radar micro-doppler signatures

Static Hand Gesture Recognition Based on 2-D SAR Imaging

Spectrum-Based Hand Gesture Recognition Using Millimeter-Wave Radar Parameter Measurements.