Abstract:As a form of body language, the gesture plays an important role in smart homes, game interactions, and sign language communication, etc. The gesture recognition methods have been carried out extensively. The existing methods have inherent limitations regarding user experience, visual environment, and recognition granularity. Millimeter wave radar provides an effective method for the problems lie ahead gesture recognition because of the advantage of considerable bandwidth and high precision perception. Interfering factors and the complexity of the model raise an enormous challenge to the practical application of gesture recognition methods as the millimeter wave radar is applied to complex scenes. Based on multi-feature fusion, a gesture recognition method for complex scenes is proposed in this work. We collected data in variety places to improve sample reliability, filtered clutters to improve the signal's signal-to-noise ratio (SNR), and then obtained multi features involves range-time map (RTM), Doppler-time map (DTM) and angle-time map (ATM) and fused them to enhance the richness and expression ability of the features. A lightweight neural network model multi-CNN-LSTM is designed to gestures recognition. This model consists of three convolutional neural network (CNN) for three obtained features and one long short-term memory (LSTM) for temporal features. We analyzed the performance and complexity of the model and verified the effectiveness of feature extraction. Numerous experiments have shown that this method has generalization ability, adaptability, and high robustness in complex scenarios. The recognition accuracy of 14 experimental gestures reached 97.28%.

Multifeature Fusion-Based Hand Gesture Sensing and Recognition System

Hand gesture recognition scheme based on millimeter-wave radar with convolutional neural network

A Robust Hand Gesture Sensing and Recognition Based on Dual-Flow Fusion with FMCW Radar.

Multi-Hand Gesture Recognition Using Automotive FMCW Radar Sensor

A Multi-feature Fusion Temporal Neural Network for Multi-hand Gesture Recognition Using Millimeter-wave Radar Sensor

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Hand Gesture Recognition Method Using FMCW Radar Based on Multidomain Fusion

Multi-Hand Gesture Separation and Recognition Using Millimeter-wave Radar

A Lightweight Network With Multifeature Fusion for mmWave Radar-Based Hand Gesture Recognition

A Lightweight Network with Multi-Feature Fusion for Mmwave Radar Based Hand Gesture Recognition

A Novel Detection and Recognition Method for Continuous Hand Gesture Using FMCW Radar

A Dynamic Continuous Hand Gesture Detection and Recognition Method with FMCW Radar

Multidimensional Feature Representation and Learning for Robust Hand-Gesture Recognition on Commercial Millimeter-Wave Radar

Gesture Recognition with Feature Fusion Using FMCW Radar

A Low-Complexity Hand Gesture Recognition Framework via Dual mmWave FMCW Radar System

Two-Stream Time Sequential Network Based Hand Gesture Recognition Method Using Radar Sensor

A Multimodal Dynamic Hand Gesture Recognition Based on Radar–Vision Fusion

Two Dimensional Parameters Based Hand Gesture Recognition Algorithm For Fmcw Radar Systems

Millimeter wave gesture recognition using multi-feature fusion models in complex scenes

Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors

Gesture Recognition with Multi-dimensional Parameter Using FMCW Radar