Abstract:As a form of body language, the gesture plays an important role in smart homes, game interactions, and sign language communication, etc. The gesture recognition methods have been carried out extensively. The existing methods have inherent limitations regarding user experience, visual environment, and recognition granularity. Millimeter wave radar provides an effective method for the problems lie ahead gesture recognition because of the advantage of considerable bandwidth and high precision perception. Interfering factors and the complexity of the model raise an enormous challenge to the practical application of gesture recognition methods as the millimeter wave radar is applied to complex scenes. Based on multi-feature fusion, a gesture recognition method for complex scenes is proposed in this work. We collected data in variety places to improve sample reliability, filtered clutters to improve the signal's signal-to-noise ratio (SNR), and then obtained multi features involves range-time map (RTM), Doppler-time map (DTM) and angle-time map (ATM) and fused them to enhance the richness and expression ability of the features. A lightweight neural network model multi-CNN-LSTM is designed to gestures recognition. This model consists of three convolutional neural network (CNN) for three obtained features and one long short-term memory (LSTM) for temporal features. We analyzed the performance and complexity of the model and verified the effectiveness of feature extraction. Numerous experiments have shown that this method has generalization ability, adaptability, and high robustness in complex scenarios. The recognition accuracy of 14 experimental gestures reached 97.28%.

Micro-motion Gesture Recognition Based on Multi-channel Frequency Modulated Continuous Wave Millimeter Wave Radar

Hand gesture recognition scheme based on millimeter-wave radar with convolutional neural network

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Micromotion Gesture Recognition Technology Based on Millimeter-wave Radar

Multidimensional Feature Representation and Learning for Robust Hand-Gesture Recognition on Commercial Millimeter-Wave Radar

An Attention-Enhanced Hand-Gesture Recognition Method on Millimeter Wave Radar

Multi-Hand Gesture Separation and Recognition Using Millimeter-wave Radar

A Multi-feature Fusion Temporal Neural Network for Multi-hand Gesture Recognition Using Millimeter-wave Radar Sensor

Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors

Lightweight Micro-Motion Gesture Recognition Based on MIMO Millimeter Wave Radar Using Bidirectional-GRU Network

Micro Gesture Recognition with Terahertz Radar Based on Diagonal Profile of Range-Doppler Map.

Gesture Recognition in Millimeter-Wave Radar Based on Spatio-Temporal Feature Sequences

Millimeter wave gesture recognition using multi-feature fusion models in complex scenes

Temporal-Range-Doppler Features Interpretation And Recognition Of Hand Gestures Using Mmw Fmcw Radar Sensors

Recognition of dynamic hand gesture based on mm-wave fmcw radar micro-doppler signatures

High-Accuracy Gesture Recognition Using Mm-Wave Radar Based on Convolutional Block Attention Module

Gesture Recognition with Multi-dimensional Parameter Using FMCW Radar

Long-Range Gesture Recognition Using Millimeter Wave Radar

A Low-Complexity Hand Gesture Recognition Framework via Dual mmWave FMCW Radar System

Two-Stream Time Sequential Network Based Hand Gesture Recognition Method Using Radar Sensor

Research on hand gesture recognition based on millimeter wave radar