Abstract:Dynamic hand gesture is an emerging and promising biometric trait. It contains both physiological and behavioral characteristics, which on the one hand can theoretically make authentication systems more accurate and more secure, and on the other hand can increase the difficulty of model design because it is essentially a fine-grained video understanding task. For authentication systems, equal error rate (EER) and real-time performance are two vital metrics. Current video understanding-based hand gesture authentication methods mainly focus on lowering the EER while neglecting to reduce the computational cost. In this paper, we propose a 2D CNN-based depthwise temporal non-local network (DwTNL-Net) that can take into account both EER and running efficiency. To enable the DwTNL-Net with spatiotemporal information processing capability, we design a temporal sharpening (TS) module and a DwTNL module for short- and long-term identity feature modeling, respectively. The TS module can assist the backbone in local behavioral characteristic understanding and can simultaneously reduce redundant information and highlight behavioral cues while retaining sufficient physiological characteristics. In contrast, the DwTNL module focuses on summarizing global information and discovering stable patterns, which are finally used for local information enhancement. The complementary combination of our TS and DwTNL modules makes DwTNL-Net achieve substantial performance improvements. Extensive experiments on the SCUT-DHGA dataset and sufficient statistical analyses fully demonstrate the superiority and efficiency of our DwTNL-Net. The code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/SCUT-BIP-Lab/DwTNL-Net</uri> .

A Fast Pen Gesture Matching Method Based on Nonlinear Embedding

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

A real-time hand gesture recognition method

Learning a compact embedding for fine-grained few-shot static gesture recognition

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Embedded Gesture Detection Algorithm Based on Convolutional Neural Network

Depthwise Temporal Non-Local Network for Faster and Better Dynamic Hand Gesture Authentication

A novel shape matching descriptor for real-time hand gesture recognition

Gesture Recognition Using Enhanced Depth Motion Map and Static Pose Map

Novel Algorithm for Hand Gesture Recognition Utilizing a Wrist-Worn Inertial Sensor

Dynamic gesture recognition based on 2D convolutional neural network and feature fusion

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

TDS-Net: Towards Fast Dynamic Random Hand Gesture Authentication via Temporal Difference Symbiotic Neural Network

FastHand: Fast monocular hand pose estimation on embedded systems

A New Iterative Synthetic Data Generation Method for CNN Based Stroke Gesture Recognition

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

A Simple and Fast Representation-Based Face Recognition Method

A novel art gesture recognition model based on two channel region-based convolution neural network for explainable human-computer interaction understanding

Long-Distance Gesture Recognition using Dynamic Neural Networks

Fast and Expressive Gesture Recognition using a Combination-Homomorphic Electromyogram Encoder