Abstract:Vision-based dynamic gesture tracking and recognition has always been a difficult point in the field of computer vision. It involves multiple vision-related technologies and is an intersecting topic in multiple visual directions. The most critical dynamic gesture tracking technology and modeling recognition technology are still not mature and perfect. At present, dynamic gesture tracking technology is in the stage of transitioning from traditional tracking methods to deep learning tracking frameworks. The existing deep learning tracking frameworks are not well applicable to the visual target tracking with high degree of freedom and small space ratio such as gestures. On the other hand, it is difficult to establish an effective general gesture model for recognition due to the flexibility of dynamic gestures and complex motion processes. These problems propose a dynamic gesture recognition framework based on improved real-time multi-domain convolutional neural network tracking. The real-time multi-domain convolutional neural network is introduced to realize real-time gesture tracking, and an attention module is added to calibrate the spatial importance of features, which can clarify the discriminative area of the tracking target, and greatly improve the accuracy of gesture tracking. On this basis, the characteristics of gestures are fully considered, and the motion information, appearance information and time information of the gestures are used to establish the frame difference spatiotemporal graph model of the gestures. Finally, the deep learning network is used to recognize dynamic gestures. The CGD International Public Library of Gestures has achieved better recognition results, which offers a workable solution for dynamic gesture tracking and recognition in complex scenarios.

Gesture Tracking and Recognition Algorithm for Dynamic Human Motion Using Multimodal Deep Learning

Dynamic hand gesture recognition using hidden Markov models

Gesture Recognition Algorithm of Human Motion Target Based on Deep Neural Network

Dynamic gesture tracking and recognition algorithm based on deep learning

Dynamic Gesture Recognition Algorithm Based on 3D Convolutional Neural Network

Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

Dynamic gesture recognition based on 2D convolutional neural network and feature fusion

Gesture recognition based on deep deformable 3D convolutional neural networks

Gesture Recognition Method Based On Deep Learning

Dynamic Hand Gesture Recognition Using Motion Pattern and Shape Descriptors

Improved mKLT and low layered HG-CNN based dynamic gesture recognition hardware system

Dynamic Gesture Recognition Based On Multimodal Fusion Model

Spatial-temporal Dynamic Hand Gesture Recognition Via Hybrid Deep Learning Model

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

Gesture Recognition Algorithm Based on Lightweight 3DCNN Network

Computer vision-based dynamic gesture recognition method

Dynamic Hand Gesture Recognition Using Multi-direction 3D Convolutional Neural Networks

Human motion tracking and 3D motion track detection technology based on visual information features and machine learning

Research on Image Recognition Technology Based on Multimodal Deep Learning