Abstract:Robust segmentation of hands in a cluttered environment for hand gesture recognition has remained a challenge in computer vision. In this work, a two-stage gesture recognition framework is proposed. In the first stage, we segment hands using the proposed deep learning algorithm, and in the second stage, we use these segmented hands to classify gestures using a novel structurally incoherent nonnegative matrix factorization approach. We propose a new deep learning framework for hand segmentation called densely dilated U-Net. We exploit recently proposed dense blocks and dilated convolution layers in our work. To cope with the scarcity of labeled datasets we extend our densely dilated U-Net for semisupervised hand segmentation using hand bounding boxes as cues. We provide quantitative and qualitative evaluation of proposed hand segmentation model on several public hand segmentation datasets including EgoHands, GTEA, EYTH, EDSH, and HOF. Semisupervised segmentation results are also obtained on two hand detection datasets including VIVA and CVRR. As an extension of our work, we show semisupervised segmentation and gesture recognition results using segmented hands on NUS-II cluttered hand gesture dataset. To validate the efficiency of our semisupervised algorithm we evaluate it on OUHands dataset with real ground truth labels. For gesture classification, we propose a novel structurally incoherent nonnegative matrix factorization algorithm. We propose to use CNN features extracted from segmented images for nonnegative matrix factorization. Experimental results on NUS-II and OUHands datasets demonstrate that our two-stage approach for gesture recognition yields superior results.

Appearance-based Gesture recognition in the compressed domain

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

A real-time hand gesture recognition method

A Cascaded Timestamp-Free Event Camera Image Compression Method for Gesture Recognition

DNN-Compressed Domain Visual Recognition with Feature Adaptation

Face Recognition using Compressive Sensing

Gesture Recognition with a 3-D Accelerometer

Towards A Robust Face Recognition System Using Compressive Sensing

Dynamic Gesture Recognition—A Machine Vision Based Approach

Dynamic gesture recognition based on 2D convolutional neural network and feature fusion

Long-Distance Gesture Recognition using Dynamic Neural Networks

Distributed Spatiotemporal Gesture Recognition in Sensor Arrays

Real-Time Compressive Tracking

Online human gesture recognition from motion data streams.

Hand Segmentation With Dense Dilated U-Net and Structurally Incoherent Nonnegative Matrix Factorization-Based Gesture Recognition

Gesture Feature Extraction and Recognition Based on Image Processing

Hand Gesture Recognition with Multiscale Weighted Histogram of Contour Direction Normalization for Wearable Applications.

Image processing algorithms for gesture recognition using MATLAB

Hand gesture recognition algorithm combining hand-type adaptive algorithm and effective-area ratio for efficient edge computing

Image Recognition Based on Compressive Imaging and Optimal Feature Selection

Action recognition in compressed domains: A survey