Abstract:Gesture and fingertip are becoming more and more important mediums for human-computer interaction (HCI). Therefore, algorithms of gesture recognition and fingertip detection have been extensively investigated. However, problems mainly remain in how to achieve a win-win situation between speed and accuracy, and how to deal with complex interaction environment. To rectify these problems, this paper proposes an attention-based dual branches network that can efficiently fulfill both fingertip detection and gesture recognition tasks. In order to deal with complex interaction environment, we combine both channel-wise attention and spatial-wise attention into the fingertip detection model. The extensive experiments demonstrate that our novel model is both effective and efficient. In the experiment, our proposed model achieves the average fingertip detection error at around 2.8 pixels in 640×480 video frame, and the average recognition accuracy among eight gestures reaches $99%$. Moreover, the average forward time is about 8 ms. Due to the light-weight design, this model can also achieve high-efficiency performance on CPU. In addition, we design a virtual key system based on our proposed model, which can allow users to complete the "clicking" operation naturally in virtual environment. Our proposed system can perform well with a single normal RGB camera without any pre-processing (e.g., image segmentation or contour extraction), which can significantly reduce the complexity of the interaction system.

Optical Flow Based Finger Stroke Detection

Real-time Dynamic Gesture Recognition and Hand Servo Tracking Using PTZ Camera

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

Optical Flow Based Obstacle Detection in Static Environment

A Method of Hand Contour Tracking based on GVF, Corner and Optical flow

A new finger touch detection algorithm and prototype system architecture for pervasive bare-hand human computer interaction

Robust Fingertip Detection in a Complex Environment.

Robust Hand Detection and Tracking Based on Monocular Vision

An Improved Approach for Gesture Recognition

Hand Motion Recognition Based on a 3D Fingertip Detection Fusion Method

Attention Based Dual Branches Fingertip Detection Network and Virtual Key System

Design of hand gesture recognition system for human-computer interaction

Hand Gesture Interface Based on Improved Adaptive Hand Area Detection and Contour Signature

Human-Computer Interaction Using Fingertip Based on Kinect

Finger-stylus for non touch-enable systems

An Efficient Optical Flow Based Motion Detection Method for Non-stationary Scenes

Hand Tracking Algorithm Based on SuperPixels Feature

Fingertip Detection and Tracking Using 2D and 3D Information

Real Time Fingertip Detection with Kinect Depth Image Sequences.

Depth camera based hand gesture recognition and its applications in Human-Computer-Interaction

A New Method of Detecting Fingertip Touch for the Projector-Camera HCI System.