Abstract:Background: Hand gesture interfaces are dedicated programs that principally perform hand tracking and hand gesture prediction to provide alternative controls and interaction methods. They take advantage of one of the most natural ways of interaction and communication, proposing novel input and showing great potential in the field of the human-computer interaction. Developing a flexible and rich hand gesture interface is known to be a time-consuming and arduous task. Previously published studies have demonstrated the significance of the finite-state-machine (FSM) approach when mapping detected gestures to GUI actions. Methods: In our hand gesture interface, we broadened the FSM approach by utilizing gesture-specific attributes, such as distance between hands, distance from the camera, and time of occurrences, to enable users to perform unique GUI actions. These attributes are obtained from hand gestures detected by the RealSense SDK employed in our hand gesture interface. By means of these gesture-specific attributes, users can activate static gestures and perform them as dynamic gestures. We also provided supplementary features to enhance the efficiency, convenience, and user-friendliness of our hand gesture interface. Moreover, we developed a complementary application for recording hand gestures by capturing hand keypoints in depth and color images to facilitate the generation of hand gesture datasets. Results: We conducted a small-scale user survey with fifteen subjects to test and evaluate our hand gesture interface. Anonymous feedback obtained from the users indicates that our hand gesture interface is adequately facile and self-explanatory to use. In addition, we received constructive feedback about minor flaws regarding the responsiveness of the interface. Conclusions: We proposed a hand gesture interface along with key concepts to attain user-friendliness and effectiveness in the control of existing GUIs.

Advantage of multi-touch gesture application in digital interface of complex system

A Comparative Study of Map Exploration Interfaces for Multi-Touch Tabletops.

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

Promoted Motion-Sensing Gestural Interaction by Adapting to Group Users' Spatial Movements

The Influence of User-Tracking Feedback Format on Gestural Interaction's User Experience:A Kinect-Based Usability Study

3D Intuitive Gesture Interaction via Motion Sensing

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

[Spatial and Temporal Characteristic of Eye Movement in Human-Computer Interface Design].

Study on the Design of a Non-Contact Interaction System Using Gestures: Framework and Case Study

On Attaining User-Friendly Hand Gesture Interfaces to Control Existing GUIs.

Design and Development of a Gesture-Based Interaction System for Multi-Projector Tiled Display Wall

Gesture centric interaction: evaluating hand and head gestures in touchless cursor control

An interaction system using mixed hand gestures.

Eye Tracking Based Control System for Natural Human-Computer Interaction

Implementation of Gesture-Based Virtual Keyboard and Mouse

Motion-Based Perceptual User Interface

Interaction preferences of human body's natural gestures and gestures in smart Large displays scenarios

Trigger motion and interface optimization of an eye-controlled human-computer interaction system based on voluntary eye blinks

Integration of eye tracking and lip motion for hands-free computer access

A Study On Human Computer Interaction Based On Eye Tracking Technology

Research on click enhancement strategy of hand-eye dual-channel human-computer interaction system: Trade-off between sensing area and area cursor