Abstract:Background: Hand gesture interfaces are dedicated programs that principally perform hand tracking and hand gesture prediction to provide alternative controls and interaction methods. They take advantage of one of the most natural ways of interaction and communication, proposing novel input and showing great potential in the field of the human-computer interaction. Developing a flexible and rich hand gesture interface is known to be a time-consuming and arduous task. Previously published studies have demonstrated the significance of the finite-state-machine (FSM) approach when mapping detected gestures to GUI actions. Methods: In our hand gesture interface, we broadened the FSM approach by utilizing gesture-specific attributes, such as distance between hands, distance from the camera, and time of occurrences, to enable users to perform unique GUI actions. These attributes are obtained from hand gestures detected by the RealSense SDK employed in our hand gesture interface. By means of these gesture-specific attributes, users can activate static gestures and perform them as dynamic gestures. We also provided supplementary features to enhance the efficiency, convenience, and user-friendliness of our hand gesture interface. Moreover, we developed a complementary application for recording hand gestures by capturing hand keypoints in depth and color images to facilitate the generation of hand gesture datasets. Results: We conducted a small-scale user survey with fifteen subjects to test and evaluate our hand gesture interface. Anonymous feedback obtained from the users indicates that our hand gesture interface is adequately facile and self-explanatory to use. In addition, we received constructive feedback about minor flaws regarding the responsiveness of the interface. Conclusions: We proposed a hand gesture interface along with key concepts to attain user-friendliness and effectiveness in the control of existing GUIs.

Lightweight Gesture Based Trigger-Action Programming for Home Internet-of-Things.

ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs with ChatGPT.

3D Intuitive Gesture Interaction via Motion Sensing

Motion-Based Perceptual User Interface

Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System

Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Making the Intelligent Home Smart Through Touch-Control Trigger-Action Programming

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Touch-driven Interaction Via an NFC-enabled Smartphone

Web-based Interactive Drone Control Using Hand Gesture

A Motion-based User Interface for the Control of Virtual Humans Performing Sports.

On Attaining User-Friendly Hand Gesture Interfaces to Control Existing GUIs.

ThumbUp: Secure Smartwatch Controller for Smart Homes using Simple Hand Gestures

GeeAir: Waving in the Air to Control Home Appliances

Multi-platform Application Interaction Extraction for IoT Devices

A Method to Recognize Dynamic Gestures on Edge Embedded Devices

ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs

A Real Time Wireless Interactive Multimedia System