Abstract:The development of human-computer interaction has seen a major change in the last few years, moving in the direction of more user-friendly and effective interfaces. This tendency has prompted researchers to investigate new input techniques, especially in the field of gesture-based control systems. By utilizing both hand and eye gestures to create a gesture-based virtual mouse and keyboard, this paper introduces a novel method of human-computer interaction. The suggested system offers users a smooth and simple way to interact with computers by combining hand gesture recognition and eye-tracking technology. Users can control cursor movement and keyboard inputs without the use of physical peripherals by using the system to track their hand and eye movements and interpret them as commands. The incorporation of eye-tracking technology improves the system's accuracy and responsiveness, enabling more precise cursor control and interaction with elements displayed on the screen. Hand gesture recognition, on the other hand, gives users an ergonomic and natural way to input data, allowing them to carry out commands with straightforward motions. The architecture of the system combines real-time processing capabilities to guarantee low latency and high responsiveness with sophisticated machine-learning algorithms for gesture recognition. Additionally, users can define their gesture commands according to their needs and preferences because the system is flexible and customizable. The suggested gesture-based virtual mouse and keyboard system has undergone rigorous testing and evaluation, and the results show promising performance and usability in a range of scenarios and applications. This novel method of interacting with computers has the potential to improve user experience, accessibility, and productivity in a variety of computing contexts. Keywords: Human-Computer Interaction, Gesture Recognition, Eye-Tracking

Inventions on GUI for Eye Cursor Controls Systems

Eye Ball Based Cursor Movement Control

Development of an Eog (Electro-Oculography) Based Human-Computer Interface

Control of Computer Peripherals using Human Eyes

An Electro-oculography Based Human-computer Interaction System

Inventions on GUI for Touch Sensitive Screens

Eye Tracking Based Control System for Natural Human-Computer Interaction

Gesture centric interaction: evaluating hand and head gestures in touchless cursor control

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

Implementation of Gesture-Based Virtual Keyboard and Mouse

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Play games with eyes: A portable EOG based HCI system for game control

A Comparison Of Gaze-Based And Gesture-Based Input For A Point-And-Click Task

Design of Eye-Controlled Mouse Based on Eye Tracking Technology

Eye movement tracking as a new promising modality for human computer interaction

Role of Eye Tracking in Human Computer Interaction

Eye-Tracker to Control Pointer Using Machine Learning

Eye Gaze Controlled Virtual Keyboard

Trigger motion and interface optimization of an eye-controlled human-computer interaction system based on voluntary eye blinks

Research on Position Advantage of Gaze Interactive Control in Eye Control System

Implementation of Eye Tracking with Webcam Images