Abstract:The development of human-computer interaction has seen a major change in the last few years, moving in the direction of more user-friendly and effective interfaces. This tendency has prompted researchers to investigate new input techniques, especially in the field of gesture-based control systems. By utilizing both hand and eye gestures to create a gesture-based virtual mouse and keyboard, this paper introduces a novel method of human-computer interaction. The suggested system offers users a smooth and simple way to interact with computers by combining hand gesture recognition and eye-tracking technology. Users can control cursor movement and keyboard inputs without the use of physical peripherals by using the system to track their hand and eye movements and interpret them as commands. The incorporation of eye-tracking technology improves the system's accuracy and responsiveness, enabling more precise cursor control and interaction with elements displayed on the screen. Hand gesture recognition, on the other hand, gives users an ergonomic and natural way to input data, allowing them to carry out commands with straightforward motions. The architecture of the system combines real-time processing capabilities to guarantee low latency and high responsiveness with sophisticated machine-learning algorithms for gesture recognition. Additionally, users can define their gesture commands according to their needs and preferences because the system is flexible and customizable. The suggested gesture-based virtual mouse and keyboard system has undergone rigorous testing and evaluation, and the results show promising performance and usability in a range of scenarios and applications. This novel method of interacting with computers has the potential to improve user experience, accessibility, and productivity in a variety of computing contexts. Keywords: Human-Computer Interaction, Gesture Recognition, Eye-Tracking

Adapted Computer Mouse for Cerebral Palsy Users

Mouth-controlled mouse for quadriplegic disabled people: System design and validation

Low-cost computer mouse for the elderly or disabled in Taiwan

Development of a Mouse for Individuals Without Upper Limbs Using Arduino Technology

A User-Friendly Packaging Solution for Silicon-Based Pressure Die to Develop Prosthetic Tactile Sensing

Continuous 2D Control Via State-Machine Triggered by Endogenous Sensory Discrimination and a Fast Brain Switch

Designing a Mouse for Disabilities Using the MPU-6050 Sensor with the Kalman Filter Method as a Noise Reducer

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

A Design Contribution to Ergonomic PC Mice Development

Evaluating Camera Mouse as a computer access system for augmentative and alternative communication in cerebral palsy: a case study

Intelligent HCI Device for Assistive Technology

Grasping and Attached Mode in Human-Computer Interaction in the Study of Mouse Substitution

Development of a computer assistive input device through a commercial numerical keyboard by position coding technology for people with disabilities

Head-mouse: A simple cursor controller based on optical measurement of head tilt

Improving mouse controlling and movement for people with Parkinson's disease and involuntary tremor using adaptive path smoothing technique via B-spline

Implementation of Gesture-Based Virtual Keyboard and Mouse

Integration of eye tracking and lip motion for hands-free computer access

Low-Cost Human-Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands

Optical Mouse Sensor for Eye Blink Detection and Pupil Tracking: Application in a Low-Cost Eye-Controlled Pointing Device

Horizontal and Vertical Handheld Pointing Devices Comparison for Increasing Human Systems Integration at the Design Stage

Auxilio and Beyond: Comparative Evaluation, Usability, and Design Guidelines for Head Movement-based Assistive Mouse Controllers