Abstract:In this paper, we design a human computer interaction (HCI) system for the locked-in syndrome (LIS) patients which combines the eye movement signals and Electroencephalogram (EEG) signals. The LIS describes patients who are faced with the quadriplegia, aphonia and facial paralysis problems. However, they are still conscious, have the ability to hear and give a hint with the blink or eye movements. Thus, the LIS patients suffer great miseries due to the difficulty to communicate with the outside. This HCI system can help the LIS patients effectively communicate with the outside. Firstly, the system gets the subject's gaze point on the screen through the acquisition data of eye movement information, and obtains the button that the subject is focusing on. Then, the system confirms or cancels the button according to the classification results of the EEG signals. The computer can execute the commands of the corresponding button to bridge the communication between the subjects and the outside. When the subject stares at the screen unconsciously, the button will not respond because there is no confirmation of the EEG signals. The subject's eyes can be relaxed. The EEG signals are divided into two categories, and the classification results can be trained to reach a high classification accuracy (more than 90%). In the test, the average accuracy is about 80% in the case of using eye tracker alone. In the case of EEG, the average accuracy can reach more than 85%. The HCI system can realize some hardware control, simple voice interaction and typing with virtual keyboard. The system can make subjects communicate with the outside through the eye movement and EEG signals with high accuracy.

EyePhone: A mobile EOG-based Human-Computer Interface for assistive healthcare

Development of an Eog (Electro-Oculography) Based Human-Computer Interface

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Play games with eyes: A portable EOG based HCI system for game control

An Electro-oculography Based Human-computer Interaction System

Design of a Wearable Eye-Movement Detection System Based on Electrooculography Signals and Its Experimental Validation

A Virtual Keyboard Controlled By Eog

An Electrooculogram-Based Interaction Method and Its Music-on-Demand Application in a Virtual Reality Environment.

A Hands-free Human-Computer-Interface Platform for Paralyzed Patients Using a TENG-based Eyelash Motion Sensor

A novel eye movement detection algorithm for EOG driven human computer interface

Design and Implementation of Multimedia Control System Based on Bluetooth and Electrooculogram (EOG)

Accelerating eye movement research via accurate and affordable smartphone eye tracking

Eye Movement Signal Classification for Developing Human-Computer Interface Using Electrooculogram

Development of A Human Computer Interaction System Based on Multi-Modal Gaze Tracking Methods

An EOG-Based Human-Machine Interface to Control a Smart Home Environment for Patients With Severe Spinal Cord Injuries

Mathematical morphology based electro-oculography recognition algorithm for human-computer interaction

EOG-Based Eye Movement Classification and Application on HCI Baseball Game

An EMG-based wearable multifunctional Eye-control glass to control home appliances and communicate by voluntary blinks

EyeScreen： A Vision-Based Gesture Interaction System

Review of Electrooculography-Based Human-Computer Interaction: Recent Technologies, Challenges and Future Trends

Using Eye Gaze to Train an Adaptive Myoelectric Interface