Abstract:Human-robot interaction is a rapidly developing field and robots have been taking more active roles in our daily lives. Patient care is one of the fields in which robots are becoming more present, especially for people with disabilities. People with neurodegenerative disorders might not consciously or voluntarily produce movements other than those involving the eyes or eyelids. In this context, Brain-Computer Interface (BCI) systems present an alternative way to communicate or interact with the external world. In order to improve the lives of people with disabilities, this paper presents a novel BCI to control an assistive robot with user's eye artifacts. In this study, eye artifacts that contaminate the electroencephalogram (EEG) signals are considered a valuable source of information thanks to their high signal-to-noise ratio and intentional generation. The proposed methodology detects eye artifacts from EEG signals through characteristic shapes that occur during the events. The lateral movements are distinguished by their ordered peak and valley formation and the opposite phase of the signals measured at F7 and F8 channels. This work, as far as the authors' knowledge, is the first method that used this behavior to detect lateral eye movements. For the blinks detection, a double-thresholding method is proposed by the authors to catch both weak blinks as well as regular ones, differentiating itself from the other algorithms in the literature that normally use only one threshold. Real-time detected events with their virtual time stamps are fed into a second algorithm, to further distinguish between double and quadruple blinks from single blinks occurrence frequency. After testing the algorithm offline and in realtime, the algorithm is implemented on the device. The created BCI was used to control an assistive robot through a graphical user interface. The validation experiments including 5 participants prove that the developed BCI is able to control the robot.

Blink and wink detection as a control tool in multimodal interaction

Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera

Detecting Eye Blink States by Tracking Iris and Eyelids.

Unsupervised Learning of Eye State Prototypes for Semantically Rich Blinking Detection

"Wink to grasp" - comparing eye, voice & EMG gesture control of grasp with soft-robotic gloves

Optical Mouse Sensor for Eye Blink Detection and Pupil Tracking: Application in a Low-Cost Eye-Controlled Pointing Device

Play games with eyes: A portable EOG based HCI system for game control

Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array

An Electro-oculography Based Human-computer Interaction System

An EMG-based wearable multifunctional Eye-control glass to control home appliances and communicate by voluntary blinks

Blink-sensing glasses: A flexible iontronic sensing wearable for continuous blink monitoring

An Intelligent Triboelectric Sensing System for Monitoring and Early Warning of Dry Eye Syndrome

A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear

Gesture Recognition using Reflected Visible and Infrared Light Wave Signals

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Trigger motion and interface optimization of an eye-controlled human-computer interaction system based on voluntary eye blinks

Adjusting eye aspect ratio for strong eye blink detection based on facial landmarks

Touchless short-wave infrared imaging for dynamic rapid pupillometry and gaze estimation in closed eyes

Hand Gesture Recognition through Reflected Infrared Light Wave Signals

Brain-computer interface for robot control with eye artifacts for assistive applications

Design and Realization of Eye Control System for Small Ground Unmanned Platform