Abstract:Background Electroencephalogram-based brain–computer interfaces (BCIs) represent novel human machine interactive technology that allows people to communicate and interact with the external world without relying on their peripheral muscles and nervous system. Among BCI systems, brain-actuated wheelchairs are promising systems for the rehabilitation of severely motor disabled individuals who are unable to control a wheelchair by conventional interfaces. Previous related studies realized the easy use of brain-actuated wheelchairs that enable people to navigate the wheelchair through simple commands; however, these systems rely on offline calibration of the environment. Other systems do not rely on any prior knowledge; however, the control of the system is time consuming. In this paper, we have proposed an improved mobile platform structure equipped with an omnidirectional wheelchair, a lightweight robotic arm, a target recognition module and an auto-control module. Based on the you only look once (YOLO) algorithm, our system can, in real time, recognize and locate the targets in the environment, and the users confirm one target through a P300-based BCI. An expert system plans a proper solution for a specific target; for example, the planned solution for a door is opening the door and then passing through it, and the auto-control system then jointly controls the wheelchair and robotic arm to complete the operation. During the task execution, the target is also tracked by using an image tracking technique. Thus, we have formed an easy-to-use system that can provide accurate services to satisfy user requirements, and this system can accommodate different environments. Results To validate and evaluate our system, an experiment simulating the daily application was performed. The tasks included the user driving the system closer to a walking man and having a conversation with him; going to another room through a door; and picking up a bottle of water on the desk and drinking water. Three patients (cerebral infarction; spinal injury; and stroke) and four healthy subjects participated in the test and all completed the tasks. Conclusion This article presents a brain-actuated smart wheelchair system. The system is intelligent in that it provides efficient and considerate services for users. To test the system, three patients and four healthy subjects were recruited to participate in a test. The results demonstrate that the system works smartly and efficiently; with this system, users only need to issue small commands to get considerate services. This system is of significance for accelerating the application of BCIs in the practical environment, especially for patients who will use a BCI for rehabilitation applications.

An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

A Brain-Computer Interface System for Smart Home Control Based on Single Trial Motor Imagery EEG

Evaluation And Application Of A Hybrid Brain Computer Interface For Real Wheelchair Parallel Control With Multi-Degree Of Freedom

An Asynchronous Wheelchair Control by Hybrid EEG–EOG Brain–computer Interface

Continuous Hybrid BCI Control for Robotic Arm Using Noninvasive Electroencephalogram, Computer Vision, and Eye Tracking

A Hybrid Brain Computer Interface System Based on the Neurophysiological Protocol and Brain-Actuated Switch for Wheelchair Control

A multi-modal brain-computer interface based on threshold discrimination and its application in wheelchair control

A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair.

A Hybrid BCI Based on SSVEP and EOG for Robotic Arm Control

Human brain control of electric wheelchair with eye-blink electrooculogram signal

An EEG/EMG/EOG-Based Multimodal Human-Machine Interface to Real-Time Control of a Soft Robot Hand.

An Adaptive Control Approach for Intelligent Wheelchair Based on BCI Combining with QoO.

Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module

An Eeg Based Control System for Intelligent Wheelchair

An EOG-based wheelchair robotic arm system for assisting patients with severe spinal cord injuries

A hybrid BCI combining SSVEP and EOG and its application for continuous wheelchair control

A shared robot control system combining augmented reality and motor imagery brain-computer interfaces with eye tracking

Vision-Based Robotic Manipulation of Intelligent Wheelchair with Human-Computer Shared Control

Towards BCI-actuated smart wheelchair system

Self-Paced Operation of a Wheelchair Based on a Hybrid Brain-Computer Interface Combining Motor Imagery and P300 Potential

SmartRolling: A Human–machine Interface for Wheelchair Control Using EEG and Smart Sensing Techniques