Abstract:Background Electroencephalogram-based brain–computer interfaces (BCIs) represent novel human machine interactive technology that allows people to communicate and interact with the external world without relying on their peripheral muscles and nervous system. Among BCI systems, brain-actuated wheelchairs are promising systems for the rehabilitation of severely motor disabled individuals who are unable to control a wheelchair by conventional interfaces. Previous related studies realized the easy use of brain-actuated wheelchairs that enable people to navigate the wheelchair through simple commands; however, these systems rely on offline calibration of the environment. Other systems do not rely on any prior knowledge; however, the control of the system is time consuming. In this paper, we have proposed an improved mobile platform structure equipped with an omnidirectional wheelchair, a lightweight robotic arm, a target recognition module and an auto-control module. Based on the you only look once (YOLO) algorithm, our system can, in real time, recognize and locate the targets in the environment, and the users confirm one target through a P300-based BCI. An expert system plans a proper solution for a specific target; for example, the planned solution for a door is opening the door and then passing through it, and the auto-control system then jointly controls the wheelchair and robotic arm to complete the operation. During the task execution, the target is also tracked by using an image tracking technique. Thus, we have formed an easy-to-use system that can provide accurate services to satisfy user requirements, and this system can accommodate different environments. Results To validate and evaluate our system, an experiment simulating the daily application was performed. The tasks included the user driving the system closer to a walking man and having a conversation with him; going to another room through a door; and picking up a bottle of water on the desk and drinking water. Three patients (cerebral infarction; spinal injury; and stroke) and four healthy subjects participated in the test and all completed the tasks. Conclusion This article presents a brain-actuated smart wheelchair system. The system is intelligent in that it provides efficient and considerate services for users. To test the system, three patients and four healthy subjects were recruited to participate in a test. The results demonstrate that the system works smartly and efficiently; with this system, users only need to issue small commands to get considerate services. This system is of significance for accelerating the application of BCIs in the practical environment, especially for patients who will use a BCI for rehabilitation applications.

Microcontroller based voice-activated powered wheelchair control

Voice Controlled Wheelchair Based on a Tmega

Smart Autonomous Wheelchair Controlled by Voice Commands-Aided by Tracking System

Wheelchair Neuro Fuzzy Control and Tracking System Based on Voice Recognition

Human brain control of electric wheelchair with eye-blink electrooculogram signal

Voice-activated wheelchair: An affordable solution for individuals with physical disabilities

Flyingbuddy2: A Brain-Controlled Assistant For The Handicapped

Design and Development of Smart Wheelchair using Voice Recognition and Head Gesture Control System

Smart Wheelchair with Advanced Assistance and Governing System for Disabled

Control System Design of Mobility Scooter with Four In-Wheel Motors

Motorized Wheelchair with Bluetooth Control and Automatic Obstacle Avoidance

Novel Extension Control Instrument for Power Wheelchair Based on Kalman Filter Head Motion Detection

An Electric Wheelchair Manipulating System Using SSVEP-Based BCI System

Control of a Wheelchair-Mounted 6DOF Assistive Robot With Chin and Finger Joysticks

Speech Control System for Intelligent Wheelchair Based on SPCE061A

Towards BCI-actuated smart wheelchair system

Steering a Robotic Wheelchair Based on Voice Recognition System Using Convolutional Neural Networks

An Asynchronous Wheelchair Control by Hybrid EEG–EOG Brain–computer Interface

A Hybrid Brain Computer Interface System Based on the Neurophysiological Protocol and Brain-Actuated Switch for Wheelchair Control

Intelligent control of power wheelchairs

Model-based shared control approach for a power wheelchair driving assistance system using a force feedback joystick