Planar myocardial imaging in the baboon model with iodine-123-15-(iodophenyl)pentadecanoic acid (IPPA) and iodine-123-15-(P-iodophenyl)-3-R,S-methylpentadecanoic acid (BMIPP), using time-activity curves for evaluation of metabolism.

I. Dormehl,N. Hugo,D. Rossouw,A. White,L. Feinendegen

DOI: https://doi.org/10.1016/0969-8051(95)00015-P

IF: 2.947

1995-10-01

Nuclear Medicine and Biology

Abstract:

What problem does this paper attempt to address?

Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

Jianlong Li,Yiliang Liu,Wang Yuan,Zhijun Li

DOI: https://doi.org/10.1109/ICARM.2018.8610763

2018-01-01

Abstract:A brain-robot interface (BRI) based control system combined with the simultaneous localization and mapping (SLAM) has been developed to achieve the navigation and control of a mobile robot in unknown environments. The BRI system is based on motor imagery(MI), which analyze the human electroencephalograph (EEG) signals through the CSP-based SVM classification algorithm. The SLAM system presented in this paper is improved by combining the RGB-D SLAM, optical flow and deep leaning based Recognition. The optical flow method is used to accurately track the displacement of ORB feature points which consume much less time than calculating the ORB characteristics in each image, while the deep learning based recognition reduce the error caused by detected moving objects, and the error of the localization is minimized through global graph-based nonlinear error optimization. Experiments have been taken by 3 operators and successfully certify the feasibility and efficiency of the whole system.
Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Jianlong Li,Zhijun Li,Ying Feng,Yiliang Liu,Guangming Shi

DOI: https://doi.org/10.1109/tase.2019.2911667

IF: 6.636

2019-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:To achieve the better navigation performance of a mobile robot in the unknown environments, a novel human–robot hybrid system incorporating a motor-imagery (MI)-based brain teleoperation control is presented in this paper, where a deep-learning-based active perception is developed in the simultaneous localization and mapping (SLAM) framework. Using the deep-learning-based object recognition in the red–green–blue-depth (RGB-D) data acquisition process, the designed SLAM approach can select the valid feature points effectively, and the speed of displacement tracking can be improved by combining the oriented FAST and rotated BRIEF (ORB) SLAM algorithm with the optical flow method. The global trajectory map can also be mended using graph-based nonlinear error optimization. In addition, to build the connection between human intentions and the robot control commands flexibly in the developed mobile robot, a common spatial pattern (CSP)-based support vector machine (SVM) classification algorithm is proposed so that the control commands can be obtained directly from the human electroencephalograph (EEG) signals, which are preanalyzed and classified using the phenomena of event-related synchronization/desynchronization (ERS/ERD). Experiments involving several operators have verified the effectiveness of the proposed framework in the actual unstructured environments. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</italic> —This paper is motivated by the exploration of the mobile robots remotely controlled by the disables in an unstructured environment that includes some unknown moving objects in the background. In the conventional approaches, the image feedback and the brain–computer interface-based EEG signals invoked by the visual stimulus are used to guide the motion of the robots. In this paper, the MI of left or right hand is adopted as an input of the brain teleoperation system, and the EEG signals are classified into two categories representing two robot control commands through the designed algorithm. Besides, a deep-learning-based SLAM is designed to analyze the image and depth of the environmental information provided by the robot RGB-D sensor, and the results can be transferred into a 3-D map locating the robot and assisting the operator to understand the operating environment. It has been verified that the deep-learning-based SLAM presented is more efficient and robust than traditional SLAM. The feasibility of the system is demonstrated by a set of experiments in the corridor environment.
A brain-actuated robotic arm system using non-invasive hybrid brain–computer interface and shared control strategy

Linfeng Cao,Guangye Li,Yang Xu,Heng Zhang,Xiaokang Shu,Dingguo Zhang

DOI: https://doi.org/10.1088/1741-2552/abf8cb

IF: 5.043

2021-05-05

Journal of Neural Engineering

Abstract:Objective. The electroencephalography (EEG)-based brain–computer interfaces (BCIs) have been used in the control of robotic arms. The performance of non-invasive BCIs may not be satisfactory due to the poor quality of EEG signals, so the shared control strategies were tried as an alternative solution. However, most of the existing shared control methods set the arbitration rules manually, which highly depended on the specific tasks and developer's experience. In this study, we proposed a novel shared control model that automatically optimized the control commands in a dynamical way based on the context in real-time control. Besides, we employed the hybrid BCI to better allocate commands with multiple functions. The system allowed non-invasive BCI users to manipulate a robotic arm moving in a three-dimensional (3D) space and complete a pick-place task of multiple objects. Approach. Taking the scene information obtained by computer vision as a knowledge base, a machine agent was designed to infer the user's intention and generate automatic commands. Based on the inference confidence and user's characteristic, the proposed shared control model fused the machine autonomy and human intention dynamically for robotic arm motion optimization during the online control. In addition, we introduced a hybrid BCI scheme that applied steady-state visual evoked potentials and motor imagery to the divided primary and secondary BCI interfaces to better allocate the BCI resources (e.g. decoding computing power, screen occupation) and realize the multi-dimensional control of the robotic arm. Main results. Eleven subjects participated in the online experiments of picking and placing five objects that scattered at different positions in a 3D workspace. The results showed that most of the subjects could control the robotic arm to complete accurate and robust picking task with an average success rate of approximately 85% under the shared control strategy, while the average success rate of placing task controlled by pure BCI was 50% approximately. Significance. In this paper, we proposed a novel shared controller for motion automatic optimization, together with a hybrid BCI control scheme that allocated paradigms according to the importance of commands to realize multi-dimensional and effective control of a robotic arm. Our study indicated that the shared control strategy with hybrid BCI could greatly improve the performance of the brain-actuated robotic arm system.

engineering, biomedical,neurosciences
Continuous 2D Control Via State-Machine Triggered by Endogenous Sensory Discrimination and a Fast Brain Switch

Ren Xu,Strahinja Dosen,Ning Jiang,Lin Yao,Asma Farooq,Mads Jochumsen,Natalie Mrachacz-Kersting,Kim Dremstrup,Dario Farina

DOI: https://doi.org/10.1088/1741-2552/ab20e5

IF: 5.043

2019-01-01

Journal of Neural Engineering

Abstract:OBJECTIVE:Brain computer interfacing (BCI) is a promising method to control assistive systems for patients with severe disabilities. Recently, we have presented a novel BCI approach that combines an electrotactile menu and a brain switch, which allows the user to trigger many commands robustly and efficiently. However, the commands are timed to periodic tactile cues and this may challenge online control. In the present study, therefore, we implemented and evaluated a novel approach for online closed-loop control using the proposed BCI.APPROACH:Eleven healthy subjects used the novel method to move a cursor in a 2D space. To assure robust control with properly timed commands, the BCI was integrated within a state machine allowing the subject to start the cursor movement in the selected direction and asynchronously stop the cursor. The brain switch was controlled using motor execution (ME) or imagery (MI) and the menu implemented four (straight movements) or eight commands (straight and diagonal movements).MAIN RESULTS:The results showed a high completion rate of a target hitting task (~97% and ~92% for ME and MI, respectively), with a small number of collisions, when four-channel control was used. There was no significant difference in outcome measures between MI and ME, and performance was similar for four and eight commands.SIGNIFICANCE:These results demonstrate that the novel state-based scheme driven by a robust BCI can be successfully utilized for online control. Therefore, it can be an attractive solution for providing the user an online-control interface with many commands, which is difficult to achieve using classic BCI solutions.
The Brain-Inspired Cooperative Shared Control for Brain-Machine Interface

Shengjie Zheng,Ling Liu,Junjie Yang,Lang Qian,Gang Gao,Xin Chen,Wenqi Jin,Chunshan Deng,Xiaojian Li

DOI: https://doi.org/10.48550/arXiv.2210.09531

IF: 3.7

2022-10-18

Robotics

Abstract:In the practical application of brain-machine interface technology, the problem often faced is the low information content and high noise of the neural signals collected by the electrode and the difficulty of decoding by the decoder, which makes it difficult for the robotic to obtain stable instructions to complete the task. The idea based on the principle of cooperative shared control can be achieved by extracting general motor commands from brain activity, while the fine details of the movement can be hosted to the robot for completion, or the brain can have complete control. This study proposes a brain-machine interface shared control system based on spiking neural networks for robotic arm movement control and wheeled robots wheel speed control and steering, respectively. The former can reliably control the robotic arm to move to the destination position, while the latter controls the wheeled robots for object tracking and map generation. The results show that the shared control based on brain-inspired intelligence can perform some typical tasks in complex environments and positively improve the fluency and ease of use of brain-machine interaction, and also demonstrate the potential of this control method in clinical applications of brain-machine interfaces.
A Shared Control Policy for Center-out Movement Decoding in Motor Brain-machine Interface

Xi Chen,Yuxi Liao,Yiwen Wang,Shaomin Zhang,Qiaosheng Zhang,Xiaoxiang Zheng

DOI: https://doi.org/10.3182/20130902-3-cn-3020.00132

2013-01-01

IFAC Proceedings Volumes

Abstract:Brain-Machine Interface provides a new way to control the peripheral devices directly using signals from brain. However, because of the uncertainty and instability of brain signals, the decoding method cannot fulfill the demand of accurate control of the intended movement. We proposed a shared control policy to involve environmental information into the decoding process of brain signals. While the monkey manipulated the joystick in a center-out task, the trajectory was updated with a control signal that derived from current decoded kinematic information considering the potential targets. Our results showed that using the proposed method combined with the decoding process, the correlation coefficient between the predicted trajectory and the true signals increased by 17.4% in average. It indicated the control policy involved the environmental information could greatly improve the performance of motor brain machine interfaces in practice.
Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation

Xiaoyan Deng,Zhu Liang Yu,Canguang Lin,Zhenghui Gu,Yuanqing Li

DOI: https://doi.org/10.1088/1741-2552/ab937e

IF: 5.043

2020-07-13

Journal of Neural Engineering

Abstract:Objective. For the shared control systems, how to trade off the control weight between robot autonomy and human operator is an important issue, especially for BCI-based systems. However, most of existing shared controllers have paid less attention to the effects caused by subjects with different levels of brain control ability. Approach. In this paper, a brain state evaluation network, termed BSE-NET, is proposed to evaluate subjects' brain control ability online based on quantized attention-gated kernel reinforcement learning. With the output of BSE-NET (confidence score), a shared controller is designed to dynamically adjust the control weight between robot autonomy and human operator. Main results. The experimental results show that most of subjects achieved high and stable experimental success rate of approximately 90%. Furthermore, for subjects with different accuracy on EEG decoding, a proper confidence score can be dynamically generated to reflect their levels of brain control ability, and the proposed system can effectively adjust the control weight in all-time shared control. Significance. We discuss how our proposed method shows promise for BCI applications that can evaluate subjects' brain control ability online as well as provide a method for the research on self-adaptive shared control to adaptively balance control weight between subject's instruction and robot autonomy.

engineering, biomedical,neurosciences
A BCI-Based Motion Control System for Heterogeneous Robot Swarm

Zhen Huo,Tao Deng,Zhiyan Dong,Lihua Zhang,Lan Niu

DOI: https://doi.org/10.1109/ccis57298.2022.10016398

2022-01-01

Abstract:The study presents a method to construct a brain-computer interaction (BCI) motion control system that uses human brainwave signals to control the motion of different kinds of individuals in a heterogeneous robot swarm. Through establishing the BCI system based on Stable State Visual Evoked Potential (SSVEP), the virtual reality (VR) twin scene for monitoring the operating state and the external environment of robots and the heterogeneous robot swarm composed of unmanned drones and vehicles, the direct motion control of human brain wave signals on heterogeneous robot swarms is realized. The experimental results present that the subjects can apply the system to achieve motion control of a heterogeneous robot swarm in a simulated complex obstacle avoidance scenario with a 90% obstacle avoidance success rate. The system provides a new control method for traditional heterogeneous robot swarm motion systems, and also provides a new solution for how to deal with sophisticated and versatile application scenarios, which is significant for improving the system's perception capability, decision-making ability, and intelligence level.
Brain–Robot Interface-Based Navigation Control of a Mobile Robot in Corridor Environments

Yiliang Liu,Zhijun Li,Tong Zhang,Suna Zhao

DOI: https://doi.org/10.1109/tsmc.2018.2833857

2020-08-01

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Abstract:This paper proposes a brain–robot interface (BRI)-based control strategy in combination with the simultaneous localization and mapping (SLAM) to achieve the navigation and control of a mobile robot in uncertain environments. The BRI is based on steady state visually evoked potentials, utilizing the multivariate synchronization index classification algorithm to analyze the human electroencephalograph (EEG) signals in such a manner that human intentions can be recognized and motion commands can be produced for the brain controlled robot. The entire system is semi-autonomous since the navigation of mobile robot is commanded by the BRI, and the low-level motion of the mobile robot is autonomous with a designed kinematic controller. By utilizing vanishing points and door plates as the environmental features, a global metric map of the environment has been built by a sequential SLAM algorithm. The main contribution of this paper is the combination of an artificial potential field (APF) and the brain signals, which builds up the relationship between the strength of EEG signals and the intensity of the potential field. Through the proposed EEG-APF method, motion commands that would plan an obstacle-free trajectory in un-structured environments, can be obtained. The entire system has been tested with eight volunteer subjects, and all subjects are able to successfully fulfill manipulating mobile robot in the experiments.
Brain-Controlled 2D Navigation Robot Based on a Spatial Gradient Controller and Predictive Environmental Coordinator

Deyu Zhang,Siyu Liu,Jian Zhang,Guoqi Li,Dingjie Suo,Tiantian Liu,Jiawei Luo,Zhiyuan Ming,Jinglong Wu,Tianyi Yan

DOI: https://doi.org/10.1109/jbhi.2022.3219812

IF: 7.7

2022-12-01

IEEE Journal of Biomedical and Health Informatics

Abstract:OBJECTIVE: Brain-computer interfaces (BCIs) have been used in two-dimensional (2D) navigation robotic devices, such as brain-controlled wheelchairs and brain-controlled vehicles. However, contemporary BCI systems are driven by binary selective control. On the one hand, only directional information can be transferred from humans to machines, such as "turn left" or "turn right", which means that the quantified value, such as the radius of gyration, cannot be controlled. In this study, we proposed a spatial gradient BCI controller and corresponding environment coordinator, by which the quantified value of brain commands can be transferred in the form of a 2D vector, improving the flexibility, stability and efficiency of BCIs.METHODS: A horizontal array of steady-state visual stimulation was arranged to excite subject (EEG) signals. Covariance arrays between subjects' electroencephalogram (EEG) and stimulation features were mapped into quantified 2-dimensional vectors. The generated vectors were then inputted into the predictive controller and fused with virtual forces generated by the robot's predictive environment coordinator in the form of vector calculation. The resultant vector was then interpreted into the driving force for the robot, and real-time speed feedback was generated.RESULTS: The proposed SGC controller generated a faster (27.4 s vs. 34.9 s) response for the single-obstacle avoidance task than the selective control approach. In practical multiobstacle tasks, the proposed robot executed 39% faster in the target-reaching tasks than the selective controller and had better robustness in multiobstacle avoidance tasks (average failures significantly dropped from 27% to 4%).SIGNIFICANCE: This research proposes a new form of brain-machine shared control strategy that quantifies brain commands in the form of a 2-D control vector stream rather than selective constant values. Combined with a predictive environment coordinator, the brain-controlled strategy of the robot is optimized and provided with higher flexibility. The proposed controller can be used in brain-controlled 2D navigation devices, such as brain-controlled wheelchairs and vehicles.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
The Brain-Inspired Cooperative Shared Control Framework for Brain-Machine Interface

Junjie Yang,Ling Liu,Shengjie Zheng,Lang Qian,Gang Gao,Xin Chen,Xiaojian Li

2024-10-12

Abstract:In brain-machine interface (BMI) applications, a key challenge is the low information content and high noise level in neural signals, severely affecting stable robotic control. To address this challenge, we proposes a cooperative shared control framework based on brain-inspired intelligence, where control signals are decoded from neural activity, and the robot handles the fine control. This allows for a combination of flexible and adaptive interaction control between the robot and the brain, making intricate human-robot collaboration feasible. The proposed framework utilizes spiking neural networks (SNNs) for controlling robotic arm and wheel, including speed and steering. While full integration of the system remains a future goal, individual modules for robotic arm control, object tracking, and map generation have been successfully implemented. The framework is expected to significantly enhance the performance of BMI. In practical settings, the BMI with cooperative shared control, utilizing a brain-inspired algorithm, will greatly enhance the potential for clinical applications.

Robotics,Human-Computer Interaction,Systems and Control
Development of a humanoid robot control system based on AR-BCI and SLAM navigation

Yao Wang,Mingxing Zhang,Meng Li,Hongyan Cui,Xiaogang Chen

DOI: https://doi.org/10.1007/s11571-024-10122-z

2024-05-19

Cognitive Neurodynamics

Abstract:Brain-computer interface (BCI)-based robot combines BCI and robotics technology to realize the brain's intention to control the robot, which not only opens up a new way for the daily care of the disabled individuals, but also provides a new way of communication for normal people. However, the existing systems still have shortcomings in many aspects such as friendliness of human–computer interaction, and interaction efficient. This study developed a humanoid robot control system by integrating an augmented reality (AR)-based BCI with a simultaneous localization and mapping (SLAM)-based scheme for autonomous indoor navigation. An 8-target steady-state visual evoked potential (SSVEP)-based BCI was implemented to enable direct control of the humanoid robot by the user. A Microsoft HoloLens was utilized to display visual stimuli for eliciting SSVEPs. Filter bank canonical correlation analysis (FBCCA), a training-free method, was used to detect SSVEPs in this study. By leveraging SLAM technology, the proposed system alleviates the need for frequent control commands transmission from the user, thereby effectively reducing their workload. Online results from 12 healthy subjects showed this developed BCI system was able to select a command out of eight potential targets with an average accuracy of 94.79%. The autonomous navigation subsystem enabled the humanoid robot to autonomously navigate to a destination chosen utilizing the proposed BCI. Furthermore, all participants successfully completed the experimental task using the developed system without any prior training. These findings illustrate the feasibility of the developed system and its potential to contribute novel insights into humanoid robots control strategies.

neurosciences
Predictive Shared Control of Robotic Arms Using Simulated Brain-Computer Interface Inputs

Kirill Kokorin,Jing Mu,Sam E John,David B Grayden

DOI: https://doi.org/10.1109/EMBC40787.2023.10340222

Abstract:Low decoding accuracy makes brain-computer interface (BCI) control of a robotic arm difficult. Shared control (SC) can overcome limitations of a BCI by leveraging external sensor data and generating commands to assist the user. Our study explored whether reaching targets with a robot end-effector was easier using SC rather than direct control (DC). We simulated a motor imagery BCI using a joystick with noise introduced to explicitly control interface accuracy to be 65% or 79%. Compared to DC, our prediction-based implementation of SC led to a significant reduction in the trajectory length of successful reaches for 4 (3) out of 5 targets using the 65% (79%) accurate interface, with failure rates being equivalent to DC for 2 (1) out of 5 targets. Therefore, this implementation of SC is likely to improve reaching efficiency but at the cost of more failures. Additionally, the NASA Task Load Index results suggest SC reduced user workload.Clinical relevance-Shared control can minimise the impact of BCI decoder errors on robot motion, making robotic arm control using noninvasive BCIs more viable.
Minimal access surgery of ascending and proximal arch of the aorta: a 9-year experience.

M. Tabata,Z. Khalpey,S. Aranki,G. Couper,L. Cohn,P. Shekar

DOI: https://doi.org/10.1016/J.ATHORACSUR.2007.03.029

2007-07-01

Abstract:
A hybrid EEG-based BCI for robot grasp controlling

Wenchang Zhang,Fuchun Sun,Chunfang Liu,Weihua Su,Chuanqi Tan,Shaobo Liu

DOI: https://doi.org/10.1109/SMC.2017.8123134

2017-01-01

Abstract:Brain-Computer Interfaces (BCI) can help disable people to improve human — environment interaction and rehabilitation. Grasping objects with EEG-based BCI has become a popular and hard research in recent years due to the high degree of freedom robot and complex grasp planning. Unlike commonly used paradigms, we propose a pipeline of hybrid EEG-based BCI for robot grasping by shared control to solve the key problems including target object selection, robot intelligent planning and shared control by both user intension and robot. Six experimental users could successfully use the system to grasp a number of objects in a test scene. The results of grasping experiment demonstrate that our method achieve an effective performance.
A shared robot control system combining augmented reality and motor imagery brain-computer interfaces with eye tracking

Arnau Dillen,Mohsen Omidi,Fakhreddine Ghaffari,Bram Vanderborght,Bart Roelands,Olivier Romain,Ann Nowé,Kevin De Pauw

DOI: https://doi.org/10.1088/1741-2552/ad7f8d

IF: 5.043

2024-09-27

Journal of Neural Engineering

Abstract:Objective: Brain-computer interface (BCI) control systems monitor neural activity to detect the user's intentions, enabling device control through mental imagery. Despite their potential, decoding neural activity in real-world conditions poses significant challenges, making BCIs currently impractical compared to traditional interaction methods. This study introduces a novel motor imagery (MI) BCI control strategy for operating a physically assistive robotic arm, addressing the difficulties of MI decoding from electroencephalogram (EEG) signals, which are inherently non-stationary and vary across individuals. Approach: A proof-of-concept BCI control system was developed using commercially available hardware, integrating MI with eye tracking in an augmented reality (AR) user interface to facilitate a shared control approach. This system proposes actions based on the user's gaze, enabling selection through imagined movements. A user study was conducted to evaluate the system's usability, focusing on its effectiveness and efficiency. Main results: Participants performed tasks that simulated everyday activities with the robotic arm, demonstrating the shared control system's feasibility and practicality in real-world scenarios. Despite low online decoding performance (mean accuracy: 0.52 9, F1: 0.29, Cohen's Kappa: 0.12), participants achieved a mean success rate of 0.83 in the final phase of the user study when given 15 minutes to complete the evaluation tasks. The success rate dropped below 0.5 when a 5-minute cutoff time was selected. Significance: These results indicate that integrating AR and eye tracking can significantly enhance the usability of BCI systems, despite the complexities of MI-EEG decoding. While efficiency is still low, the effectiveness of our approach was verified. This suggests that BCI systems have the potential to become a viable interaction modality for everyday applications in the future.

engineering, biomedical,neurosciences
A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Lin Yao,Xinjun Sheng,Dingguo Zhang,Ning Jiang,Natalie Mrachacz-Kersting,Xiangyang Zhu,Dario Farina

DOI: https://doi.org/10.1109/tnsre.2017.2684084

IF: 4.9

2017-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Distinctive EEG signals from the motor and somatosensory cortex are generated during mental tasks of motor imagery (MI) and somatosensory attentional orientation (SAO). In this paper, we hypothesize that a combination of these two signal modalities provides improvements in a brain–computer interface (BCI) performance with respect to using the two methods separately, and generate novel types of multi-class BCI systems. Thirty two subjects were randomly divided into a Control-Group and a Hybrid-Group. In the Control-Group, the subjects performed left and right hand motor imagery (i.e., L-MI and R-MI). In the Hybrid-Group, the subjects performed the four mental tasks (i.e., L-MI, R-MI, L-SAO, and R-SAO). The results indicate that combining two of the tasks in a hybrid manner (such as L-SAO and R-MI) resulted in a significantly greater classification accuracy than when using two MI tasks. The hybrid modality reached 86.1% classification accuracy on average, with a 7.70% increase with respect to MI ( ${\mathrm {P}}<0.01$ ), and 7.21% to SAO ( ${\mathrm {P}}<0.01$ ) alone. Moreover, all 16 subjects in the hybrid modality reached at least 70% accuracy, which is considered the threshold for BCI illiteracy. In addition to the two-class results, the classification accuracy was 68.1% and 54.1% for the three-class and four-class hybrid BCI. Combining the induced brain signals from motor and somatosensory cortex, the proposed stimulus-independent hybrid BCI has shown improved performance with respect to individual modalities, reducing the portion of BCI-illiterate subjects, and provided novel types of multi-class BCIs.
An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

Qiyun Huang,Zhijun Zhang,Tianyou Yu,Shenghong He,Yuanqing Li

DOI: https://doi.org/10.3389/fnins.2019.01243

IF: 4.3

2019-11-22

Frontiers in Neuroscience

Abstract:Most existing brain-computer Interfaces (BCIs) are designed to control a single assistive device, such as a wheelchair, a robotic arm or a prosthetic limb. However, many daily tasks require combined functions which can only be realized by integrating multiple robotic devices. Such integration raises the requirement of the control accuracy and is more challenging to achieve a reliable control compared with the single device case. In this study, we propose a novel hybrid BCI with high accuracy based on electroencephalogram (EEG) and electrooculogram (EOG) to control an integrated wheelchair robotic arm system. The user turns the wheelchair left/right by performing left/right hand motor imagery (MI), and generates other commands for the wheelchair and the robotic arm by performing eye blinks and eyebrow raising movements. Twenty-two subjects participated in a MI training session and five of them completed a mobile self-drinking experiment, which was designed purposely with high accuracy requirements. The results demonstrated that the proposed hBCI could provide satisfied control accuracy for a system that consists of multiple robotic devices, and showed the potential of BCI-controlled systems to be applied in complex daily tasks.

neurosciences
Continuous Hybrid BCI Control for Robotic Arm Using Noninvasive Electroencephalogram, Computer Vision, and Eye Tracking

Baoguo Xu,Wenlong Li,Deping Liu,Kun Zhang,Minmin Miao,Guozheng Xu,Aiguo Song

DOI: https://doi.org/10.3390/math10040618

IF: 2.4

2022-02-17

Mathematics

Abstract:The controlling of robotic arms based on brain–computer interface (BCI) can revolutionize the quality of life and living conditions for individuals with physical disabilities. Invasive electroencephalography (EEG)-based BCI has been able to control multiple degrees of freedom (DOFs) robotic arms in three dimensions. However, it is still hard to control a multi-DOF robotic arm to reach and grasp the desired target accurately in complex three-dimensional (3D) space by a noninvasive system mainly due to the limitation of EEG decoding performance. In this study, we propose a noninvasive EEG-based BCI for a robotic arm control system that enables users to complete multitarget reach and grasp tasks and avoid obstacles by hybrid control. The results obtained from seven subjects demonstrated that motor imagery (MI) training could modulate brain rhythms, and six of them completed the online tasks using the hybrid-control-based robotic arm system. The proposed system shows effective performance due to the combination of MI-based EEG, computer vision, gaze detection, and partially autonomous guidance, which drastically improve the accuracy of online tasks and reduce the brain burden caused by long-term mental activities.

mathematics
Augmented-reality based brain-computer interface of robot control

Junying Hu

DOI: https://doi.org/10.1016/j.heliyon.2024.e26255

IF: 3.776

2024-02-20

Heliyon

Abstract:Brain Computer Interface (BCI) is a new approach to human-computer interaction. It can control the external devices directly with the brain without words and body movements. Brain-controlled robot is a major research area in the field of BCI, which organically integrates BCI with robotic systems to achieve safe and effective real-time control of robots using the user's electroencephalogram (EEG). Currently, there are two types of control methods for brain-controlled robots. One is direct control and the other is shared control. Direct brain control has its shortcomings, namely, low control efficiency and easy user fatigue. Shared control technique can effectively improve the control of brain-controlled robots and reduce the thinking ability of brain-controlled robots, thus making it the main control method of brain-controlled robots. The brain-computer collaborative control system based on augmented reality (AR) technology studied in this paper is a human-computer shared control method. In the experimental analysis of virtual reality (VR) systems and AR systems, this paper processes polylines through a series of control vertices with specific coordinates, using the relative distance measured between each point and the starting point as the relative coordinates, and calculates the operational errors of the two types of systems. In the system error of machining broken lines, when the relative coordinates are (10, 20), (40, 50), and (70, 80), the error values of the VR system are 0.17 mm, 0.36 mm, and 0.55 mm, respectively, while the error values of the AR system are 0.11 mm, 0.24 mm, and 0.41 mm, respectively. Therefore, the studies have illustrated the importance of AR systems for the study of brain-computer collaborative control of robots.

Planar myocardial imaging in the baboon model with iodine-123-15-(iodophenyl)pentadecanoic acid (IPPA) and iodine-123-15-(P-iodophenyl)-3-R,S-methylpentadecanoic acid (BMIPP), using time-activity curves for evaluation of metabolism.

Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

A brain-actuated robotic arm system using non-invasive hybrid brain–computer interface and shared control strategy

Continuous 2D Control Via State-Machine Triggered by Endogenous Sensory Discrimination and a Fast Brain Switch

The Brain-Inspired Cooperative Shared Control for Brain-Machine Interface

A Shared Control Policy for Center-out Movement Decoding in Motor Brain-machine Interface

Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation

A BCI-Based Motion Control System for Heterogeneous Robot Swarm

Brain–Robot Interface-Based Navigation Control of a Mobile Robot in Corridor Environments

Brain-Controlled 2D Navigation Robot Based on a Spatial Gradient Controller and Predictive Environmental Coordinator

The Brain-Inspired Cooperative Shared Control Framework for Brain-Machine Interface

Development of a humanoid robot control system based on AR-BCI and SLAM navigation

Predictive Shared Control of Robotic Arms Using Simulated Brain-Computer Interface Inputs

Minimal access surgery of ascending and proximal arch of the aorta: a 9-year experience.

A hybrid EEG-based BCI for robot grasp controlling

A shared robot control system combining augmented reality and motor imagery brain-computer interfaces with eye tracking

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

Continuous Hybrid BCI Control for Robotic Arm Using Noninvasive Electroencephalogram, Computer Vision, and Eye Tracking

Augmented-reality based brain-computer interface of robot control