Tyrosine hydroxylase-like immunoreactivity is distributed in the matrix compartment of normal human and Huntington's disease striatum

R. Ferrante,N. Kowall

DOI: https://doi.org/10.1016/0006-8993(87)91506-X

IF: 3.61

1987-07-21

Brain Research

Abstract:

What problem does this paper attempt to address?

Continuous Tracking using Deep Learning-based Decoding for Non-invasive Brain-Computer Interface

Dylan Forenzo,Hao Zhu,Jenn Shanahan,Jaehyun Lim,Bin He

DOI: https://doi.org/10.1101/2023.10.12.562084

2024-04-25

Abstract:Brain-computer interfaces (BCI) using electroencephalography (EEG) provide a non-invasive method for users to interact with external devices without the need for muscle activation. While noninvasive BCIs have the potential to improve the quality of lives of healthy and motor impaired individuals, they currently have limited applications due to inconsistent performance and low degrees of freedom. In this study, we use deep learning (DL)-based decoders for online Continuous Pursuit (CP), a complex BCI task requiring the user to track an object in two-dimensional space. We developed a labeling system to use CP data for supervised learning, trained DL-based decoders based on two architectures, including a newly proposed adaptation of the PointNet architecture, and evaluated the performance over several online sessions. We rigorously evaluated the DL-based decoders in a total of 28 human participants, and found that the DL-based models improved throughout the sessions as more training data became available and significantly outperformed a traditional BCI decoder by the last session. We also performed additional experiments to test an implementation of transfer learning by pre-training models on data from other subjects, and mid-session training to reduce inter-session variability. The results from these experiments showed that pre-training did not significantly improve performance, but updating the models mid-session may have some benefit. Overall, these findings support the use of DL-based decoders for improving BCI performance in complex tasks like CP, which can expand the potential applications of BCI devices and help improve the quality of lives of healthy and motor-impaired individuals.

Bioengineering
Extracting Semantic-Dynamic Features for Long-Term Stable Brain Computer Interface.

Tao Fang,Qian Zheng,Yu Qi,Gang Pan

DOI: https://doi.org/10.1609/aaai.v37i5.25738

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Brain-computer Interface (BCI) builds a neural signal to the motor command pathway, which is a prerequisite for the realization of neural prosthetics. However, a long-term stable BCI suffers from the neural data drift across days while retraining the BCI decoder is expensive and restricts its application scenarios. Recent solutions of neural signal recalibration treat the continuous neural signals as discrete, which is less effective in temporal feature extraction. Inspired by the observation from biologists that low-dimensional dynamics could describe high-dimensional neural signals, we model the underlying neural dynamics and propose a semantic-dynamic feature that represents the semantics and dynamics in a shared feature space facilitating the BCI recalibration. Besides, we present the joint distribution alignment instead of the common used marginal alignment strategy, dealing with the various complex changes in neural data distribution. Our recalibration approach achieves state-of-the-art performance on the real neural data of two monkeys in both classification and regression tasks. Our approach is also evaluated on a simulated dataset, which indicates its robustness in dealing with various common causes of neural signal instability.
Meeting brain–computer interface user performance expectations using a deep neural network decoding framework

Michael A. Schwemmer,Nicholas D. Skomrock,Per B. Sederberg,Jordyn E. Ting,Gaurav Sharma,Marcia A. Bockbrader,David A. Friedenberg

DOI: https://doi.org/10.1038/s41591-018-0171-y

IF: 82.9

2018-09-24

Nature Medicine

Abstract:Brain–computer interface (BCI) neurotechnology has the potential to reduce disability associated with paralysis by translating neural activity into control of assistive devices1–9. Surveys of potential end-users have identified key BCI system features10–14, including high accuracy, minimal daily setup, rapid response times, and multifunctionality. These performance characteristics are primarily influenced by the BCI’s neural decoding algorithm1,15, which is trained to associate neural activation patterns with intended user actions. Here, we introduce a new deep neural network16 decoding framework for BCI systems enabling discrete movements that addresses these four key performance characteristics. Using intracortical data from a participant with tetraplegia, we provide offline results demonstrating that our decoder is highly accurate, sustains this performance beyond a year without explicit daily retraining by combining it with an unsupervised updating procedure3,17–20, responds faster than competing methods8, and can increase functionality with minimal retraining by using a technique known as transfer learning21. We then show that our participant can use the decoder in real-time to reanimate his paralyzed forearm with functional electrical stimulation (FES), enabling accurate manipulation of three objects from the grasp and release test (GRT)22. These results demonstrate that deep neural network decoders can advance the clinical translation of BCI technology.

biochemistry & molecular biology,cell biology,medicine, research & experimental
Real-time Decoding Algorithm in Brain Machine Interfaces

Xiaoxiang Zheng,Qiaosheng Zhang,Shaomin Zhang,Yi Yu

DOI: https://doi.org/10.1109/iccme.2010.5558867

2010-01-01

Abstract:The technology of invasive Brain-Computer Interfaces (BCIs) has been developed in last decades, for its possibility to restore motor function of the disabilities. The main task of BCI system is to translate the cortical neural activities into commands of direct brain-controlled prosthetic devices. To study how cortical signals simultaneously recorded from primary motor cortex (M1) neurons were used for external devices control, invasive brain-machine interfaces in rat were investigated. In these experiments, rats were trained to control a relay to obtain water by pressing a lever over a pressure threshold. Microwire array was implanted in rat's motor cortex to record neural activities, and pressure was recorded by a pressure sensor. After spike detecting and sorting, totally 22-58 neurons were found in all 15 channels per rat (except the reference electrode in the array). To compute the firing rate of individual unit, the numbers of spikes in a time bin (Δt =100ms) were counted. Meanwhile, the pressure signal was also computed into bin size (Δt =100ms), by averaging pressure value in the bin period. After that some decoders were designed to make mapping between neural activities and pressure, such as Optimum Linear Estimation(OLE), Kalman filter (KF), and Kernel-Based Membership combined with Curve Fitting algorithm (KMCF). These decoders can be easily learned using a few minutes of training data and provides real-time estimates of hand position every 100ms given the firing rates of neurons in motor cortex. The performances of these decoders were evaluated by Correlation Coefficient (CC) between real and predictive pressure value. The results showed that the KMCF decoder performed best in these experiment, which had higher CC than others (CC=0.94). The higher CC indicated that the activity of motor cortex (M1) neurons can be used for detection of the corresponding movement states and estimation of continuous kinematic parameters. The rats could use - - their neural activities to directly control the relay and successfully get rewards after about one week of training. In further, with the development of the motor-related BCIs technology, BCIs will be possibly used to motor function restoration of paralytics and greatly rehabilitate their capacity of life. Furthermore, the experiment results provide insights into the nature of the neural coding of movement.
Tracking Neural Modulation Depth by Dual Sequential Monte Carlo Estimation on Point Processes for Brain–Machine Interfaces

Yiwen Wang,Xiwei She,Yuxi Liao,Hongbao Li,Qiaosheng Zhang,Shaomin Zhang,Xiaoxiang Zheng,Jose Principe

DOI: https://doi.org/10.1109/tbme.2015.2500585

IF: 4.6

2016-01-01

IEEE Transactions on Biomedical Engineering

Abstract:Classic brain-machine interface (BMI) approaches decode neural signals from the brain responsible for achieving specific motor movements, which subsequently command prosthetic devices. Brain activities adaptively change during the control of the neuroprosthesis in BMIs, where the alteration of the preferred direction and the modulation of the gain depth are observed. The static neural tuning models have been limited by fixed codes, resulting in a decay of decoding performance over the course of the movement and subsequent instability in motor performance. To achieve stable performance, we propose a dual sequential Monte Carlo adaptive point process method, which models and decodes the gradually changing modulation depth of individual neuron over the course of a movement. We use multichannel neural spike trains from the primary motor cortex of a monkey trained to perform a target pursuit task using a joystick. Our results show that our computational approach successfully tracks the neural modulation depth over time with better goodness-of-fit than classic static neural tuning models, resulting in smaller errors between the true kinematics and the estimations in both simulated and real data. Our novel decoding approach suggests that the brain may employ such strategies to achieve stable motor output, i.e., plastic neural tuning is a feature of neural systems. BMI users may benefit from this adaptive algorithm to achieve more complex and controlled movement outcomes.
A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Hanwen Wang,Yu Qi,Lin Yao,Yueming Wang,Dario Farina,Gang Pan

DOI: https://doi.org/10.1109/tnnls.2023.3305621

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Brain-computer interfaces (BCIs) provide a direct pathway from the brain to external devices and have demonstrated great potential for assistive and rehabilitation technologies. Endogenous BCIs based on electroencephalogram (EEG) signals, such as motor imagery (MI) BCIs, can provide some level of control. However, mastering spontaneous BCI control requires the users to generate discriminative and stable brain signal patterns by imagery, which is challenging and is usually achieved over a very long training time (weeks/months). Here, we propose a human-machine joint learning framework to boost the learning process in endogenous BCIs, by guiding the user to generate brain signals toward an optimal distribution estimated by the decoder, given the historical brain signals of the user. To this end, we first model the human-machine joint learning process in a uniform formulation. Then a human-machine joint learning framework is proposed: 1) for the human side, we model the learning process in a sequential trial-and-error scenario and propose a novel "copy/new" feedback paradigm to help shape the signal generation of the subject toward the optimal distribution and 2) for the machine side, we propose a novel adaptive learning algorithm to learn an optimal signal distribution along with the subject's learning process. Specifically, the decoder reweighs the brain signals generated by the subject to focus more on "good" samples to cope with the learning process of the subject. Online and psuedo-online BCI experiments with 18 healthy subjects demonstrated the advantages of the proposed joint learning process over coadaptive approaches in both learning efficiency and effectiveness.
Design a Novel BCI for Neurorehabilitation Using Concurrent LFP and EEG Features: A Case Study

Zhao Feng,Yi Sun,Linze Qian,Yu Qi,Yueming Wang,Cuntai Guan,Yu Sun

DOI: https://doi.org/10.1109/TBME.2021.3115799

Abstract:Objective: Brain-computer interfaces (BCI) that enables people with severe motor disabilities to use their brain signals for direct control of objects have attracted increased interest in rehabilitation. To date, no study has investigated feasibility of the BCI framework incorporating both intracortical and scalp signals. Methods: Concurrent local field potential (LFP) from the hand-knob area and scalp EEG were recorded in a paraplegic patient undergoing a spike-based close-loop neurorehabilitation training. Based upon multimodal spatio-spectral feature extraction and Naïve Bayes classification, we developed, for the first time, a novel LFP-EEG-BCI for motor intention decoding. A transfer learning (TL) approach was employed to further improve the feasibility. The performance of the proposed LFP-EEG-BCI for four-class upper-limb motor intention decoding was assessed. Results: Using a decision fusion strategy, we showed that the LFP-EEG-BCI significantly (p 0.05) outperformed single modal BCI (LFP-BCI and EEG-BCI) in terms of decoding accuracy with the best performance achieved using regularized common spatial pattern features. Interrogation of feature characteristics revealed discriminative spatial and spectral patterns, which may lead to new insights for better understanding of brain dynamics during different motor imagery tasks and promote development of efficient decoding algorithms. Moreover, we showed that similar classification performance could be obtained with few training trials, therefore highlighting the efficacy of TL. Conclusion: The present findings demonstrated the superiority of the novel LFP-EEG-BCI in motor intention decoding. Significance: This work introduced a novel LFP-EEG-BCI that may lead to new directions for developing practical neurorehabilitation systems with high detection accuracy and multi-paradigm feasibility in clinical applications.
Kernel Reinforcement Learning-Assisted Adaptive Decoder Facilitates Stable and Continuous Brain Control Tasks

Xiang Zhang,Shuhang Chen,Yiwen Wang

DOI: https://doi.org/10.1109/tnsre.2023.3321756

IF: 4.9

2023-10-28

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Brain-Machine Interfaces (BMIs) assist paralyzed people to brain control (BC) the neuro-prosthesis continuously moving in space. During the BC process, the subject imagines the movement of the real limb and adapts the brain activity according to the sensory feedback. The neural adaptation in the closed-loop control results in complex and changing brain signals. Simultaneously, the decoder interprets the time-varying functional mapping between neural activity and continuous trajectory. It is crucial and challenging to accurately and adaptively track the mapping to help the subject accomplish the BC task with a stable performance. Existing Kalman Filter (KF) based decoders achieve continuous trajectory control by linearly interpreting neural firing observations into self-evolving prosthetic states. However, the linear neural-state mapping might not accurately reflect the movement intention of the subject. In this paper, we propose a novel method that allows subjects to achieve continuous brain control efficiently and stably. The proposed method incorporates a kernel reinforcement learning method into a state-observation model to decode the nonlinearly neural observation into a continuous trajectory state. The state transition function ensures the continuity of the prosthetic state. The kernel reinforcement learning allows the quick adaptation of the nonlinear neural-movement mapping during the BC process. The proposed method is tested in an online brain control reaching task for rats. Compared with KF, our method achieved more successful trials, faster response time, shorter inter-trial time, and remained stable over days. These results demonstrate that the proposed method is an efficient tool to assist subjects in brain control tasks.

engineering, biomedical,rehabilitation
Wilms tumor 1 expression in malignant gliomas and correlation of +KTS isoforms with p53 status.

A. Clark,Wagner G Dos Santos,J. McCready,M. Chen,Timothy Van Meter,J. Ware,Sharon B. Wolber,H. Fillmore,W. Broaddus

DOI: https://doi.org/10.3171/JNS-07/09/0586

IF: 5.408

2007-09-01

Journal of Neurosurgery

Abstract:OBJECT The WT1 gene is overexpressed in many types of human cancer. It has been demonstrated that Wilms tumor 1 (WT1) promotes tumor cell proliferation and survival in some cell lines by inhibiting p53-mediated apoptosis; however, this relationship has not been investigated in gliomas. The goal in this study was to characterize the expression pattern of WT1 in human gliomas and to determine if a correlation exists between WT1 expression and p53 status. METHODS The authors screened nine malignant glioma cell lines, 50 glioblastoma multiforme (GBM) samples, and 16 lower-grade glial tumors for WT1 expression. RESULTS Five of nine cell lines, 44 of 50 GBM samples, and 13 of 16 lower-grade gliomas expressed WT1 mRNA on reverse transcriptase polymerase chain reaction (PCR) analysis. Expression of WT1 was not detected in normal astrocytes. Two WT1 isoforms, +/+ and -/+, were expressed in the majority of these samples. Real-time PCR analysis of the GBM cell lines revealed that the level of WT1 mRNA ranged from 6.33 to 214.70 ng per ng 18S ribosomal RNA. The authors screened the GBM samples for p53 mutation by using PCR and single-stranded conformational polymorphism analysis, and they demonstrated an association between WT1 expression and p53 status. Tumors that contained wild-type p53 were significantly more likely to express WT1 than tumors that contained mutant p53. CONCLUSIONS The presence of WT1 in glioma cell lines and the majority of primary tumor samples and its absence in normal astrocytes support the suggestion that WT1 expression is important in glioma biology.
Quantized Attention-Gated Kernel Reinforcement Learning for Brain-Machine Interface Decoding.

Fang Wang,Yiwen Wang,Kai Xu,Hongbao Li,Yuxi Liao,Qiaosheng Zhang,Shaomin Zhang,Xiaoxiang Zheng,Jose C Principe

DOI: https://doi.org/10.1109/TNNLS.2015.2493079

IF: 14.255

2017-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Reinforcement learning (RL)-based decoders in brain-machine interfaces (BMIs) interpret dynamic neural activity without patients' real limb movements. In conventional RL, the goal state is selected by the user or defined by the physics of the problem, and the decoder finds an optimal policy essentially by assigning credit over time, which is normally very time-consuming. However, BMI tasks require...
Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface

Dongdong Zhang,Dong Cao,Haibo Chen

DOI: https://doi.org/10.48550/arXiv.1911.05661

IF: 4.729

2019-11-11

Signal Processing

Abstract:Brain computer interface (BCI) has been popular as a key approach to monitor our brains recent year. Mental states monitoring is one of the most important BCI applications and becomes increasingly accessible. However, the mental state prediction accuracy and generality through encephalogram (EEG) are not good enough for everyday use. Here in this paper we present a deep learning-based EEG decoding method to read mental states. We propose a novel 1D convolutional neural network with different filter lengths to capture different frequency bands information. To improve the prediction accuracy, we also used a resnet-like structure to train a relatively deep convolutional neural network to promote feature extraction. Compared with traditional ways of predictions such as KNN and SVM, we achieved a significantly better result with an accuracy of 96.40%. Also, in contrast with some already published open source deep neural network structures, our methods achieved the state of art prediction accuracy on a mental state recognition dataset. Our results demonstrate using only 1D convolution could extract the features of EEG and the possibility of mental state prediction using portable EEG devices.
A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

Xingchen Ran,Weidong Chen,Blaise Yvert,Shaomin Zhang

DOI: https://doi.org/10.1016/j.compbiomed.2022.105871

IF: 7.7

2022-01-01

Computers in Biology and Medicine

Abstract:OBJECTIVE:As the scale of neural recording increases, Brain-computer interfaces (BCIs) are restrained by high-dimensional neural features, so dimensionality reduction is required as a preprocess of neural features. In this context, we propose a novel framework based on deep learning to reduce the dimensionality of neural features that are typically extracted from electrocorticography (ECoG) or local field potential (LFP).APPROACH:A high-performance autoencoder was implemented by chaining convolutional layers to deal with spatial and frequency dimensions with bottleneck long short-term memory (LSTM) layers to deal with the temporal dimension of the features. Furthermore, this autoencoder is combined with a fully connected layer to regularize the training.MAIN RESULTS:By applying the proposed method to two different datasets, we found that this dimensionality reduction method largely outperforms kernel principal component analysis (KPCA), partial least square (PLS), preferential subspace identification (PSID), and latent factor analysis via dynamical systems (LFADS). Besides, the new features obtained by our method can be applied to various BCI decoders, without significant differences in decoding performance.SIGNIFICANCE:A novel method is proposed as a reliable tool for efficient dimensionality reduction of neural signals. Its high performance and robustness are promising to enhance the decoding accuracy and long-term stability of online BCI systems based on large-scale neural recordings.
Continuous and discrete decoding of overt speech with electroencephalography

Alexander Robert Craik,Heather Dial,Jose Luis Contreras-Vidal

DOI: https://doi.org/10.1101/2024.05.23.595510

2024-05-23

Abstract:Neurological disorders affecting speech production adversely impact quality of life for over 7 million individuals in the US. Traditional speech interfaces like eyetracking devices and P300 spellers are slow and unnatural for these patients. An alternative solution, speech Brain-Computer Interfaces (BCIs), directly decodes speech characteristics, offering a more natural communication mechanism. This research explores the feasibility of decoding speech features using non-invasive EEG. Nine neurologically intact participants were equipped with a 63-channel EEG system with additional sensors to eliminate eye artifacts. Participants read aloud sentences displayed on a screen selected for phonetic similarity to the English language. Deep learning models, including Convolutional Neural Networks and Recurrent Neural Networks with/without attention modules, were optimized with a focus on minimizing trainable parameters and utilizing small input window sizes. These models were employed for discrete and continuous speech decoding tasks, achieving above-chance participant-independent decoding performance for discrete classes and continuous characteristics of the produced audio signal. A frequency sub-band analysis highlighted the significance of certain frequency bands (delta, theta, and gamma) for decoding performance, and a perturbation analysis identified crucial channels. Assessed channel selection methods did not significantly improve performance, but they still outperformed chance levels, suggesting a distributed representation of speech information encoded in the EEG signals. Leave-One-Out training demonstrated the feasibility of utilizing common speech neural correlates, reducing data collection requirements from individual participants.

Neuroscience
Visual tracking brain computer interface

Changxing Huang,Nanlin Shi,Yining Miao,Xiaogang Chen,Yijun Wang,Xiaorong Gao

2023-11-21

Abstract:Brain-computer interfaces (BCIs) offer a way to interact with computers without relying on physical movements. Non-invasive electroencephalography (EEG)-based visual BCIs, known for efficient speed and calibration ease, face limitations in continuous tasks due to discrete stimulus design and decoding methods. To achieve continuous control, we implemented a novel spatial encoding stimulus paradigm and devised a corresponding projection method to enable continuous modulation of decoded velocity. Subsequently, we conducted experiments involving 17 participants and achieved Fitt's ITR of 0.55 bps for the fixed tracking task and 0.37 bps for the random tracking task. The proposed BCI with a high Fitt's ITR was then integrated into two applications, including painting and gaming. In conclusion, this study proposed a visual BCI-based control method to go beyond discrete commands, allowing natural continuous control based on neural activity.

Human-Computer Interaction,Artificial Intelligence,Systems and Control
Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

Alexander Craik,Heather R Dial,Jose L Contreras-Vidal

DOI: https://doi.org/10.1088/1741-2552/ad8d0a

IF: 5.043

2024-10-31

Journal of Neural Engineering

Abstract:Neurological disorders affecting speech production adversely impact quality of life for over 7 million individuals in the US. Traditional speech interfaces like eyetracking devices and P300 spellers are slow and unnatural for these patients. An alternative solution, speech Brain-Computer Interfaces (BCIs), directly decodes speech characteristics, offering a more natural communication mechanism. This research explores the feasibility of decoding speech features using non-invasive EEG. Nine neurologically intact participants were equipped with a 63-channel EEG system with additional sensors to eliminate eye artifacts. Participants read aloud sentences displayed on a screen selected for phonetic similarity to the English language. Deep learning models, including Convolutional Neural Networks and Recurrent Neural Networks with and without attention modules, were optimized with a focus on minimizing trainable parameters and utilizing small input window sizes for real-time application. These models were employed for discrete and continuous speech decoding tasks, achieving statistically significant participant-independent decoding performance for discrete classes and continuous characteristics of the produced audio signal. A frequency sub-band analysis highlighted the significance of certain frequency bands (delta, theta, and gamma) for decoding performance, and a perturbation analysis was used to identify crucial channels. Assessed channel selection methods did not significantly improve performance, suggesting a distributed representation of speech information encoded in the EEG signals. Leave-One-Out training demonstrated the feasibility of utilizing common speech neural correlates, reducing data collection requirements from individual participants.

engineering, biomedical,neurosciences
Translating Mental Imaginations into Characters with Codebooks and Dynamics-Enhanced Decoding

Jingyuan Li,Yansen Wang,Nie Lin,Dongsheng Li

2024-09-25

Abstract:Advancements in non-invasive electroencephalogram (EEG)-based Brain-Computer Interface (BCI) technology have enabled communication through brain activity, offering significant potential for individuals with motor impairments. Existing methods for decoding characters or words from EEG recordings either rely on continuous external stimulation for high decoding accuracy or depend on direct intention imagination, which suffers from reduced discrimination ability. To overcome these limitations, we introduce a novel EEG paradigm based on mental tasks that achieves high discrimination accuracy without external stimulation. Specifically, we propose a codebook in which each letter or number is associated with a unique code that integrates three mental tasks, interleaved with eye-open and eye-closed states. This approach allows individuals to internally reference characters without external stimuli while maintaining reasonable accuracy. For enhanced decoding performance, we apply a Temporal-Spatial-Latent-Dynamics (TSLD) network to capture latent dynamics of spatiotemporal EEG signals. Experimental results demonstrate the effectiveness of our proposed EEG paradigm which achieves five times higher accuracy over direct imagination. Additionally, the TSLD network improves baseline methods by approximately 8.5%. Further more, we observe consistent performance improvement throughout the data collection process, suggesting that the proposed paradigm has potential for further optimization with continued use.

Signal Processing
A Semi-Supervised Progressive Learning Algorithm for Brain–Computer Interface

Yuxuan Wei,Jie Li,Hongfei Ji,Lingjing Jin,Lingyu Liu,Zhongfei Bai,Chen Ye

DOI: https://doi.org/10.1109/tnsre.2022.3192448

IF: 4.9

2022-07-29

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Brain-computer interface (BCI) usually suffers from the problem of low recognition accuracy and large calibration time, especially when identifying motor imagery tasks for subjects with indistinct features and classifying fine grained motion control tasks by electroencephalogram (EEG)-electromyogram (EMG) fusion analysis. To fill the research gap, this paper presents an end-to-end semi-supervised learning framework for EEG classification and EEG–EMG fusion analysis. Benefiting from the proposed metric learning based label estimation strategy, sampling criterion and progressive learning scheme, the proposed framework efficiently extracts distinctive feature embedding from the unlabeled EEG samples and achieves a 5.40% improvement on BCI Competition IV Dataset IIa with 80% unlabeled samples and an average 3.35% improvement on two public BCI datasets. By employing synchronous EMG features as pseudo labels for the unlabeled EEG samples, the proposed framework further extracts deep level features of the synergistic complementarity between the EEG signals and EMG features based on the deep encoders, which improves the performance of hybrid BCI (with a 5.53% improvement for the Upper Limb Motion Dataset and an average 4.34% improvement on two hybrid datasets). Moreover, the ablation experiments show that the proposed framework can substantially improve the performance of the deep encoders (with an average 5.53% improvement). The proposed framework not only largely improves the performance of deep networks in the BCI system, but also significantly reduces the calibration time for EEG-EMG fusion analysis, which shows great potential for building an efficient and high-performance hybrid BCI for the motor rehabilitation process.

engineering, biomedical,rehabilitation
Adaptive LDA Classifier Enhances Real-Time Control of an EEG Brain–Computer Interface for Imagined-Syllables Decoding

Shizhe Wu,Kinkini Bhadra,Anne-Lise Giraud,Silvia Marchesotti

DOI: https://doi.org/10.3390/brainsci14030196

IF: 3.333

2024-02-22

Brain Sciences

Abstract:Brain-Computer Interfaces (BCIs) aim to establish a pathway between the brain and an external device without the involvement of the motor system, relying exclusively on neural signals. Such systems have the potential to provide a means of communication for patients who have lost the ability to speak due to a neurological disorder. Traditional methodologies for decoding imagined speech directly from brain signals often deploy static classifiers, that is, decoders that are computed once at the beginning of the experiment and remain unchanged throughout the BCI use. However, this approach might be inadequate to effectively handle the non-stationary nature of electroencephalography (EEG) signals and the learning that accompanies BCI use, as parameters are expected to change, and all the more in a real-time setting. To address this limitation, we developed an adaptive classifier that updates its parameters based on the incoming data in real time. We first identified optimal parameters (the update coefficient, UC) to be used in an adaptive Linear Discriminant Analysis (LDA) classifier, using a previously recorded EEG dataset, acquired while healthy participants controlled a binary BCI based on imagined syllable decoding. We subsequently tested the effectiveness of this optimization in a real-time BCI control setting. Twenty healthy participants performed two BCI control sessions based on the imagery of two syllables, using a static LDA and an adaptive LDA classifier, in randomized order. As hypothesized, the adaptive classifier led to better performances than the static one in this real-time BCI control task. Furthermore, the optimal parameters for the adaptive classifier were closely aligned in both datasets, acquired using the same syllable imagery task. These findings highlight the effectiveness and reliability of adaptive LDA classifiers for real-time imagined speech decoding. Such an improvement can shorten the training time and favor the development of multi-class BCIs, representing a clear interest for non-invasive systems notably characterized by low decoding accuracies.

neurosciences
An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding

Dichen,Haiyun Huang,Zijing Guan,Jiahui Pan,Yuanqing Li

DOI: https://doi.org/10.1109/TBME.2024.3404131

2024-05-23

Abstract:Attention decoding plays a vital role in daily life, where electroencephalography (EEG) has been widely involved. However, training a universally effective model for everyone is impractical due to substantial interindividual variability in EEG signals. To tackle the above challenge, we propose an end-to-end brain-computer interface (BCI) framework, including temporal and spatial one-dimensional (1D) convolutional neural network and domain-adversarial training strategy, namely DA-TSnet. Specifically, DA-TSnet extracts temporal and spatial features of EEG, while it is jointly supervised by task loss and domain loss. During training, DA-TSnet aims to maximize the domain loss while simultaneously minimizing the task loss. We conduct an offline analysis, simulate online experiments on a self-collected dataset of 85 subjects, and real online experiments on 22 subjects. Main results: DA-TSnet achieves a leave-one-subject-out (LOSO) cross-validation (CV) classification accuracy of 89.40% ± 9.96%, outperforming several state-of-the-art attention EEG decoding methods. In simulated online experiments, DA-TSnet achieves an outstanding accuracy of 88.07% ± 11.22%. In real online experiments, it achieves an average accuracy surpassing 86%. Significance: An end-to-end network framework does not rely on elaborate preprocessing and feature extraction steps, which saves time and human workload. Moreover, our framework utilizes domain-adversarial training neural network (DANN) to tackle the challenge posed by the high interindividual variability in EEG signals, which has significant reference value for handling other EEG signal decoding issues. Last, the performance of the DA-TSnet framework in offline and online experiments underscores its potential to facilitate more reliable applications.
Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface

Xuan Ma,Fabio Rizzoglio,Kevin L Bodkin,Lee E Miller

DOI: https://doi.org/10.1101/2024.09.09.612102

2024-09-13

Abstract:Objective. Creating an intracortical brain-computer interface (iBCI) capable of seamless transitions between tasks and contexts would greatly enhance user experience. However, the nonlinearity in neural activity presents challenges to computing a global iBCI decoder. We aimed to develop a method that differs from a globally optimized decoder to address this issue. Approach. We devised an unsupervised approach that relies on the structure of a low-dimensional neural manifold to implement a piecewise linear decoder. We created a distinctive dataset in which monkeys performed a diverse set of tasks, some trained, others innate, while we recorded neural signals from the motor cortex (M1) and electromyographs (EMGs) from upper limb muscles. We used both linear and nonlinear dimensionality reduction techniques to discover neural manifolds and applied unsupervised algorithms to identify clusters within those spaces. Finally, we fit a linear decoder of EMG for each cluster. A specific decoder was activated corresponding to the cluster each new neural data point belonged to. Main results. We found clusters in the neural manifolds corresponding with the different tasks or task sub-phases. The performance of piecewise decoding improved as the number of clusters increased and plateaued gradually. With only two clusters it already outperformed a global linear decoder, and unexpectedly, it outperformed even a global recurrent neural network (RNN) decoder with 10-12 clusters. Significance. This study introduced a computationally lightweight solution for creating iBCI decoders that can function effectively across a broad range of tasks. EMG decoding is particularly challenging, as muscle activity is used, under varying contexts, to control interaction forces and limb stiffness, as well as motion. The results suggest that a piecewise linear decoder can provide a good approximation to the nonlinearity between neural activity and motor outputs, a result of our increased understanding of the structure of neural manifolds in motor cortex.

Neuroscience

Tyrosine hydroxylase-like immunoreactivity is distributed in the matrix compartment of normal human and Huntington's disease striatum

Continuous Tracking using Deep Learning-based Decoding for Non-invasive Brain-Computer Interface

Extracting Semantic-Dynamic Features for Long-Term Stable Brain Computer Interface.

Meeting brain–computer interface user performance expectations using a deep neural network decoding framework

Real-time Decoding Algorithm in Brain Machine Interfaces

Tracking Neural Modulation Depth by Dual Sequential Monte Carlo Estimation on Point Processes for Brain–Machine Interfaces

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Design a Novel BCI for Neurorehabilitation Using Concurrent LFP and EEG Features: A Case Study

Kernel Reinforcement Learning-Assisted Adaptive Decoder Facilitates Stable and Continuous Brain Control Tasks

Wilms tumor 1 expression in malignant gliomas and correlation of +KTS isoforms with p53 status.

Quantized Attention-Gated Kernel Reinforcement Learning for Brain-Machine Interface Decoding.

Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

Continuous and discrete decoding of overt speech with electroencephalography

Visual tracking brain computer interface

Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

Translating Mental Imaginations into Characters with Codebooks and Dynamics-Enhanced Decoding

A Semi-Supervised Progressive Learning Algorithm for Brain–Computer Interface

Adaptive LDA Classifier Enhances Real-Time Control of an EEG Brain–Computer Interface for Imagined-Syllables Decoding

An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding

Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface