Abstract:The technology of invasive Brain-Computer Interfaces (BCIs) has been developed in last decades, for its possibility to restore motor function of the disabilities. The main task of BCI system is to translate the cortical neural activities into commands of direct brain-controlled prosthetic devices. To study how cortical signals simultaneously recorded from primary motor cortex (M1) neurons were used for external devices control, invasive brain-machine interfaces in rat were investigated. In these experiments, rats were trained to control a relay to obtain water by pressing a lever over a pressure threshold. Microwire array was implanted in rat's motor cortex to record neural activities, and pressure was recorded by a pressure sensor. After spike detecting and sorting, totally 22-58 neurons were found in all 15 channels per rat (except the reference electrode in the array). To compute the firing rate of individual unit, the numbers of spikes in a time bin (Δt =100ms) were counted. Meanwhile, the pressure signal was also computed into bin size (Δt =100ms), by averaging pressure value in the bin period. After that some decoders were designed to make mapping between neural activities and pressure, such as Optimum Linear Estimation(OLE), Kalman filter (KF), and Kernel-Based Membership combined with Curve Fitting algorithm (KMCF). These decoders can be easily learned using a few minutes of training data and provides real-time estimates of hand position every 100ms given the firing rates of neurons in motor cortex. The performances of these decoders were evaluated by Correlation Coefficient (CC) between real and predictive pressure value. The results showed that the KMCF decoder performed best in these experiment, which had higher CC than others (CC=0.94). The higher CC indicated that the activity of motor cortex (M1) neurons can be used for detection of the corresponding movement states and estimation of continuous kinematic parameters. The rats could use - - their neural activities to directly control the relay and successfully get rewards after about one week of training. In further, with the development of the motor-related BCIs technology, BCIs will be possibly used to motor function restoration of paralytics and greatly rehabilitate their capacity of life. Furthermore, the experiment results provide insights into the nature of the neural coding of movement.

Diffusion model-based image generation from rat brain activity

Diffusion model-based image generation from rat brain activity

Real-time Decoding Algorithm in Brain Machine Interfaces

Guess What I Think: Streamlined EEG-to-Image Generation with Latent Diffusion Models

DreamDiffusion: Generating High-Quality Images from Brain EEG Signals

MindCeive: Perceiving human imagination using CNN-GRU and GANs

BrainDreamer: Reasoning-Coherent and Controllable Image Generation from EEG Brain Signals via Language Guidance

Decoding human brain activity with deep learning

NECOMIMI: Neural-Cognitive Multimodal EEG-informed Image Generation with Diffusion Models

Brain-machine interfaces researches in rats

Generating Music and Generative Art from Brain activity

Brain Captioning: Decoding human brain activity into images and text

Computational imaging with the human brain

Unidirectional brain-computer interface: Artificial neural network encoding natural images to fMRI response in the visual cortex

Decoding the Nonstationary Neural Activity in Motor Cortex for Brain Machine Interfaces

EEG2IMAGE: Image Reconstruction from EEG Brain Signals

UniBrain: Unify Image Reconstruction and Captioning All in One Diffusion Model from Human Brain Activity

Improving classification and reconstruction of imagined images from EEG signals

Text and image generation from intracranial electroencephalography using an embedding space for text and images

Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signals

Deep image reconstruction from human brain activity