Abstract:Objective. This paper presents data-driven solutions to address two challenges in the problem of linking neural data and behavior: 1) unsupervised analysis of behavioral data and automatic label generation from behavioral observations, and 2) extraction of subject-invariant features for the development of generalized neural decoding models. Approach. For behavioral analysis and label generation, an unsupervised method, which employs an autoencoder to transform behavior data into a cluster-friendly feature space is presented. The model iteratively refines the assigned clusters with soft clustering assignment loss, and gradually improves the learned feature representations. To address subject variability in decoding neural activity, adversarial learning in combination with a long short-term memory-based adversarial variational autoencoder (LSTM-AVAE) model is employed. By using an adversary network to constrain the latent representations, the model captures shared information among subjects' neural activity, making it proper for cross-subject transfer learning. Main results. The proposed approach is evaluated using cortical recordings of Thy1-GCaMP6s transgenic mice obtained via widefield calcium imaging during a motivational licking behavioral experiment. The results show that the proposed model achieves an accuracy of 89.7% in cross-subject neural decoding, outperforming other well-known autoencoder-based feature learning models. These findings suggest that incorporating an adversary network eliminates subject dependency in representations, leading to improved cross-subject transfer learning performance, while also demonstrating the effectiveness of LSTM-based models in capturing the temporal dependencies within neural data. Significance. Results demonstrate the feasibility of the proposed framework in unsupervised clustering and label generation of behavioral data, as well as achieving high accuracy in cross-subject neural decoding, indicating its potentials for relating neural activity to behavior.

Transfer Learning in Brain-Computer Interfaces with Adversarial Variational Autoencoders

Semi-supervised Deep Learning in Motor Imagery-Based Brain-Computer Interfaces with Stacked Variational Autoencoder

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Unsupervised Multi-Source Variational Domain Adaptation for Inter-Subject SSVEP-based BCIs

Autoencoder-based Transfer Learning in Brain–computer Interface for Rehabilitation Robot

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network

Ensemble or pool: A comprehensive study on transfer learning for c-VEP BCI during interpersonal interaction

Confidence-Aware Subject-to-Subject Transfer Learning for Brain-Computer Interface

BLSAN: A Brain Lateralization-Guided Subject Adaptive Network for Motor Imagery Classification

DEEP TRANSFER LEARNING FOR EEG-BASED BRAIN COMPUTER INTERFACE

Domain Adaptive Algorithm Based on Multi-Manifold Embedded Distributed Alignment for Brain-Computer Interfaces

Adversarial Domain Adaptation for Stable Brain-Machine Interfaces

SCDAN: Learning Common Feature Representation of Brain Activation for Intersubject Motor Imagery EEG Decoding

Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs

An LSTM-based adversarial variational autoencoder framework for self-supervised neural decoding of behavioral choices

Toward calibration-free motor imagery brain-computer interfaces: a VGG-based convolutional neural network and WGAN approach

Joint multi-feature extraction and transfer learning in motor imagery brain computer interface

Decoding Movement Imagination and Execution from EEG Signals using BCI-Transfer Learning Method based on Relation Network

Improving brain computer interface performance by data augmentation with conditional Deep Convolutional Generative Adversarial Networks