Cross-subject Mapping of Neural Activity with Restricted Boltzmann Machines

Haoming Yang,Marko Angjelichinoski,Suya Wu,Joy Putney,Simon Sponberg,Vahid Tarokh
DOI: https://doi.org/10.1101/2023.04.14.536854
2024-01-17
Abstract:Subject-to-subject variability is a common challenge in both generalizing models of neural data across subjects, discriminating subject-specific and inter-subject features in large neural datasets, and engineering neural interfaces with subject-specific tuning. We study the problem of the cross-subject mapping of neural activity. The objective is to obtain a task-specific representation of the target subject signal into the feature space of the source subject. We propose to use the Restricted Boltzmann Machine (RBM) with Gaussian inputs and Bernoulli hidden units; once trained over the entire set of subjects, the RBM allows the mapping of target features on source feature spaces using Gibbs sampling. We also consider a novel computationally efficient training technique for RBMs based on the minimization of the Fisher divergence, which allows the gradients of the RBM to be computed in closed form. Specifically, we test decoding performance on neuromuscular recordings of spike trains from the ten muscles that primarily control wing motion in an agile flying hawk moth, . The dataset consists of this comprehensive motor program recorded from nine subjects, each driven by six discrete visual stimuli. The evaluations show that the target features can be decoded using the source classifier with an accuracy of up to 95% when mapped using an RBM trained by Fisher divergence, showcasing the promising potential of the RBMs for cross-subject mapping applications.
Neuroscience
What problem does this paper attempt to address?