Abstract:Modeling the nonlinear dynamics of neuronal populations represents a key pursuit in computational neuroscience. Recent research has increasingly focused on jointly modeling neural activity and behavior to unravel their interconnections. Despite significant efforts, these approaches often necessitate either intricate model designs or oversimplified assumptions. Given the frequent absence of perfectly paired neural-behavioral datasets in real-world scenarios when deploying these models, a critical yet understudied research question emerges: how to develop a model that performs well using only neural activity as input at inference, while benefiting from the insights gained from behavioral signals during training? To this end, we propose BLEND, the behavior-guided neural population dynamics modeling framework via privileged knowledge distillation. By considering behavior as privileged information, we train a teacher model that takes both behavior observations (privileged features) and neural activities (regular features) as inputs. A student model is then distilled using only neural activity. Unlike existing methods, our framework is model-agnostic and avoids making strong assumptions about the relationship between behavior and neural activity. This allows BLEND to enhance existing neural dynamics modeling architectures without developing specialized models from scratch. Extensive experiments across neural population activity modeling and transcriptomic neuron identity prediction tasks demonstrate strong capabilities of BLEND, reporting over 50% improvement in behavioral decoding and over 15% improvement in transcriptomic neuron identity prediction after behavior-guided distillation. Furthermore, we empirically explore various behavior-guided distillation strategies within the BLEND framework and present a comprehensive analysis of effectiveness and implications for model performance.

What problem does this paper attempt to address?

### Problems the paper attempts to solve The paper aims to solve an important problem in neural dynamics modeling: how to develop a superior - performance model when only using neural activity as input during the inference stage, while taking advantage of the insights provided by behavioral signals during the training stage. Specifically, the paper attempts to answer the following key research questions: 1. **Differences in data availability**: In the real world, neural activity recordings and paired behavioral signals do not always co - exist. For example, in some studies, subjects may be in a resting state without performing a specific task or receiving external stimuli. In this case, there is a lack of clear time alignment between neural events and behavioral events. Therefore, how to construct an effective neural dynamics model in the absence of behavioral data is an urgent problem to be solved. 2. **Limitations of existing methods**: Existing joint - modeling methods either require complex designs or rely on overly simplified assumptions. These methods usually require specially - designed modules or complex training strategies to combine neural activity and behavioral information, which makes them difficult to be widely applied and may encounter difficulties in practical applications. 3. **Making full use of existing information**: How to maximize the use of existing neural - behavioral feature pairs (privileged - regular feature pairs) to enhance the network performance based on regular features (neural activity) is an important challenge in the field of neural dynamics modeling. To solve these problems, the paper proposes the BLEND framework (Behavior - guided neural population dynamics modeling via privileged knowledge distillation). This framework regards behavioral information as privileged information to guide the learning of the student model during the training stage, so that good performance can also be achieved when only using neural activity data during the inference stage. This method not only avoids strong assumptions about the relationship between behavior and neural activity, but also can be seamlessly integrated into existing neural dynamics modeling architectures without developing specialized models from scratch. ### Main contributions of the BLEND framework - **Simple and effective paradigm**: Based on the privileged knowledge distillation framework, BLEND introduces a new neural dynamics modeling paradigm, assuming that behavior can be an explicit guide for neural representation learning. - **Significant performance improvement**: Experimental results show that BLEND significantly outperforms baseline methods in tasks such as neural activity prediction, behavior decoding, and transcriptome neuron identity prediction, increasing the behavior - decoding performance by more than 50% and the neuron - identity - prediction performance by more than 15% respectively. - **Comprehensive analysis**: Through extensive analysis of different base models and privileged knowledge distillation strategies, the interaction mechanism between neural activity and behavior is revealed, showing that behavior - guided distillation not only improves model performance but also fundamentally enhances the quality of the learned neural representation. In conclusion, the BLEND framework provides a novel and effective method that can significantly improve the performance of neural dynamics models in the absence of behavioral data.

BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

Post-distillation Via Neural Resuscitation

Exploring Behavior-Relevant and Disentangled Neural Dynamics with Generative Diffusion Models

Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication

Distilling Multi-Scale Neural Mechanisms from Diverse Unlabeled Experimental Data Using Deep Domain-Adaptive Inference Framework

Adversarial Distillation for Learning with Privileged Provisions

Neural-to-Tree Policy Distillation with Policy Improvement Criterion

Fine-Grained Learning Behavior-Oriented Knowledge Distillation for Graph Neural Networks

Revisiting Knowledge Distillation: an Inheritance and Exploration Framework

Flexible Knowledge Distillation with an Evolutional Network Population

Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation

Reprogramming Distillation for Medical Foundation Models

Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones

Dynamic Knowledge Distillation for Pre-trained Language Models

Distilling dynamical knowledge from stochastic reaction networks

Transfer Heterogeneous Knowledge Among Peer-to-Peer Teammates: A Model Distillation Approach

Follow Your Path: A Progressive Method for Knowledge Distillation

Online Knowledge Distillation with Diverse Peers

Beyond Knowledge Distillation: Collaborative Learning for Bidirectional Model Assistance

Reinforced Multi-Teacher Selection for Knowledge Distillation