Abstract:Inferring the connectivity of neural circuits from in vivo experimental data is essential for understanding the neural architectures that underpin behavior and cognition. However, advanced machine learning approaches in this domain, particularly deep learning, are significantly constrained by incomplete in vivo observations. This limitation restricts the ability to assign 'ground-truth' labels to in vivo data, compelling researchers to rely on synthetic data generated by biophysical neural models for initial training. Yet, this strategy introduces a widely perceived insurmountable challenge: 'model mismatch', where synthetic model dynamics fail to accurately match true neural dynamics. To tackle these interrelated challenges, we introduce DeepDAM (Deep Domain-Adaptive Matching), a robust, adaptive, and versatile framework that fundamentally transforms the training of deep neural networks (DNNs) for inference tasks using both synthetic data and unlabeled in vivo data. DeepDAM fine-tunes DNNs on a fusion of synthetic and unlabeled in vivo data, adaptively aligning the DNN's feature space with in vivo neural dynamics, thereby effectively mitigating the model mismatch challenge. Impressively, we validated the framework with extracellular recordings in the hippocampal CA1 region of freely behaving mice, which achieves an exemplary Matthews correlation coefficient of 0.97-1.0 in connectivity inference accuracy, significantly outperforming existing methods (~0.6-0.7). Importantly, our framework can well adapt to diverse experimental conditions and a broad spectrum of neural properties and scales, demonstrating its high generalizability across various in vivo and ex vivo scenarios. This marks a significant step towards the accurate and comprehensive reconstruction of functional mammalian brains using data-driven methodologies.

Extraction and Recovery of Spatio-Temporal Structure in Latent Dynamics Alignment with Diffusion Models

Extracting Semantic-Dynamic Features for Long-Term Stable Brain Computer Interface.

Neural Latent Aligner: Cross-trial Alignment for Learning Representations of Complex, Naturalistic Neural Data

Exploring Behavior-Relevant and Disentangled Neural Dynamics with Generative Diffusion Models

Functional Brain Connectivity Revealed by Sparse Coding of Large-Scale Local Field Potential Dynamics

Reconstructing Circuit Connectivity from in vivo Spike Trains Using Deep Domain-Adaptive Matching

Spatio-temporal Modeling of Connectome-Scale Brain Network Interactions Via Time-Evolving Graphs

Comparing high-dimensional neural recordings by aligning their low-dimensional latent representations

Towards a "universal translator" for neural dynamics at single-cell, single-spike resolution

Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention

DrDisco: Deep Registration for Distortion Correction of Diffusion MRI with single phase-encoding

Exploiting correlations across trials and behavioral sessions to improve neural decoding

Joint fMRI Decoding and Encoding with Latent Embedding Alignment

Graph-Based Decoding Model for Functional Alignment of Unaligned fMRI Data

Optimal Transport for Latent Integration with An Application to Heterogeneous Neuronal Activity Data

Modeling dynamic characteristics of brain functional connectivity networks using resting-state functional MRI

Latent Diffusion for Neural Spiking Data

NeuralDiffuser: Controllable fMRI Reconstruction with Primary Visual Feature Guided Diffusion

Latent Alignment with Deep Set EEG Decoders

Multi-Scale Spatio-Temporal Fusion with Adaptive Brain Topology Learning for Fmri Based Neural Decoding.