Abstract:The human brain operates at multiple levels, from molecules to circuits, and understanding these complex processes requires integrated research efforts. Simulating biophysically-detailed neuron models is a computationally expensive but effective method for studying local neural circuits. Recent innovations have shown that artificial neural networks (ANNs) can accurately predict the behavior of these detailed models in terms of spikes, electrical potentials, and optical readouts. While these methods have the potential to accelerate large network simulations by several orders of magnitude compared to conventional differential equation based modelling, they currently only predict voltage outputs for the soma or a select few neuron compartments. Our novel approach, based on enhanced state-of-the-art architectures for multitask learning (MTL), allows for the simultaneous prediction of membrane potentials in each compartment of a neuron model, at a speed of up to two orders of magnitude faster than classical simulation methods. By predicting all membrane potentials together, our approach not only allows for comparison of model output with a wider range of experimental recordings (patch-electrode, voltage-sensitive dye imaging), it also provides the first stepping stone towards predicting local field potentials (LFPs), electroencephalogram (EEG) signals, and magnetoencephalography (MEG) signals from ANN-based simulations. While LFP and EEG are an important downstream application, the main focus of this paper lies in predicting dendritic voltages within each compartment to capture the entire electrophysiology of a biophysically-detailed neuron model. It further presents a challenging benchmark for MTL architectures due to the large amount of data involved, the presence of correlations between neighbouring compartments, and the non-Gaussian distribution of membrane potentials.

Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve

Neuron Specialization: Leveraging intrinsic task modularity for multilingual machine translation

Parallel Learning by Multitasking Neural Networks

Too Big to Fail: Larger Language Models are Disproportionately Resilient to Induction of Dementia-Related Linguistic Anomalies

Natural Language Multitasking: Analyzing and Improving Syntactic Saliency of Hidden Representations

Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Multitask learning of a biophysically-detailed neuron model

Overcoming catastrophic forgetting in neural networks

Neural Task Representations as Weak Supervision for Model Agnostic Cross-Lingual Transfer

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

Robust Computation with Intrinsic Heterogeneity

What Is Missing in Multilingual Visual Reasoning and How to Fix It

Exploring mechanisms of Neural Robustness: probing the bridge between geometry and spectrum

Multi-lingual agents through multi-headed neural networks

Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?

Lost in Translation: The Algorithmic Gap Between LMs and the Brain

One Model to Rule them all: Multitask and Multilingual Modelling for Lexical Analysis

Synergistic pathways of modulation enable robust task packing within neural dynamics

Generalizability Under Sensor Failure: Tokenization + Transformers Enable More Robust Latent Spaces

Multiplex networks quantify robustness of the mental lexicon to catastrophic concept failures, aphasic degradation and ageing

Resilience from Diversity: Population-based approach to harden models against adversarial attacks