Abstract:figure legend Neural networks execute the transformation of inputs into the neural activity that enables the execution of a task. Thus, they have the potential to establish causal relationships between the input, the elements of a circuit, the network activity, and eventually behavior. When the purpose of building a model is to understand the mechanisms that enable behavior in biological circuits, the design of network models should be guided by three principles: (1) biological constraints are necessary (e.g., connectivity), (2) the network activity should match the recorded activity, and (3) the network should be able to perform the task of interest. Machine‐learning‐based training can help accomplish these goals. Due to the staggering complexity of the brain and its neural circuitry, neuroscientists rely on the analysis of mathematical models to elucidate its function. From Hodgkin and Huxley's detailed description of the action potential in 1952 to today, new theories and increasing computational power have opened up novel avenues to study how neural circuits implement the computations that underlie behavior. Computational neuroscientists have developed many models of neural circuits that differ in complexity, biological realism, or emergent network properties. With recent advances in experimental techniques for detailed anatomical reconstructions of large‐scale activity recordings, precise biological data has become more available. The challenge when building network models is to reflect experimental results, either through a high level of detail or by finding an appropriate level of abstraction. Meanwhile, machine learning has facilitated the development of artificial neural networks (ANN), which are trained to perform specific tasks. While they have proven successful at achieving task‐oriented behavior, they are often abstract constructs that differ in many features from the physiology of brain circuits. Thus, it is unclear whether the mechanisms underlying computation in biological circuits can be investigated by analyzing artificial networks that accomplish the same function but differ in their mechanisms. Here, we argue that building biologically realistic network models is crucial to establishing causal relationships between neurons, synapses, circuits, and behavior. More specifically, we advocate for network models that consider the connectivity structure and the recorded activity dynamics while evaluating task performance.

Partial observation can induce mechanistic mismatches in data-constrained models of neural dynamics

Recurrent neural circuits overcome partial inactivation by compensation and re-learning

Prediction of neural activity in connectome-constrained recurrent networks

Deep inverse modeling reveals dynamic-dependent invariances in neural circuit mechanisms

Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning

How to incorporate biological insights into network models and why it matters

The sloppy relationship between neural circuit structure and function

Biologically informed cortical models predict optogenetic perturbations

One Step Back, Two Steps Forward: Interference and Learning in Recurrent Neural Networks

Perturbing a Neural Network to Infer Effective Connectivity: Evidence from Synthetic EEG Data

Partial observations and conservation laws: Grey-box modeling in biotechnology and optogenetics

Neural Circuit Inference from Function to Structure

Single-unit activations confer inductive biases for emergent circuit solutions to cognitive tasks

Recurrent connections enable point attractor dynamics and dimensionality reduction in a connectome-constrained model of the insect learning center

Bridging the gap between the connectome and whole-brain activity in

From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction

Inference of network connectivity from temporally binned spike trains

Real-Time Machine Learning Strategies for a New Kind of Neuroscience Experiments

Successes and failures of simple statistical physics models for a network of real neurons

Mesoscopic modeling of hidden spiking neurons

A Goal-Driven Approach to Systems Neuroscience