Abstract:The principle of efficient coding posits that sensory cortical networks are designed to encode maximal sensory information with minimal metabolic cost. Despite the major influence of efficient coding in neuroscience, it has remained unclear whether fundamental empirical properties of neural network activity can be explained solely based on this normative principle. Here, we derive the structural, coding, and biophysical properties of excitatory-inhibitory recurrent networks of spiking neurons that emerge directly from imposing that the network minimizes an instantaneous loss function and a time-averaged performance measure enacting efficient coding. We assumed that the network encodes a number of independent stimulus features varying with a time scale equal to the membrane time constant of excitatory and inhibitory neurons. The optimal network has biologically-plausible biophysical features, including realistic integrate-and-fire spiking dynamics, spike-triggered adaptation, and a non-specific excitatory external input. The excitatory-inhibitory recurrent connectivity between neurons with similar stimulus tuning implements feature-specific competition, similar to that recently found in visual cortex. Networks with unstructured connectivity cannot reach comparable levels of coding efficiency. The optimal ratio of excitatory vs inhibitory neurons and the ratio of mean inhibitory-to-inhibitory vs excitatory-to-inhibitory connectivity are comparable to those of cortical sensory networks. The efficient network solution exhibits an instantaneous balance between excitation and inhibition. The network can perform efficient coding even when external stimuli vary over multiple time scales. Together, these results suggest that key properties of biological neural networks may be accounted for by efficient coding.

Efficiency characterization of a large neuronal network: a causal information approach

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

Inferring Structure of Cortical Neuronal Networks from Firing Data: A Statistical Physics Approach

Optimal Interplay between Synaptic Strengths and Network Structure Enhances Activity Fluctuations and Information Propagation in Hierarchical Modular Networks

Identifying Effective Connectivity between Stochastic Neurons with Variable-Length Memory Using a Transfer Entropy Rate Estimator

A causal inference approach of monosynapses from spike trains

Evaluating performance of neural codes in model neural communication networks

Biologically plausible solutions for spiking networks with efficient coding

The causal interaction between the subnetworks of a complex network

Excitation-inhibition balance controls information encoding in neural populations

Functional Control of Network Dynamical Systems: An Information Theoretic Approach

Entropic Causal Inference for Neurological Applications

A Graph Theoretic Interpretation of Neural Complexity

Revealing directed effective connectivity of cortical neuronal networks from measurements

Synchronous clusters in a noisy inhibitory neural network

Effects of Spatial Constraints of Inhibitory Connectivity on the Dynamical Development of Criticality in Spiking Networks

Information integration in large brain networks

The functional structure of cortical neuronal networks grown in vitro

Inferring network structure and local dynamics from neuronal patterns with quenched disorder

A high-efficiency model indicating the role of inhibition in the resilience of neuronal networks to damage resulting from traumatic injury

Network algorithmics and the emergence of the cortical synaptic-weight distribution