Abstract:Selective pressure may drive neural systems to process as much information as possible with the lowest energy cost. Recent experiment evidence revealed that the ratio between synaptic excitation and inhibition (E/I) in local cortex is generally maintained at a certain value which may influence the efficiency of energy consumption and information transmission of neural networks. To understand this issue deeply, we constructed a typical recurrent Hodgkin-Huxley network model and studied the general principles that governs the relationship among the E/I synaptic current ratio, the energy cost and total amount of information transmission. We observed in such a network that there exists an optimal E/I synaptic current ratio in the network by which the information transmission achieves the maximum with relatively low energy cost. The coding energy efficiency which is defined as the mutual information divided by the energy cost, achieved the maximum with the balanced synaptic current. Although background noise degrades information transmission and imposes an additional energy cost, we find an optimal noise intensity that yields the largest information transmission and energy efficiency at this optimal E/I synaptic transmission ratio. The maximization of energy efficiency also requires a certain part of energy cost associated with spontaneous spiking and synaptic activities. We further proved this finding with analytical solution based on the response function of bistable neurons, and demonstrated that optimal net synaptic currents are capable of maximizing both the mutual information and energy efficiency. These results revealed that the development of E/I synaptic current balance could lead a cortical network to operate at a highly efficient information transmission rate at a relatively low energy cost. The generality of neuronal models and the recurrent network configuration used here suggest that the existence of an optimal E/I cell ratio for highly efficient energy costs and information maximization is a potential principle for cortical circuit networks. Summary We conducted numerical simulations and mathematical analysis to examine the energy efficiency of neural information transmission in a recurrent network as a function of the ratio of excitatory and inhibitory synaptic connections. We obtained a general solution showing that there exists an optimal E/I synaptic ratio in a recurrent network at which the information transmission as well as the energy efficiency of this network achieves a global maximum. These results reflect general mechanisms for sensory coding processes, which may give insight into the energy efficiency of neural communication and coding.

Biologically plausible solutions for spiking networks with efficient coding

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Spike-based population coding and working memory

Spiking networks that efficiently process dynamic sensory features explain receptor information mixing in somatosensory cortex

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Cooperative coding of continuous variables in networks with sparsity constraint

A theoretical basis for efficient computations with noisy spiking neurons

Evaluating performance of neural codes in model neural communication networks

Emergence of Sparse Coding, Balance and Decorrelation from a Biologically-Grounded Spiking Neural Network Model of Learning in the Primary Visual Cortex

Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation

Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems

Temporal resolution of spike coding in feedforward networks with signal convergence and divergence

Efficient Inference on a Network of Spiking Neurons using Deep Learning

Efficient Coding and Energy Efficiency Are Promoted by Balanced Excitatory and Inhibitory Synaptic Currents in Neuronal Network

Input-output Relation and Energy Efficiency in the Neuron with Different Spike Threshold Dynamics

Neural Information Coding on Small-World Spiking Neuronal Networks Modulated by Spike-Timing-dependent Plasticity under External Noise Stimulation.

A Comprehensive Review of Spiking Neural Networks: Interpretation, Optimization, Efficiency, and Best Practices