Abstract:Selective pressure may drive neural systems to process as much information as possible with the lowest energy cost. Recent experiment evidence revealed that the ratio between synaptic excitation and inhibition (E/I) in local cortex is generally maintained at a certain value which may influence the efficiency of energy consumption and information transmission of neural networks. To understand this issue deeply, we constructed a typical recurrent Hodgkin-Huxley network model and studied the general principles that governs the relationship among the E/I synaptic current ratio, the energy cost and total amount of information transmission. We observed in such a network that there exists an optimal E/I synaptic current ratio in the network by which the information transmission achieves the maximum with relatively low energy cost. The coding energy efficiency which is defined as the mutual information divided by the energy cost, achieved the maximum with the balanced synaptic current. Although background noise degrades information transmission and imposes an additional energy cost, we find an optimal noise intensity that yields the largest information transmission and energy efficiency at this optimal E/I synaptic transmission ratio. The maximization of energy efficiency also requires a certain part of energy cost associated with spontaneous spiking and synaptic activities. We further proved this finding with analytical solution based on the response function of bistable neurons, and demonstrated that optimal net synaptic currents are capable of maximizing both the mutual information and energy efficiency. These results revealed that the development of E/I synaptic current balance could lead a cortical network to operate at a highly efficient information transmission rate at a relatively low energy cost. The generality of neuronal models and the recurrent network configuration used here suggest that the existence of an optimal E/I cell ratio for highly efficient energy costs and information maximization is a potential principle for cortical circuit networks. Summary We conducted numerical simulations and mathematical analysis to examine the energy efficiency of neural information transmission in a recurrent network as a function of the ratio of excitatory and inhibitory synaptic connections. We obtained a general solution showing that there exists an optimal E/I synaptic ratio in a recurrent network at which the information transmission as well as the energy efficiency of this network achieves a global maximum. These results reflect general mechanisms for sensory coding processes, which may give insight into the energy efficiency of neural communication and coding.

Energy--Information Trade-off Induces Continuous and Discontinuous Phase Transitions in Lateral Predictive Coding

Energy-information trade-off induces continuous and discontinuous phase transitions in lateral predictive coding

Energy-information trade-off makes the cortical critical power law the optimal coding

Energy Optimization Induces Predictive-coding Properties in a Multicompartment Spiking Neural Network Model

Predictive coding is a consequence of energy efficiency in recurrent neural networks

Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks

Efficient Coding and Energy Efficiency Are Promoted by Balanced Excitatory and Inhibitory Synaptic Currents in Neuronal Network

A Unified Theory of Response Sparsity and Variability for Energy-Efficient Neural Coding

Energy Coding in Biological Neural Networks

Cortical networks with multiple interneuron types generate oscillatory patterns during predictive coding

Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus

Relaxing the Constraints on Predictive Coding Models

Evaluating the extent to which homeostatic plasticity learns to compute prediction errors in unstructured neuronal networks

Energy Consumption Optimization, Response Time Differences and Indicators in Cortical Working Memory Revealed by Nonequilibrium

Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?

Emergence of input selective recurrent dynamics via information transfer maximization

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

Physics in Next-token Prediction

Energy Coding and Energy Functions for Local Activities of the Brain

Continuous-Mixture Autoregressive Networks Learning the Kosterlitz-Thouless Transition