Abstract:Synapses in the brain are highly noisy, which leads to a large trial-by-trial variability. Given how costly synapses are in terms of energy consumption these high levels of noise are surprising. Here we propose that synapses use noise to represent uncertainties about the somatic activity of the postsynaptic neuron. To show this, we developed a mathematical framework, in which the synapse as a whole interacts with the soma of the postsynaptic neuron in a similar way to an agent that is situated and behaves in an uncertain, dynamic environment. This framework suggests that synapses use an implicit internal model of the somatic membrane dynamics that is being updated by a synaptic learning rule, which resembles experimentally well-established LTP/LTD mechanisms. In addition, this approach entails that a synapse utilizes its inherently noisy synaptic release to also encode its uncertainty about the state of the somatic potential. Although each synapse strives for predicting the somatic dynamics of its postsynaptic neuron, we show that the emergent dynamics of many synapses in a neuronal network resolve different learning problems such as pattern classification or closed-loop control in a dynamic environment. Hereby, synapses coordinate themselves to represent and utilize uncertainties on the network level in behaviorally ambiguous situations. Synapses in the brain are highly noisy leading to a large trial-by-trial variability in their response to presynaptic action potentials. Adopting the principle of predictive processing, which is based on the idea that agents instantiate an internal model of their environment enabling them to make predictions, take actions, and to minimize surprise, we can show that a synapse utilizes its inherently noisy release to encode its uncertainty about the state of its cellular, postsynaptic environment. The resulting model framework leads to a synaptic learning rule that adapts the synaptic efficacy such that the synapse can predict future postsynaptic spiking. This synaptic learning rule resembles experimentally well-established plasticity mechanisms and makes very precise experimental predictions. In addition, we show that this synaptic learning rule enables neuronal networks to utilize the unreliability of synaptic release to master behaviorally ambiguous situations.

Turn Down that Noise: Synaptic Encoding of Afferent SNR in a Single Spiking Neuron

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Exploiting Noise As a Resource for Computation and Learning in Spiking Neural Networks

Noise Helps Optimization Escape from Saddle Points in the Synaptic Plasticity

Synaptic Learning with Augmented Spikes

Spatiotemporal Pattern Recognition in Single Mixed-Signal VLSI Neurons with Heterogeneous Dynamic Synapses

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Noise and spike-time-dependent plasticity drive self-organized criticality in spiking neural network: Toward neuromorphic computing

Analog-Digital Simulations of Full Conductance-Based Networks of Spiking Neurons with Spike Timing Dependent Plasticity

Neuromorphic Auditory Perception by Neural Spiketrum

Building an Analog Circuit Synapse for Deep Learning Neuromorphic Processing

Time-Integrated Spike-Timing-Dependent-Plasticity

Synaptic dynamics: linear model and adaptation algorithm

Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Sparse coding with a somato-dendritic rule

Synapses learn to utilize stochastic pre-synaptic release for the prediction of postsynaptic dynamics

Noise Helps Optimization Escape from Saddle Points in the Neural Dynamics.

Decoding the amplitude and slope of continuous signals into spikes with a spiking point neuron model

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Endowing Spiking Neural Networks with Homeostatic Adaptivity for APS-DVS Bimodal Scenarios