Impact of dendritic non-linearities on the computational capabilities of neurons

Clarissa Lauditi,Enrico M. Malatesta,Fabrizio Pittorino,Carlo Baldassi,Nicolas Brunel,Riccardo Zecchina

DOI: https://doi.org/10.1101/2024.06.24.600504

2024-06-28

Abstract:Multiple neurophysiological experiments have shown that dendritic non-linearities can have a strong influence on synaptic input integration. In this work we model a single neuron as a two-layer computational unit with non-overlapping sign-constrained synaptic weights and a biologically plausible form of dendritic non-linearity, which is analytically tractable using statistical physics methods. Using both analytical and numerical tools, we demonstrate several key computational advantages of non-linear dendritic integration with respect to models with linear synaptic integration. We find that the dendritic non-linearity concurrently enhances the number of possible learned input-output associations and the learning velocity, and we characterize how capacity and learning speed depend on the implemented non-linearity and the levels of dendritic and somatic inhibition. We find that experimentally observed connection probabilities naturally emerge in neurons with sign-constrained synapses as a consequence of non-linear dendritic integration, while in models with linear integration, an additional robustness parameter must be introduced in order to reproduce realistic connection probabilities. Non-linearly induced sparsity comes with a second central advantage for neuronal information processing, i.e. input and synaptic noise robustness. By testing our model on standard real-world benchmark datasets inspired by deep learning practice, we observe empirically that the non-linearity provides an enhancement in generalization performance, showing that it enables to capture more complex input/output relations.

Neuroscience

What problem does this paper attempt to address?

The core problem that this paper attempts to solve is to explore the influence of dendritic nonlinearity on the computational ability of a single neuron. Specifically, the researchers constructed a two - layer computational unit model with non - overlapping sign - constrained synaptic weights and biologically reasonable dendritic nonlinearity to simulate a single neuron. Through analytical and numerical tools, they aim to show several key computational advantages of dendritic nonlinearity over the linear synaptic integration model, including:

1. **Enhanced learning capacity**: Dendritic nonlinearity can increase the number of input - output associations that a neuron can learn.
2. **Accelerated learning speed**: Dendritic nonlinearity can improve the learning speed.
3. **Natural emergence of connection probability**: The experimentally observed connection probability naturally emerges in neurons with sign - constrained synapses, while in the linear integration model, additional robustness parameters need to be introduced to reproduce these connection probabilities.
4. **Robustness to input and synaptic noise**: The sparsity induced by dendritic nonlinearity brings robustness to input and synaptic noise.
5. **Improved generalization performance**: By testing the model on standard real - world benchmark datasets, the researchers found that dendritic nonlinearity can enhance generalization performance, enabling neurons to capture more complex input / output relationships.

Overall, this paper attempts to understand how dendritic nonlinearity enhances the computational ability of a single neuron through modeling and analysis, thereby providing new insights into a fundamental open problem in neuroscience.