Abstract:Pattern separation is a valuable computational function performed by neuronal circuits, such as the dentate gyrus, where dissimilarity between inputs is increased, reducing noise and increasing the storage capacity of downstream networks. Pattern separation is studied from both in vivo experimental and computational perspectives and, a number of different measures (such as orthogonalisation, decorrelation, or spike train distance) have been applied to quantify the process of pattern separation. However, these are known to give conclusions that can differ qualitatively depending on the choice of measure and the parameters used to calculate it. We here demonstrate that arbitrarily increasing sparsity, a noticeable feature of dentate granule cell firing and one that is believed to be key to pattern separation, typically leads to improved classical measures for pattern separation even, inappropriately, up to the point where almost all information about the inputs is lost. Standard measures therefore both cannot differentiate between pattern separation and pattern destruction, and give results that may depend on arbitrary parameter choices. We propose that techniques from information theory, in particular mutual information, transfer entropy, and redundancy, should be applied to penalise the potential for lost information (often due to increased sparsity) that is neglected by existing measures. We compare five commonly-used measures of pattern separation with three novel techniques based on information theory, showing that the latter can be applied in a principled way and provide a robust and reliable measure for comparing the pattern separation performance of different neurons and networks. We demonstrate our new measures on detailed compartmental models of individual dentate granule cells and a dentate microcircuit, and show how structural changes associated with epilepsy affect pattern separation performance. We also demonstrate how our measures of pattern separation can predict pattern completion accuracy. Overall, our measures solve a widely acknowledged problem in assessing the pattern separation of neural circuits such as the dentate gyrus, as well as the cerebellum and mushroom body. Finally we provide a publicly available toolbox allowing for easy analysis of pattern separation in spike train ensembles. The hippocampus is a region of the brain strongly associated with spatial navigation and encoding of episodic memories. To perform these functions effectively it makes use of circuits that perform pattern separation , where redundant structure is removed from neural representations leaving only the most salient information. Pattern separation allows downstream pattern completion networks to better distinguish between similar situations. Pathological changes, caused by Alzheimer's, schizophrenia, or epilepsy, to the circuits that perform pattern separation are associated with reduced discriminative ability in both animal models and humans. Traditionally, pattern separation has been described alongside the complementary process of pattern completion, but more recent studies have focussed on the detailed neuronal and circuit features that contribute to pattern separation alone. We here show that traditional measures of pattern separation are inappropriate in this case, as they do not give consistent conclusions when parameters are changed and can confound pattern separation with the loss of important information. We show that directly accounting for the information throughput of a pattern separation circuit can provide new measures of pattern separation that are robust and consistent, and allow for nuanced analysis of the structure-function relationship of such circuits and how this may be perturbed by pathology.

Dentate Gyrus circuitry features improve performance of sparse approximation algorithms

Research on Network Model of Dentate Gyrus Based on Bionics.

Subregional activity in the dentate gyrus is amplified during elevated cognitive demands

The Role of Competitive Learning in the Generation of DG Fields from EC Inputs

Biological lateral inhibition and digital cellular neural network applied on associations memory

Selection of Distinct Populations of Dentate Granule Cells in Response to Inputs As a Mechanism for Pattern Separation in Mice.

How do neurons operate on sparse distributed representations? A mathematical theory of sparsity, neurons and active dendrites

Assessments of dentate gyrus function: discoveries and debates

Cellular and circuit features distinguish dentate gyrus semilunar granule cells and granule cells activated during contextual memory formation

How Informative Are Spatial CA3 Representations Established by the Dentate Gyrus?

Robust and consistent measures of pattern separation based on information theory and demonstrated in the dentate gyrus

Recurrent Inhibitory Dynamics in the Entorhinal Cortex Support Pattern Separation

The suprapyramidal and infrapyramidal blades of the dentate gyrus exhibit different GluN subunit content and dissimilar frequency-dependent synaptic plasticity in vivo

Repeating Spatial-Temporal Motifs of CA3 Activity Dependent on Engineered Inputs from Dentate Gyrus Neurons in Live Hippocampal Networks

A computational study on how theta modulated inhibition can account for the long temporal windows in the entorhinal-hippocampal loop

Offline hippocampal reactivation during dentate spikes supports flexible memory

Cooperation and competition between lateral and medial perforant path synapses in the dentate gyrus

Modeling Rate Remapping in Dentate Gyrus

Dynamical Origin for Winner-Take-All Competition in A Biological Network of The Hippocampal Dentate Gyrus

A Computational Theory of Hippocampal Function, and Empirical Tests of the Theory.