Abstract:Pattern separation is a valuable computational function performed by neuronal circuits, such as the dentate gyrus, where dissimilarity between inputs is increased, reducing noise and increasing the storage capacity of downstream networks. Pattern separation is studied from both in vivo experimental and computational perspectives and, a number of different measures (such as orthogonalisation, decorrelation, or spike train distance) have been applied to quantify the process of pattern separation. However, these are known to give conclusions that can differ qualitatively depending on the choice of measure and the parameters used to calculate it. We here demonstrate that arbitrarily increasing sparsity, a noticeable feature of dentate granule cell firing and one that is believed to be key to pattern separation, typically leads to improved classical measures for pattern separation even, inappropriately, up to the point where almost all information about the inputs is lost. Standard measures therefore both cannot differentiate between pattern separation and pattern destruction, and give results that may depend on arbitrary parameter choices. We propose that techniques from information theory, in particular mutual information, transfer entropy, and redundancy, should be applied to penalise the potential for lost information (often due to increased sparsity) that is neglected by existing measures. We compare five commonly-used measures of pattern separation with three novel techniques based on information theory, showing that the latter can be applied in a principled way and provide a robust and reliable measure for comparing the pattern separation performance of different neurons and networks. We demonstrate our new measures on detailed compartmental models of individual dentate granule cells and a dentate microcircuit, and show how structural changes associated with epilepsy affect pattern separation performance. We also demonstrate how our measures of pattern separation can predict pattern completion accuracy. Overall, our measures solve a widely acknowledged problem in assessing the pattern separation of neural circuits such as the dentate gyrus, as well as the cerebellum and mushroom body. Finally we provide a publicly available toolbox allowing for easy analysis of pattern separation in spike train ensembles. The hippocampus is a region of the brain strongly associated with spatial navigation and encoding of episodic memories. To perform these functions effectively it makes use of circuits that perform pattern separation , where redundant structure is removed from neural representations leaving only the most salient information. Pattern separation allows downstream pattern completion networks to better distinguish between similar situations. Pathological changes, caused by Alzheimer's, schizophrenia, or epilepsy, to the circuits that perform pattern separation are associated with reduced discriminative ability in both animal models and humans. Traditionally, pattern separation has been described alongside the complementary process of pattern completion, but more recent studies have focussed on the detailed neuronal and circuit features that contribute to pattern separation alone. We here show that traditional measures of pattern separation are inappropriate in this case, as they do not give consistent conclusions when parameters are changed and can confound pattern separation with the loss of important information. We show that directly accounting for the information throughput of a pattern separation circuit can provide new measures of pattern separation that are robust and consistent, and allow for nuanced analysis of the structure-function relationship of such circuits and how this may be perturbed by pathology.

An Information-Geometric Formulation of Pattern Separation and Evaluation of Existing Indices

An Information-Geometric Formulation of Pattern Separation and Evaluation of Existing Indices

Robust and consistent measures of pattern separation based on information theory and demonstrated in the dentate gyrus

Subspace Projection Approaches To Classification And Visualization Of Neural Network-Level Encoding Patterns

Neighbourhood Sensitive Preserving Embedding for Pattern Classification.

Automatic sorting of point pattern sets using Minkowski Functionals

Data Separability for Neural Network Classifiers and the Development of a Separability Index

Quantifying the distribution of feature values over data represented in arbitrary dimensional spaces

Pattern Separation in a Spiking Neural Network of Hippocampus Robust to Imbalanced Excitation/Inhibition

Spike Train SIMilarity Space (SSIMS): A Framework for Single Neuron and Ensemble Data Analysis

Applications of information geometry to spiking neural network behavior

An Information Theoretic Approach to the Contributions of the Firing Rates and the Correlations Between the Firing of Neurons.

A novel tri-component scheme for classifying neuronal discharge patterns

Multiscale relevance and informative encoding in neuronal spike trains

Generalized Shape Metrics on Neural Representations

Applications of information geometry to spiking neural network activity

“What-Where” sparse distributed invariant representations of visual patterns

The representational-hierarchical view of pattern separation: Not just hippocampus, not just space, not just memory?

A New Separation Measure for Improving the Effectiveness of Validity Indices

Correntropy Induced Metric Based Common Spatial Patterns.

Multivoxel Pattern Analysis Using Information-Preserving EMD.