Abstract:Pattern separation is a valuable computational function performed by neuronal circuits, such as the dentate gyrus, where dissimilarity between inputs is increased, reducing noise and increasing the storage capacity of downstream networks. Pattern separation is studied from both in vivo experimental and computational perspectives and, a number of different measures (such as orthogonalisation, decorrelation, or spike train distance) have been applied to quantify the process of pattern separation. However, these are known to give conclusions that can differ qualitatively depending on the choice of measure and the parameters used to calculate it. We here demonstrate that arbitrarily increasing sparsity, a noticeable feature of dentate granule cell firing and one that is believed to be key to pattern separation, typically leads to improved classical measures for pattern separation even, inappropriately, up to the point where almost all information about the inputs is lost. Standard measures therefore both cannot differentiate between pattern separation and pattern destruction, and give results that may depend on arbitrary parameter choices. We propose that techniques from information theory, in particular mutual information, transfer entropy, and redundancy, should be applied to penalise the potential for lost information (often due to increased sparsity) that is neglected by existing measures. We compare five commonly-used measures of pattern separation with three novel techniques based on information theory, showing that the latter can be applied in a principled way and provide a robust and reliable measure for comparing the pattern separation performance of different neurons and networks. We demonstrate our new measures on detailed compartmental models of individual dentate granule cells and a dentate microcircuit, and show how structural changes associated with epilepsy affect pattern separation performance. We also demonstrate how our measures of pattern separation can predict pattern completion accuracy. Overall, our measures solve a widely acknowledged problem in assessing the pattern separation of neural circuits such as the dentate gyrus, as well as the cerebellum and mushroom body. Finally we provide a publicly available toolbox allowing for easy analysis of pattern separation in spike train ensembles. The hippocampus is a region of the brain strongly associated with spatial navigation and encoding of episodic memories. To perform these functions effectively it makes use of circuits that perform pattern separation , where redundant structure is removed from neural representations leaving only the most salient information. Pattern separation allows downstream pattern completion networks to better distinguish between similar situations. Pathological changes, caused by Alzheimer's, schizophrenia, or epilepsy, to the circuits that perform pattern separation are associated with reduced discriminative ability in both animal models and humans. Traditionally, pattern separation has been described alongside the complementary process of pattern completion, but more recent studies have focussed on the detailed neuronal and circuit features that contribute to pattern separation alone. We here show that traditional measures of pattern separation are inappropriate in this case, as they do not give consistent conclusions when parameters are changed and can confound pattern separation with the loss of important information. We show that directly accounting for the information throughput of a pattern separation circuit can provide new measures of pattern separation that are robust and consistent, and allow for nuanced analysis of the structure-function relationship of such circuits and how this may be perturbed by pathology.

Pattern Separation in a Spiking Neural Network of Hippocampus Robust to Imbalanced Excitation/Inhibition

Research on Network Model of Dentate Gyrus Based on Bionics.

Modeling rhythmic patterns in the hippocampus

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

A Feed-Forward Neural Network for Increasing the Hopfield-Network Storage Capacity

Pattern Separation, Completion, and Categorisation in the Hippocampus and Neocortex

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Robust and consistent measures of pattern separation based on information theory and demonstrated in the dentate gyrus

Robust Resting-State Dynamics in a Large-Scale Spiking Neural Network Model of Area CA3 in the Mouse Hippocampus

A Hierarchical Organized Memory Model Using Spiking Neurons

Effect of adult hippocampal neurogenesis on pattern separation and its applications

The mechanisms for pattern completion and pattern separation in the hippocampus

Selective inhibition in CA3: A mechanism for stable pattern completion through heterosynaptic plasticity

Simulation Studies of the CA3 Hippocampal Subfield Modelled As an Attractor Neural Network.

Pattern Segmentation Based on Hindmarsh-Rose Neuron Model

Associative Memory Model of Hippocampus CA3 Using Spike Response Neurons

Spiking Neural Networks and Hippocampal Function: A Web-Accessible Survey of Simulations, Modeling Methods, and Underlying Theories

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

Distinguishing examples while building concepts in hippocampal and artificial networks

A Hippocampus Model for Online One-Shot Storage of Pattern Sequences

Dual coding with STDP in a spiking recurrent neural network model of the hippocampus