Abstract:Working memory $\unicode{x2013}$ the ability to remember recent events as they recede continuously into the past $\unicode{x2013}$ requires the ability to represent any stimulus at any time delay. This property requires neurons coding working memory to show mixed selectivity, with conjunctive receptive fields (RFs) for stimuli and time, forming a representation of 'what' $\times$ 'when'. We study the properties of such a working memory in simple experiments where a single stimulus must be remembered for a short time. The requirement of conjunctive receptive fields allows the covariance matrix of the network to decouple neatly, allowing an understanding of the low-dimensional dynamics of the population. Different choices of temporal basis functions lead to qualitatively different dynamics. We study a specific choice $\unicode{x2013}$ a Laplace space with exponential basis functions for time coupled to an "Inverse Laplace" space with circumscribed basis functions in time. We refer to this choice with basis functions that evenly tile log time as a Laplace Neural Manifold. Despite the fact that they are related to one another by a linear projection, the Laplace population shows a stable stimulus-specific subspace whereas the Inverse Laplace population shows rotational dynamics. The growth of the rank of the covariance matrix with time depends on the density of the temporal basis set; logarithmic tiling shows good agreement with data. We sketch a continuous attractor CANN that constructs a Laplace Neural Manifold. The attractor in the Laplace space appears as an edge; the attractor for the inverse space appears as a bump. This work provides a map for going from more abstract cognitive models of WM to circuit-level implementation using continuous attractor neural networks, and places constraints on the types of neural dynamics that support working memory.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: how to achieve the combined representation of "what" and "when" in working memory in neuroscience. Specifically, working memory needs to remember recently occurred events and be able to represent the state of any stimulus at any time delay. This requires that neurons exhibit mixed selectivity when encoding working memory, that is, having conjunctive receptive fields that combine stimuli and time, thus forming a combined representation of "what" and "when". ### Core problems of the paper 1. **Combined representation of working memory**: - Working memory needs to be able to represent the state of any stimulus at any time delay. - This requires that neurons have mixed selectivity, that is, their receptive fields must be a combination of stimuli and time, forming a combined representation of "what" and "when". 2. **Understanding of low - dimensional dynamics**: - Study how a neural network remembers a single stimulus briefly presented in a simple experiment within a short time. - By studying the covariance matrix of the network, the low - dimensional dynamics of a population of neurons can be understood. 3. **Selection of different time basis functions**: - Different selections of time basis functions will lead to qualitatively different dynamic behaviors. - The paper focuses on a specific selection - Laplace space, where the time basis function is an exponential function, and "Inverse Laplace space", where the time basis function is a gamma function. 4. **Constraints on neural dynamics**: - Provide a mapping from an abstract cognitive model to a circuit - level implementation, especially using continuous attractor neural networks (CANN) to construct a Laplace Neural Manifold. - Constrain the types of neural dynamics that support working memory. ### Main findings - **Laplace Neural Manifold**: Selecting exponential and gamma basis functions that uniformly cover logarithmic time makes the Laplace population show a stable stimulus - specific subspace, while the inverse Laplace population exhibits rotational dynamics. - **Dimension growth**: As the recording time increases, the dimension of the neural trajectory depends on the distribution of time constants. The uniform coverage of logarithmic time is consistent with experimental data, indicating its rationality. - **Theoretical results**: The combined representation requires that the receptive fields of neurons must be in the form of a product of stimuli and time, which enables the covariance matrix to be decomposed into a tensor product of stimuli and time, thus simplifying the behavior analysis of a large population of neurons. ### Summary By introducing the concept of Laplace Neural Manifold, the paper explores the combined representation of "what" and "when" in working memory and its neural dynamics characteristics. This research not only provides theoretical insights but also offers new tools and methods for understanding and simulating the working memory mechanism of the brain.

"What" x "When" working memory representations using Laplace Neural Manifolds

Continuous Attractor Networks for Laplace Neural Manifolds

Learning temporal relationships between symbols with Laplace Neural Manifolds

Recurrent neural network models for working memory of continuous variables: activity manifolds, connectivity patterns, and dynamic codes

Slow manifolds within network dynamics encode working memory efficiently and robustly

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

Neural population dynamics of human working memory

Exact neural mass model for synaptic-based working memory

Slow manifolds in recurrent networks encode working memory efficiently and robustly

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex

Cognitive computation using neural representations of time and space in the Laplace domain

Network mechanisms of working memory: the role of neuronal nonlinearities

Storing overlapping associative memories on latent manifolds in low-rank spiking networks

A unifying perspective on neural manifolds and circuits for cognition

Precise Spatial Memory in Local Random Networks

Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model

Optimizing working memory with heterogeneity of recurrent cortical excitation

“What” and “Where” in Visual Working Memory: A Computational Neurodynamical Perspective for Integrating fMRI and Single-Neuron Data

Beyond the circuit architecture : attractor dynamics reveals the mechanism of improved performance in decision-making and working memory

A balanced memory network

Neuromorphic Implementation of Attractor Dynamics in a Two-Variable Winner-Take-All Circuit with NMDARs: A Simulation Study