Abstract:We have built a neuronal model of decision making. Our model performs a decision based on an imperfect discrimination between highly mixed stimuli, and expresses it with a saccadic eye movement, like real living beings. We use populations of integrate-and-fire neurons. To take a decision that depends on imperfectly separated stimuli, we use a model inspired by the principle of accumulation of evidence. More precisely, this accumulation of evidence is performed by a competition between groups of neurons that model a visual column in the lateral intra-parietal area (area LIP) of the brain. In this column, we have groups of neurons that are sensitive to specific stimuli on which the decision is based. They inhibit each other through groups of inhibitory neurons. Simultaneously, they recursively excite themselves through recurrent synaptic excitation, and all the neurons receive a steady low-level excitation from the rest of the brain. The competition is generated by these recurrent inhibitory and excitatory loops. We study this structure within the framework of dynamical systems. The variables we use are the activities of each group of neurons. This dynamical system has several stable states: one of them occurs when all activities are weak, and other ones when one local group of neurons has a higher activity and dominates the others through lateral inhibition. The convergence to one of these stable states models decision making, guided by sensory evidence. The group of neurons sensitive to the specific stimulus has a comparative advantage on the others during the competition. This structure is not a new idea, but we use it to test our hypothesis on the way the brain controls the dynamics of decision making. Our hypothesis is that the statistical signature of the low-level activity of the brain modifies the stability of the attractors of our model, and thus changes the dynamics of the competition that models decision making. The criterion by which we judge that a decision is taken is more realistic than just looking at the decisive neurons' activities. We model a saccadic eye movement directed by the activities of our LIP neurons, and we read the decision from the position of the eye. This experimental setup is comparable to biophysical experiments in which living beings express their decisions by saccadic eye movements. The neurons of the LIP column in which the decisions take place are modeled as neurons in a real brain: besides the stimuli and the recurrent interactions, they receive significant inputs from the rest of the brain. It is well known that neurons in the brain are highly influenced by this activity, called low-level background activity. We study how the dynamics of the decision making change as a function of the first-order statistics (mean) and second-order statistics (variance) of this global low-level background activity or noise. By studying its influence on the reaction time and error rate, we show that this background activity may be used to control the dynamics of decision making. We compare the performance of such a model (error rate as a function of reaction time) to the performance of living beings during psychophysical experiments. By doing so, we assess the plausibility of the hypothesis that decisions be controlled by the statistical signature of the low-level background activity of the brain.

Neuronal Representation of a Working Memory-Based Decision Strategy in the Motor and Prefrontal Cortico-Basal Ganglia Loops

Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task

Working memory as a representational template for reinforcement learning

Single-Trial Representations of Decision-Related Variables by Decomposed Frontal Corticostriatal Ensemble Activity

Working Memory Guides Action Valuation in Model-based Decision-making Strategy.

Cortex-wide characterization of decision-making neural dynamics during spatial navigation

Neural dynamics in the orbitofrontal cortex reveal cognitive strategies

Decomposed frontal corticostriatal ensemble activity changes across trials, revealing distinct features relevant to outcome-based decision making

Overlapping neural representations for selection in attention and working memory

Neuronal representation of working memory in the medial prefrontal cortex of rats

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis

Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia

Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops

Neuronal Model of Decision Making

Causal Evidence for a Role of Cerebellar Lobulus Simplex in Prefrontal-Hippocampal Interaction in Spatial Working Memory Decision-Making

Dynamical model of salience gated working memory, action selection and reinforcement based on basal ganglia and dopamine feedback

A novel fMRI paradigm to dissociate the behavioral and neural components of mixed-strategy decision making from non-strategic decisions in humans

From memory-based decisions to decision-based movements: A model of interval discrimination followed by action selection

Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making task

Intertemporal Decision-Making Involves Prefrontal Control Mechanisms Associated with Working Memory