Abstract:Perceptual decision-making is the process by which an animal uses sensory stimuli to choose an action or mental proposition. This process is thought to be mediated by neurons organized as attractor networks . However, whether attractor dynamics underlie decision behavior and the complex neuronal responses remains unclear. Here we use an unsupervised, deep learning-based method to discover decision-related dynamics from the simultaneous activity of neurons in frontal cortex and striatum of rats while they accumulate pulsatile auditory evidence. We found that trajectories evolved along two sequential regimes, the first dominated by sensory inputs, and the second dominated by the autonomous dynamics, with flow in a direction (i.e., “neural mode”) largely orthogonal to that in the first regime. We propose that the second regime corresponds to decision commitment. We developed a simplified model that approximates the coupled transition in dynamics and neural mode and allows precise inference, from each trial’s neural activity, of a putative internal decision commitment time in that trial. The simplified model captures diverse and complex single-neuron temporal profiles, such as ramping and stepping . It also captures trial-averaged curved trajectories , and reveals distinctions between brain regions. The putative neurally-inferred commitment times (“nTc”) occurred at times broadly distributed across trials, and not time-locked to stimulus onset, offset, or response onset. Nevertheless, when trials were aligned to nTc, behavioral analysis showed that, as predicted by a decision commitment time, sensory evidence before nTc affected the subjects’ decision, but evidence after nTc did not. Our results show that the formation of a perceptual choice involves a rapid, coordinated transition in both the dynamical regime and the neural mode of the decision process, and suggest the moment of commitment to be a useful entry point for dissecting mechanisms underlying rapid changes in internal state.

Neural dynamics of reversal learning in the prefrontal cortex and recurrent neural networks

Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging

Selective engagement of prefrontal VIP neurons in reversal learning

Encoding priors in the brain: a reinforcement learning model for mouse decision making

The cost of behavioral flexibility: reversal learning driven by a spiking neural network

Neural correlates of rapid reversal learning in a simple model of human social interaction.

Human Reversal Learning under Conditions of Certain Versus Uncertain Outcomes.

Synaptic and Spiking Dynamics Underlying Reward Reversal in the Orbitofrontal Cortex.

Reactivation of reward representations associated with the reinforcement of behavior

Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making

The Neuropsychology of Ventral Prefrontal Cortex: Decision-making and Reversal Learning

Reward Prediction Error in Learning-Related Behaviors

Valence-dependent dopaminergic modulation during reversal learning in Parkinson's disease: A neurocomputational approach

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Dopamine release in human associative striatum during reversal learning

Rapid Rule-Based Reward Reversal and the Lateral Orbitofrontal Cortex.

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

Transitions in dynamical regime and neural mode underlie perceptual decision-making

Recurrent neural circuits overcome partial inactivation by compensation and re-learning

Recurrent networks endowed with structural priors explain suboptimal animal behavior

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field