Abstract:Abstract For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animal’s perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal area during perceptual-decision-making, we extracted low-dimensional neural tra jectories that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the neural trajectories strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population. Author summary In sensorimotor decision-making, internal representation of sensory stimuli is utilized for the generation of appropriate behavior for the context. Therefore, the correlation between variability in sensory neurons and perceptual decisions is sometimes explained by a causal, feedforward role of sensory noise in behavior. However, this correlation could also originate via feedback from decision-making mechanisms downstream of the sensory representation. This cannot be resolved by analyzing single unit responses, but requires a population level analysis. Area MT contains both sensory and choice information and is known to be the key sensory area for visual motion perception. Thus the decision-making process may be corrupting the sensory representation. However, we find that the sensory stimuli and choice variables are separate at the population level,contradicting the previous interpretations based on single unit recordings. This new insight postulates how neural systems can maintain a mixed representation while allows learning and adaptation.

A Common Cortical Circuit Mechanism For Perceptual Categorical Discrimination And Veridical Judgment

Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making

Structured Synaptic Inhibition Has a Critical Role in Multiple-Choice Motion-Discrimination Tasks

A cortical circuit mechanism for structural knowledge-based flexible sensorimotor decision-making

Stimulus-choice (mis)alignment in primate MT cortex

Unveiling Dynamic System Strategies for Multisensory Processing: from Neuronal Fixed-Criterion Integration to Population Bayesian Inference

Visual-Based Spatial Coordinate Dominates Probabilistic Multisensory Inference in Macaque MST-d Disparity Encoding

Decision-related activity and movement selection in primate visual cortex

A simple neural circuit model explains diverse types of integration kernels in perceptual decision-making

Distinct neural manifolds and critical roles of primate caudate nucleus in multimodal decision-making

Neural Implementation of Categorization in a Motion Discrimination Task

Distinct decision processes for 3D and motion stimuli in both humans and monkeys revealed by computational modelling

Integrated Perceptual Decisions Rely on Parallel Evidence Accumulation

Conflict Resolution as Near-Threshold Decision-Making: A Spiking Neural Circuit Model with Two-Stage Competition for Antisaccadic Task

A Computational Model of Direction Selectivity in Macaque V1 Cortex Based on Dynamic Differences between On and Off Pathways

Distributed evidence accumulation across macaque large-scale neocortical networks during perceptual decision making

Neural dynamics of causal inference in the macaque frontoparietal circuit

A Spiking Neuron Network Model for the Delayed Motion Direction Discrimination Task

Bayesian inference by visuomotor neurons in prefrontal cortex

A Group-Decision Making Model of Orientation Detection