Abstract:Abstract For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animal’s perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal area during perceptual-decision-making, we extracted low-dimensional neural tra jectories that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the neural trajectories strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population. Author summary In sensorimotor decision-making, internal representation of sensory stimuli is utilized for the generation of appropriate behavior for the context. Therefore, the correlation between variability in sensory neurons and perceptual decisions is sometimes explained by a causal, feedforward role of sensory noise in behavior. However, this correlation could also originate via feedback from decision-making mechanisms downstream of the sensory representation. This cannot be resolved by analyzing single unit responses, but requires a population level analysis. Area MT contains both sensory and choice information and is known to be the key sensory area for visual motion perception. Thus the decision-making process may be corrupting the sensory representation. However, we find that the sensory stimuli and choice variables are separate at the population level,contradicting the previous interpretations based on single unit recordings. This new insight postulates how neural systems can maintain a mixed representation while allows learning and adaptation.

Regressing Away Common Neural Choice Signals does not make them Artifacts. Comment on Frömer et al (2024, Nature Human Behaviour)

Common neural choice signals can emerge artefactually amid multiple distinct value signals

Common neural choice signals can emerge artifactually amidst multiple distinct value signals

Stimulus-choice (mis)alignment in primate MT cortex

Shared and diverging neural dynamics underlying false and veridical perception

Why is there an error negativity on correct trials? A reappraisal

Neural Dynamics Underlying False Alarms in Extrastriate Cortex

How Can Single Sensory Neurons Predict Behavior?

Mismatch Negativity: time for deconstruction

Reactivated past decisions repel early sensory processing and attract late decision-making

Population Models, Not Analyses, of Human Neuroscience Measurements

Evaluating the effectiveness of artifact correction and rejection in event‐related potential research

Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?

Neocortical inhibitory imbalance predicts successful sensory detection

The Effects of Spatial Filtering and Artifacts on Electrocorticographic Signals

Model mimicry limits conclusions about neural tuning and can mistakenly imply unlikely priors

Sensory and perceptual decisional processes underlying the perception of reverberant auditory environments

Cortical responses to looming sources are explained away by the auditory periphery

Repairing Artifacts in Neural Activity Recordings Using Low-Rank Matrix Estimation

Segregation, connectivity, and gradients of deactivation in neural correlates of evidence in social decision making

Reply to: Limitations in odour recognition and generalisation in a neuromorphic olfactory circuit