Abstract:Abstract For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animal’s perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal area during perceptual-decision-making, we extracted low-dimensional neural tra jectories that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the neural trajectories strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population. Author summary In sensorimotor decision-making, internal representation of sensory stimuli is utilized for the generation of appropriate behavior for the context. Therefore, the correlation between variability in sensory neurons and perceptual decisions is sometimes explained by a causal, feedforward role of sensory noise in behavior. However, this correlation could also originate via feedback from decision-making mechanisms downstream of the sensory representation. This cannot be resolved by analyzing single unit responses, but requires a population level analysis. Area MT contains both sensory and choice information and is known to be the key sensory area for visual motion perception. Thus the decision-making process may be corrupting the sensory representation. However, we find that the sensory stimuli and choice variables are separate at the population level,contradicting the previous interpretations based on single unit recordings. This new insight postulates how neural systems can maintain a mixed representation while allows learning and adaptation.

Perceptual decision related activity in the lateral geniculate nucleus

Neuronal Thresholds and Choice-Related Activity of Otolith Afferent Fibers During Heading Perception

More than expected: extracellular waveforms and functional responses in monkey LGN

A latent pool of neurons silenced by sensory-evoked inhibition can be recruited to enhance perception

Direct observation of the neural computations underlying a single decision

Visual Response Properties of Neurons in the LGN of Normally Reared and Visually Deprived Macaque Monkeys

Neural Correlates of Optimal Multisensory Decision Making under Time-Varying Reliabilities with an Invariant Linear Probabilistic Population Code

Decision-related activity and movement selection in primate visual cortex

Visual Receptive Field Properties of Neurons in the Mouse Lateral Geniculate Nucleus

Neuronal and behavioral responses to naturalistic texture im-ages in macaque monkeys

Choice-related activity and neural encoding in primary auditory cortex and lateral belt during feature-selective attention

Hierarchical effects of choice-related activity and neural encoding during feature selective attention

Choice can be predicted from populations of bursting neurons in superficial layers of monkey V1

Stimulus-choice (mis)alignment in primate MT cortex

Foundations of visual form selectivity for neurons in macaque V1 and V2

A survey of neurophysiological differentiation across mouse visual brain areas and timescales

Comparing the feature selectivity of the gamma-band of the local field potential and the underlying spiking activity in primate visual cortex

Single neuron responses to perceptual difficulty in the mouse auditory cortex

Bayesian inference by visuomotor neurons in prefrontal cortex

Optimization of decision making in multilayer networks: the role of locus coeruleus