Abstract:Abstract For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animal’s perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal area during perceptual-decision-making, we extracted low-dimensional neural tra jectories that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the neural trajectories strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population. Author summary In sensorimotor decision-making, internal representation of sensory stimuli is utilized for the generation of appropriate behavior for the context. Therefore, the correlation between variability in sensory neurons and perceptual decisions is sometimes explained by a causal, feedforward role of sensory noise in behavior. However, this correlation could also originate via feedback from decision-making mechanisms downstream of the sensory representation. This cannot be resolved by analyzing single unit responses, but requires a population level analysis. Area MT contains both sensory and choice information and is known to be the key sensory area for visual motion perception. Thus the decision-making process may be corrupting the sensory representation. However, we find that the sensory stimuli and choice variables are separate at the population level,contradicting the previous interpretations based on single unit recordings. This new insight postulates how neural systems can maintain a mixed representation while allows learning and adaptation.

Neuronal Thresholds and Choice-Related Activity of Otolith Afferent Fibers During Heading Perception

Detection Thresholds of Macaque Otolith Afferents

Long-term Deficits in Motion Detection Thresholds and Spike Count Variability after Unilateral Vestibular Lesion

Transformation of Spatiotemporal Dynamics in the Macaque Vestibular System from Otolith Afferents to Cortex

Perceptual decision related activity in the lateral geniculate nucleus

Stimulus-choice (mis)alignment in primate MT cortex

Diverse Effects of Gaze Direction on Heading Perception in Humans

Hierarchical effects of choice-related activity and neural encoding during feature selective attention

Choice-related activity and neural encoding in primary auditory cortex and lateral belt during feature-selective attention

A Common Cortical Circuit Mechanism For Perceptual Categorical Discrimination And Veridical Judgment

Delineating neural responses and functional connectivity changes during vestibular and nociceptive stimulation reveal the uniqueness of cortical vestibular processing

Decision-related activity and movement selection in primate visual cortex

Direct observation of the neural computations underlying a single decision

Integration of Semi-Circular Canal and Otolith Cues for Direction Discrimination during Eccentric Rotations

Multiple mechanisms underlying the orientation selectivity of visual cortical neurones

Central Vestibular Tuning Arises from Patterned Convergence of Otolith Afferents

Intrinsic Activity in the Fly Brain Gates Visual Information During Behavioral Choices

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Brain state and cortical layer-specific mechanisms underlying perception at threshold

Detection of Threshold-Level Stimuli Modulated by Temporal Predictions of the Cerebellum