Abstract:Background: Behavior results from the integration of ongoing sensory signals and contextual information in various forms, such as past experience, expectations, current goals, etc. Thus, the response to a specific stimulus, say the ringing of a doorbell, varies depending on whether you are at home or in someone else's house. What is the neural basis of this flexibility? What mechanism is capable of selecting, in a context-dependent way an adequate response to a given stimulus? One possibility is based on a nonlinear neural representation in which context information regulates the gain of stimulus-evoked responses. Here I explore the properties of this mechanism. Results: By means of three hypothetical visuomotor tasks, I study a class of neural network models in which any one of several possible stimulus-response maps or rules can be selected according to context. The underlying mechanism based on gain modulation has three key features: (1) modulating the sensory responses is equivalent to switching on or off different subpopulations of neurons, (2) context does not need to be represented continuously, although this is advantageous for generalization, and (3) context-dependent selection is independent of the discriminability of the stimuli. In all cases, the contextual cues can quickly turn on or off a sensory-motor map, effectively changing the functional connectivity between inputs and outputs in the networks. Conclusions: The modulation of sensory-triggered activity by proprioceptive signals such as eye or head position is regarded as a general mechanism for performing coordinate transformations in vision. The present results generalize this mechanism to situations where the modulatory quantity and the input-output relationships that it selects are arbitrary. The model predicts that sensory responses that are nonlinearly modulated by arbitrary context signals should be found in behavioral situations that involve choosing or switching between multiple sensory-motor maps. Because any relevant circumstancial information can be part of the context, this mechanism may partly explain the complex and rich behavioral repertoire of higher organisms.

Sensory context of initiation-cue modulates action goal-relevant neural representations

Context-dependent selection of visuomotor maps

Neural Encoding of Direction and Distance across Reference Frames in Visually Guided Reaching

Exploring the internal forward model: action-effect prediction and attention in sensorimotor processing

Voluntary action sharpens sensory prediction and facilitates neural processing of contingent sensory stimuli

Visuomotor prediction during action planning in the human frontoparietal cortex and cerebellum

Motor, not visual, encoding of potential reach targets

Sequential Effects in Reaching Reveal Efficient Coding in Motor Planning

Flexible sensory-motor mapping rules manifest in correlated variability of stimulus and action codes across the brain

Preparing to act follows Bayesian inference rules

EEG Analyses of visual cue effects on executed movements

Neural oscillations guiding action during effects imagery

Effector-independent Representations Guide Sequential Target Selection Biases in Action

Neural Activity Associated with Attention Orienting Triggered by Implied Action Cues

Neural substrates for saccadic modulation of visual representations in mouse superior colliculus

Rule-based modulation of a sensorimotor transformation across cortical areas

Brain-wide dynamics linking sensation to action during decision-making

Dynamic prioritisation of sensory and motor contents in working memory

Early modality-specific somatosensory cortical regions are modulated by attended visual stimuli: interaction of vision, touch and behavioral intent

The Human Basal Ganglia Mediate the Interplay between Reactive and Proactive Control of Response through Both Motor Inhibition and Sensory Modulation