Abstract:A fundamental feature of the human brain is its capacity to learn novel motor skills. This capacity requires the formation of vastly different visuomotor mappings. Using a grid navigation task, we investigated whether training variability would enhance the flexible use of a visuomotor mapping (key-to-direction rule), leading to better generalization performance. Experiments 1 and 2 show that participants trained to move between multiple start-target pairs exhibited greater generalization to both distal and proximal targets compared to participants trained to move between a single pair. This finding suggests that limited variability can impair decisions even in simple tasks without planning. In addition, during the training phase, participants exposed to higher variability were more inclined to choose options that, counterintuitively, moved the cursor away from the target while minimizing its actual distance under the constrained mapping, suggesting a greater engagement in model-based computations. In Experiments 3 and 4, we showed that the limited generalization performance in participants trained with a single pair can be enhanced by a short period of variability introduced early in learning or by incorporating stochasticity into the visuomotor mapping. Our computational modeling analyses revealed that a hybrid model between model-free and model-based computations with different mixing weights for the training and generalization phases, best described participants' data. Importantly, the differences in the model-based weights between our experimental groups, paralleled the behavioral findings during training and generalization. Taken together, our results suggest that training variability enables the flexible use of the visuomotor mapping, potentially by preventing the consolidation of habits due to the continuous demand to change responses. The development of new motor skills often requires the learning of novel associations between actions and outcomes. These novel mappings can be flexible and generalize to new situations, or more local with narrow generalization, similar to stimulus-action associations. In a series of experiments using a navigation task, we showed that generalizable mappings are favored under a training variability regime, while local mappings with narrow generalization are developed in the absence of variability. Training variability was generated in our experiments either with multiple goals or with stochasticity in the action-outcome mapping, with both regimes leading to successful generalization. In addition, we showed that the benefits in generalization from training variability can be observed even when participants are subsequently exposed to no variability for a prolonged period of time. These results were best described by a mixture of model-free and model-based reinforcement learning algorithms, with different mixture weights for the training and generalization phases.

Temporal structure of motor variability is dynamically regulated and predicts motor learning ability

Volitional Modulation of Temporal Spiking Patterns Uncovers the Ability of Temporal Coding in Abstract Skills Learning

The role of training variability for model-based and model-free learning of an arbitrary visuomotor mapping

Corticostriatal Dynamics Encode the Refinement of Specific Behavioral Variability During Skill Learning.

Individual variability in sensorimotor learning reflects trait-like neurobehavioral subject factors

Reinforcement regulates timing variability in thalamus

Inter-individual variability in motor learning due to differences in effective learning rates between generalist and specialist memory stores

Internal states as a source of subject-dependent movement variability are represented by large-scale brain networks

Structure Learning in Motor Control:A Deep Reinforcement Learning Model

Direction-Specific Iterative Tuning of Motor Commands With Local Generalization During Randomized Reaching Practice Across Movement Directions

Ramping Dynamics in the Frontal Cortex Unfold Over Multiple Timescales During Motor Planning

Temporal exploration in sequential movements shapes efficient neuromuscular control

Distinct optimization of motor control and learning: Self-paced motor learning achieves different motor patterns from overtrained

Exposure to temporal variability promotes subsequent adaptation to new temporal regularities

Structural Pathways Supporting Swift Acquisition of New Visuo-Motor Skills

Kernels of Motor Memory Formation: Temporal Generalization in Bimanual Adaptation

The Statistical Determinants of the Speed of Motor Learning

Periodic tapping mechanisms of skill learning in a fast-paced video game.

Dynamic reinforcement learning reveals time-dependent shifts in strategy during reward learning.

Age-dependent predictors of effective reinforcement motor learning across childhood

When stimulus variability accelerates the learning of task knowledge in adults and school-aged children