Abstract:Humans can implicitly learn complex perceptuo-motor skills over the course of large numbers of trials. This likely depends on our becoming better able to take advantage of ever richer and temporally deeper predictive relationships in the environment. Here, we offer a novel characterization of this process, fitting a non-parametric, hierarchical Bayesian sequence model to the reaction times of human participants' responses over ten sessions, each comprising thousands of trials, in a serial reaction time task involving higher-order dependencies. The model, adapted from the domain of language, forgetfully updates trial-by-trial, and seamlessly combines predictive information from shorter and longer windows onto past events, weighing the windows proportionally to their predictive power. As the model implies a posterior over window depths, we were able to determine how, and how many, previous sequence elements influenced individual participants' internal predictions, and how this changed with practice. Already in the first session, the model showed that participants had begun to rely on two previous elements (i.e., trigrams), thereby successfully adapting to the most prominent higher-order structure in the task. The extent to which local statistical fluctuations influenced participants' responses waned over subsequent sessions, as subjects forgot the trigrams less and evidenced skilled performance. By the eighth session, a subset of participants shifted their prior further to consider a context deeper than two previous elements. Finally, participants showed resistance to interference and slow forgetting of the old sequence when it was changed in the final sessions. Model parameters for individual subjects covaried appropriately with independent measures of working memory. In sum, the model offers the first principled account of the adaptive complexity and nuanced dynamics of humans' internal sequence representations during long-term implicit skill learning. A central function of the brain is to predict. One challenge of prediction is that both external events and our own actions can depend on a variably deep temporal context of previous events or actions. For instance, in a short motor routine, like opening a door, our actions only depend on a few previous ones (e.g., push the handle if the key was turned). In longer routines such as coffee making, our actions require a deeper context (e.g., place the moka pot on the hob if coffee is ground, the pot is filled and closed, and the hob is on). We adopted a model from the natural language processing literature that matches humans' ability to learn variable-length relationships in sequences. This model explained the gradual emergence of more complex sequence knowledge and individual differences in an experiment where humans practiced a perceptual-motor sequence over 10 weekly sessions.

A Computational Framework for Motor Skill Acquisition

Control of automated behavior: insights from the discrete sequence production task

Human motor learning dynamics in high-dimensional tasks

Influence of error-augmentation on the dynamics of visuomotor skill acquisition: insights from proxy-process models

A learning framework for semantic reach-to-grasp tasks integrating machine learning and optimization.

Model-Free Robust Optimal Feedback Mechanisms of Biological Motor Control

A Simplified Cerebellar Model with Priority-based Delayed Eligibility Trace Learning for Motor Control

Periodic tapping mechanisms of skill learning in a fast-paced video game.

A Hierarchical Model of Motor Skill for Haptic-assisted Virtual Reality Training

A Probabilistic Model for Skill Acquisition with Switching Latent Feedback Controllers

Learning robot motor skills with mixed reality

Effective Learning and Online Modulation for Robotic Variable Impedance Skills.

An Efficient Learning Control Framework With Sim-to-Real for String-Type Artificial Muscle-Driven Robotic Systems

An in-silico framework for modeling optimal control of neural systems

Tracking human skill learning with a hierarchical Bayesian sequence model

A Novel Skill Learning Framework for Redundant Manipulators Based on Multi-task Dynamic Movement Primitives

A Unifying Framework for the Identification of Motor Primitives

Predictive Strategies for the Control of Complex Motor Skills: Recent Insights into Individual and Joint Actions

Design and Implementation of a Behavioral Sequence Framework for Human-robot Interaction Utilizing Brain-computer Interface and Haptic Feedback

Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems