Abstract:Humans can implicitly learn complex perceptuo-motor skills over the course of large numbers of trials. This likely depends on our becoming better able to take advantage of ever richer and temporally deeper predictive relationships in the environment. Here, we offer a novel characterization of this process, fitting a non-parametric, hierarchical Bayesian sequence model to the reaction times of human participants' responses over ten sessions, each comprising thousands of trials, in a serial reaction time task involving higher-order dependencies. The model, adapted from the domain of language, forgetfully updates trial-by-trial, and seamlessly combines predictive information from shorter and longer windows onto past events, weighing the windows proportionally to their predictive power. As the model implies a posterior over window depths, we were able to determine how, and how many, previous sequence elements influenced individual participants' internal predictions, and how this changed with practice. Already in the first session, the model showed that participants had begun to rely on two previous elements (i.e., trigrams), thereby successfully adapting to the most prominent higher-order structure in the task. The extent to which local statistical fluctuations influenced participants' responses waned over subsequent sessions, as subjects forgot the trigrams less and evidenced skilled performance. By the eighth session, a subset of participants shifted their prior further to consider a context deeper than two previous elements. Finally, participants showed resistance to interference and slow forgetting of the old sequence when it was changed in the final sessions. Model parameters for individual subjects covaried appropriately with independent measures of working memory. In sum, the model offers the first principled account of the adaptive complexity and nuanced dynamics of humans' internal sequence representations during long-term implicit skill learning. A central function of the brain is to predict. One challenge of prediction is that both external events and our own actions can depend on a variably deep temporal context of previous events or actions. For instance, in a short motor routine, like opening a door, our actions only depend on a few previous ones (e.g., push the handle if the key was turned). In longer routines such as coffee making, our actions require a deeper context (e.g., place the moka pot on the hob if coffee is ground, the pot is filled and closed, and the hob is on). We adopted a model from the natural language processing literature that matches humans' ability to learn variable-length relationships in sequences. This model explained the gradual emergence of more complex sequence knowledge and individual differences in an experiment where humans practiced a perceptual-motor sequence over 10 weekly sessions.

Modeling of learning curves with applications to pos tagging

Adaptive scheduling for adaptive sampling in POS taggers construction

Surfing the modeling of PoS taggers in low-resource scenarios

Mathematical Modeling of Learning from an Inconsistent Source: A Nonlinear Approach

Learning to Tag.

Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling

Mapping the Learning Curves of Deep Learning Networks

Absolute convergence and error thresholds in non-active adaptive sampling

Probabilistic prediction and context tree identification in the Goalkeeper Game

Early stopping by correlating online indicators in neural networks

Tracking human skill learning with a hierarchical Bayesian sequence model

Learning to Stop While Learning to Predict

Dreaming Learning

Coarse-to-Fine Curriculum Learning

A Long-Term Learning-Based Dynamic User Model in Image Retrieval

Learning Curves for Analysis of Deep Networks

Integrating temporal usage pattern into personalized tag prediction

A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks

Retrain or not retrain: Conformal test martingales for change-point detection

Learning Bayesian Networks From Data: An Efficient Approach Based On Extended Evolutionary Programming

The Study of a Nonstationary Maximum Entropy Markov Model and Its Application on the Pos-Tagging Task