Abstract:Our environment contains temporal information unfolding simultaneously at multiple timescales. How do we learn and represent these dynamic and overlapping information streams? We investigated these processes in a statistical learning paradigm with simultaneous short and long timescale contingencies. Human participants (N=96) played a game where they learned to quickly click on a target image when it appeared in one of 9 locations, in 8 different contexts. Across contexts, we manipulated the order of target locations: at a short timescale, the order of pairs of sequential locations in which the target appeared; at a longer timescale, the set of locations that appeared in the first vs. second half of the game. Participants periodically predicted the upcoming target location, and later performed similarity judgements comparing the games based on their order properties. Participants showed context dependent sensitivity to order information at both short and long timescales, with evidence of stronger learning for short timescales. We modeled the learning paradigm using a gated recurrent network trained to make immediate predictions, which demonstrated multilevel learning timecourses and patterns of sensitivity to the similarity structure of the games that mirrored human participants. The model grouped games with matching rule structure and dissociated games based on low-level order information more so than high-level order information. The work shows how humans and models can rapidly and concurrently acquire order information at different timescales.

What problem does this paper attempt to address?

The problem this paper attempts to address is how humans learn and represent dynamic and overlapping streams of information across multiple time scales simultaneously. Specifically, the researchers designed a statistical learning paradigm to explore whether participants can learn regularities on different time scales within a short period by simultaneously manipulating the sequence of target positions on short and long time scales, and to assess their sensitivity to these regularities. ### Research Background Our environment contains time-dependent information on multiple time scales. For example, a baseball fan can predict the trajectory of a just-thrown ball and also predict the player substitutions on the field during each half-inning. To fully represent, simulate, and predict changes in the environment, humans must learn time dependencies across multiple time scales. This cross-time-scale learning has been demonstrated in various fields such as language, event segmentation, motor learning, and visual statistical learning. However, it is still unclear whether humans can quickly learn regularities on different time scales that appear simultaneously within a short period, especially whether they remain sensitive to slower background statistical dependencies while focusing on immediate tasks. ### Research Methods The researchers designed a "whack-a-mole" game to allow participants to learn the sequence of target positions in different contexts. In the game, the sequence of target positions changes on a short time scale (the sequence of two consecutive positions) and a long time scale (the set of positions in the first and second halves of the game). Participants need to predict the upcoming target positions during the game and judge the similarity of different games based on the temporal structure after the game ends. ### Main Findings 1. **Participant Performance**: - Participants showed sensitivity to sequence information on both short and long time scales, but the learning effect was better for the short time scale. - As training progressed, participants' sensitivity to sequence information on the long time scale increased, but not significantly. 2. **Model Simulation**: - The researchers used a Gated Recurrent Unit (GRU) model to simulate human behavior. The model was able to learn regularities on multiple time scales, and its learning process and sensitivity to similar structures were similar to those of human participants. - The model could group games with the same rule structure and distinguish games more based on low-level sequence information rather than high-level sequence information. ### Conclusion This study shows that both humans and models can learn sequence information on different time scales simultaneously within a short period, although learning is more sensitive to the short time scale. This finding helps to understand how humans quickly learn and adapt to multi-time-scale information in complex environments.

Rapid learning of temporal dependencies at multiple timescales

Time-scale invariant contingency yields one-shot reinforcement learning despite extremely long delays to reinforcement

Temporal Preparation and Statistical Learning: The Influence of Temporal Preparation on Statistical Learning Effects in Complex Temporal Environments

Unraveling Temporal Dynamics of Multidimensional Statistical Learning in Implicit and Explicit Systems: An X‐Way Hypothesis

Multiple timescales of learning indicated by changes in evidence-accumulation processes during perceptual decision-making

Tracking human skill learning with a hierarchical Bayesian sequence model

Episodic Memory for Learning Subjective-Timescale Models

Predictive learning by a burst-dependent learning rule

Deep reinforcement learning with time-scale invariant memory

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

Long-range cortical synchronization supports abrupt visual learning

A bounded accumulation model of temporal generalization outperforms existing models and captures modality differences and learning effects

Temporal Album

Fast implicit and slow explicit learning of temporal context in cortico-cerebellar loops

The influence of temporal context on vision over multiple time scales

Long-horizon associative learning explains human sensitivity to statistical and network structures in auditory sequences

Multi-timescale nexting in a reinforcement learning robot

Flexible structure learning under uncertainty

Perceptual learning evidence for an interval- and modality-invariant representation of subsecond time

Learning spatiotemporal signals using a recurrent spiking network that discretizes time