Abstract:In many domains, learners extract recurring units from continuous sequences. For example, in unknown languages, fluent speech is perceived as a continuous signal. Learners need to extract the underlying words from this continuous signal and then memorize them. One prominent candidate mechanism is statistical learning, whereby learners track how predictive syllables (or other items) are of one another. Syllables within the same word predict each other better than syllables straddling word boundaries. But does statistical learning lead to memories of the underlying words—or just to pairwise associations among syllables? Electrophysiological results provide the strongest evidence for the memory view. Electrophysiological responses can be time‐locked to statistical word boundaries (e.g., N400s) and show rhythmic activity with a periodicity of word durations. Here, I reproduce such results with a simple Hebbian network. When exposed to statistically structured syllable sequences (and when the underlying words are not excessively long), the network activation is rhythmic with the periodicity of a word duration and activation maxima on word‐final syllables. This is because word‐final syllables receive more excitation from earlier syllables with which they are associated than less predictable syllables that occur earlier in words. The network is also sensitive to information whose electrophysiological correlates were used to support the encoding of ordinal positions within words. Hebbian learning can thus explain rhythmic neural activity in statistical learning tasks without any memory representations of words. Learners might thus need to rely on cues beyond statistical associations to learn the words of their native language. Research Highlights Statistical learning may be utilized to identify recurring units in continuous sequences (e.g., words in fluent speech) but may not generate explicit memory for words. Exposure to statistically structured sequences leads to rhythmic activity with a period of the duration of the underlying units (e.g., words). I show that a memory‐less Hebbian network model can reproduce this rhythmic neural activity as well as putative encodings of ordinal positions observed in earlier research. Direct tests are needed to establish whether statistical learning leads to declarative memories for words.

Statistical Features in Learning

Learning with incomplete information - and the mathematical structure behind it

Neural Networks Learn Statistics of Increasing Complexity

From statistical inference to a differential learning rule for stochastic neural networks

Simple statistical gradient-following algorithms for connectionist reinforcement learning

A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks

Learning in Associative Networks through Pavlovian Dynamics

Lyapunov Functional for Neural Networks with Delayed Interactions and Statistical Mechanics of Temporal Associations

One Step Back, Two Steps Forward: Interference and Learning in Recurrent Neural Networks

On the Feature Learning in Diffusion Models

Hebbian learning can explain rhythmic neural entrainment to statistical regularities

Contributions of statistical learning to learning from reward feedback

Learning Temporal Distances: Contrastive Successor Features Can Provide a Metric Structure for Decision-Making

Holographic Principle and Quantum Physics

Measuring the Stability of Learned Features

Reinforcement Learning under Latent Dynamics: Toward Statistical and Algorithmic Modularity

A simple normative network approximates local non-Hebbian learning in the cortex

Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learning

A Mathematical Analysis of Memory Lifetime in a Simple Network Model of Memory

Statistical mechanics of learning via reverberation in bidirectional associative memories

Active Learning with Statistical Models