Abstract:Despite the multidimensional and temporally fleeting nature of auditory signals we quickly learn to assign novel sounds to behaviorally relevant categories. The neural systems underlying the learning and representation of novel auditory categories are far from understood. Current models argue for a rigid specialization of hierarchically organized core regions that are fine-tuned to extracting and mapping relevant auditory dimensions to meaningful categories. Scaffolded within a dual-learning systems approach, we test a competing hypothesis: the spatial and temporal dynamics of emerging auditory-category representations are not driven by the underlying dimensions but are constrained by category structure and learning strategies. To test these competing models, we used functional Magnetic Resonance Imaging (fMRI) to assess representational dynamics during the feedback-based acquisition of novel non-speech auditory categories with identical dimensions but differing category structures: rule-based (RB) categories, hypothesized to involve an explicit sound-to-rule mapping network, and information integration (II) based categories, involving pre-decisional integration of dimensions via a procedural-based sound-to-reward mapping network. Adults were assigned to either the RB (n = 30, 19 females) or II (n = 30, 22 females) learning tasks. Despite similar behavioral learning accuracies, learning strategies derived from computational modeling and involvements of corticostriatal systems during feedback processing differed across tasks. Spatiotemporal multivariate representational similarity analysis revealed an emerging representation within an auditory sensory-motor pathway exclusively for the II learning task, prominently involving the superior temporal gyrus (STG), inferior frontal gyrus (IFG), and posterior precentral gyrus. In contrast, the RB learning task yielded distributed neural representations within regions involved in cognitive-control and attentional processes that emerged at different time points of learning. Our results unequivocally demonstrate that auditory learners' neural systems are highly flexible and show distinct spatial and temporal patterns that are not dimension-specific but reflect underlying category structures and learning strategies.

The acquisition of speech categories: Beyond perceptual narrowing, beyond unsupervised learning and beyond infancy

Learning phonetic categories in infancy: The role of word-context information

Neural dynamics underlying the acquisition of distinct auditory category structures

The formation of perceptual space in early phonetic acquisition: a cross-linguistic modeling approach

Dual systems of speech category learning across the lifespan.

Modeling early phonetic acquisition from child-centered audio data

A computational model of early language acquisition from audiovisual experiences of young infants

Infant vocal category exploration as a foundation for speech development

A model of early word acquisition based on realistic-scale audiovisual naming events

Simulating the Acquisition of Lexical Tones from Continuous Dynamic Input

Speech Perception in Infants

Evaluating computational models of infant phonetic learning across languages

Low-dimensional representation of infant and adult vocalization acoustics

Systematic changes in neural selectivity reflect the acquired salience of category-diagnostic dimensions

Infant directed speech and the development of speech perception: Enhancing development or an unintended consequence?

Developmental Predictive Coding Model for Early Infancy Mono and Bilingual Vocal Continual Learning

Sensitive periods in language development: Do children outperform adults on auditory word-form segmentation?

An auditory perspective on phonological development in infancy

Exploration, Distributed Attention, and Development of Category Learning

Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks

Maintenance of subcategorical information during speech perception: Revisiting misunderstood limitations