Abstract:Despite the multidimensional and temporally fleeting nature of auditory signals we quickly learn to assign novel sounds to behaviorally relevant categories. The neural systems underlying the learning and representation of novel auditory categories are far from understood. Current models argue for a rigid specialization of hierarchically organized core regions that are fine-tuned to extracting and mapping relevant auditory dimensions to meaningful categories. Scaffolded within a dual-learning systems approach, we test a competing hypothesis: the spatial and temporal dynamics of emerging auditory-category representations are not driven by the underlying dimensions but are constrained by category structure and learning strategies. To test these competing models, we used functional Magnetic Resonance Imaging (fMRI) to assess representational dynamics during the feedback-based acquisition of novel non-speech auditory categories with identical dimensions but differing category structures: rule-based (RB) categories, hypothesized to involve an explicit sound-to-rule mapping network, and information integration (II) based categories, involving pre-decisional integration of dimensions via a procedural-based sound-to-reward mapping network. Adults were assigned to either the RB (n = 30, 19 females) or II (n = 30, 22 females) learning tasks. Despite similar behavioral learning accuracies, learning strategies derived from computational modeling and involvements of corticostriatal systems during feedback processing differed across tasks. Spatiotemporal multivariate representational similarity analysis revealed an emerging representation within an auditory sensory-motor pathway exclusively for the II learning task, prominently involving the superior temporal gyrus (STG), inferior frontal gyrus (IFG), and posterior precentral gyrus. In contrast, the RB learning task yielded distributed neural representations within regions involved in cognitive-control and attentional processes that emerged at different time points of learning. Our results unequivocally demonstrate that auditory learners' neural systems are highly flexible and show distinct spatial and temporal patterns that are not dimension-specific but reflect underlying category structures and learning strategies.

Task-General and Acoustic-Invariant Neural Representation of Speech Categories in the Human Brain

The Cortical Maps of Hierarchical Linguistic Structures During Speech Perception

A Distributed Dynamic Brain Network Mediates Linguistic Tone Representation and Categorization.

Cooperative Cortical Network for Categorical Processing of Chinese Lexical Tone.

Neural dynamics underlying the acquisition of distinct auditory category structures

Neural Distance Amplification of Lexical Tone in Human Auditory Cortex

Recognizing Tonal and Non-Tonal Mandarin Sentences for EEG-based Brain-Computer Interface

Neural Decoding Reveals Concurrent Phonemic and Subphonemic Representations of Speech Across Tasks

Recognizing Tonal and Nontonal Mandarin Sentences for EEG-Based Brain–Computer Interface

Mandarin Tone Recognition from Brain Dynamics

Human cortical encoding of pitch in tonal and non-tonal languages

Task-dependent decoding of speaker and vowel identity from auditory cortical response patterns

Neural representation of phonological wordform in bilateral posterior temporal cortex

Intracranial Mapping of Response Latencies and Task Effects for Spoken Syllable Processing in the Human Brain

Testing Native Language Neural Commitment at the Brainstem Level: A Cross-Linguistic Investigation of the Association Between Frequency-Following Response and Speech Perception.

Functionally integrated neural processing of linguistic and talker information: An event-related fMRI and ERP study

Cortical specialization associated with native speech category acquisition in early infancy

Neural representation of phonological wordform in temporal cortex

Separate Neural Subsystems Support Goal-Directed Speech Listening.

Cerebellar Representation During Phonetic Processing in Tonal and Non-Tonal Language Speakers: an ALE Meta-Analysis

Neural correlates of phonetic categorization under auditory (phoneme) and visual (grapheme) modalities