Abstract:A fundamental objective in Auditory Sciences is to understand how people learn to generalize auditory category knowledge in new situations. How we generalize to novel scenarios speaks to the nature of acquired category representations and generalization mechanisms in handling perceptual variabilities and novelty. The dual learning system (DLS) framework proposes that auditory category learning involves an explicit, hypothesis-testing learning system, which is optimal for learning rule-based (RB) categories, and an implicit, procedural-based learning system, which is optimal for learning categories requiring pre-decisional information integration (II) across acoustic dimensions. Although DLS describes distinct mechanisms of two types of category learning, it is yet clear the nature of acquired representations and how we transfer them to new contexts. Here, we conducted three experiments to examine differences between II and RB category representations by examining what acoustic and perceptual novelties and variabilities affect learners’ generalization success. Learners can successfully categorize different sets of untrained sounds after only eight blocks of training for both II and RB categories. The category structures and novel contexts differentially modulated the generalization success. The II learners significantly decreased generalization performances when categorizing new items derived from an untrained perceptual area and in a context with more distributed samples. In contrast, RB learners’ generalizations are resistant to changes in perceptual regions but are sensitive to changes in sound dispersity. Representational similarity modeling revealed that the generalization in the more dispersed sampling context was accomplished differently by II and RB learners. II learners increased representations of perceptual similarity and decision distance to compensate for the decreased transfer of category representations, whereas the RB learners used a more computational cost strategy by default, computing the decision-bound distance to guide generalization decisions. These results suggest that distinct representations emerged after learning the two types of category structures and using different computations and flexible mechanisms in resolving generalization challenges when facing novel perceptual variability in new contexts. These findings provide new evidence for dissociated representations of auditory categories and reveal novel generalization mechanisms in resolving variabilities to maintain perceptual constancy.

Neural dynamics underlying the acquisition of distinct auditory category structures

Distribution-dependent Representations in Auditory Category Learning and Generalization

Systematic changes in neural selectivity reflect the acquired salience of category-diagnostic dimensions

Task-General and Acoustic-Invariant Neural Representation of Speech Categories in the Human Brain

A hierarchy of processing complexity and timescales for natural sounds in human auditory cortex

Dual systems of speech category learning across the lifespan.

Learning Shapes Spatiotemporal Brain Patterns for Flexible Categorical Decisions

Sound categories are represented as distributed patterns in the human auditory cortex

Neural correlates of phonetic categorization under auditory (phoneme) and visual (grapheme) modalities

Task-specific invariant representation in auditory cortex

Resolving the time course of visual and auditory object categorization

Neural correlates tracking different aspects of the emerging representation of novel visual categories

Individual-specific strategies inform category learning

Attentional modulation and domain-specificity underlying the neural organization of auditory categorical perception

A Distributed Dynamic Brain Network Mediates Linguistic Tone Representation and Categorization.

Acquisition of auditory discrimination mediated by different processes through two distinct circuits linked to the lateral striatum

Auditory Category Learning in Children With Dyslexia

Dynamic encoding of phonetic categories in zebra finch auditory forebrain

Neuroimaging studies of phonetic category learning

The interplay of uncertainty, relevance and learning influences auditory categorization