Abstract:Our brains constantly generate predictions of sensory input that are compared with actual inputs, propagate the prediction-errors through a hierarchy of brain regions, and subsequently update the internal predictions of the world. However, the essential feature of predictive coding, the notion of hierarchical depth and its neural mechanisms, remains largely unexplored. Here, we investigated the hierarchical depth of predictive auditory processing by combining functional magnetic resonance imaging (fMRI) and high-density whole-brain electrocorticography (ECoG) in marmoset monkeys during an auditory local-global paradigm in which the temporal regularities of the stimuli were designed at two hierarchical levels. The prediction-errors and prediction updates were examined as neural responses to auditory mismatches and omissions. Using fMRI, we identified a hierarchical gradient along the auditory pathway: midbrain and sensory regions represented local, shorter-time-scale predictive processing followed by associative auditory regions, whereas anterior temporal and prefrontal areas represented global, longer-time-scale sequence processing. The complementary ECoG recordings confirmed the activations at cortical surface areas and further differentiated the signals of prediction-error and update, which were transmitted via putative bottom-up γ and top-down β oscillations, respectively. Furthermore, omission responses caused by absence of input, reflecting solely the two levels of prediction signals that are unique to the hierarchical predictive coding framework, demonstrated the hierarchical top-down process of predictions in the auditory, temporal, and prefrontal areas. Thus, our findings support the hierarchical predictive coding framework, and outline how neural networks and spatiotemporal dynamics are used to represent and arrange a hierarchical structure of auditory sequences in the marmoset brain.

Hierarchical Perception Of Monosyllabic Sounds

Decomposition and integration of monosyllabic information for auditory perceptual process

The Cortical Maps of Hierarchical Linguistic Structures During Speech Perception

A neural network model for encoding and perception of vowel sounds

Formation Of An Auditory Map For Invariant Perception Of Vowel Sounds: Listening To A Variety Of Speakers To Make Unified Vowel Representation

Time-domain Analysis of Neural Tracking of Hierarchical Linguistic Structures

A Spiking Neural Network Model for Sound Recognition.

Hierarchical-Concatenate Fusion TDNN for sound event classification

Cortical Processing of Dynamic Sound Envelope Transitions

Neural Signatures of Hierarchical Linguistic Structures in Second Language Listening Comprehension

A hierarchical sparse coding model predicts acoustic feature encoding in both auditory midbrain and cortex

Learning Midlevel Auditory Codes from Natural Sound Statistics

Sound reconstruction from human brain activity via a generative model with brain-like auditory features

Neural manifolds carry reactivation of phonetic representations during semantic processing

Constructing the hierarchy of predictive auditory sequences in the marmoset brain

Exploring Hierarchical Auditory Representation via a Neural Encoding Model

Neural Representation of Harmonic Single Sideband Encoder in Inferior Colliculus of Guinea Pigs

A Systematic Approach To Compute Perceptual Distribution Of Monosyllables

Complex Mapping between Neural Response Frequency and Linguistic Units in Natural Speech

A hierarchy of processing complexity and timescales for natural sounds in human auditory cortex

Distinct Neuronal Types Contribute to Hybrid Temporal Encoding Strategies in Primate Auditory Cortex