Abstract:Phase‐encoded fMRI captures the step‐by‐step spatiotemporal brain dynamics of cognitive processes. When a sentence is heard, language information is carried across the auditory cortex in multiple streams of traveling waves. This provides direct evidence for and supplement the dual‐stream model of speech processing. Natural language processing unfolds information overtime as spatially separated, multimodal, and interconnected neural processes. Existing noninvasive subtraction‐based neuroimaging techniques cannot simultaneously achieve the spatial and temporal resolutions required to visualize ongoing information flows across the whole brain. Here we have developed rapid phase‐encoded designs to fully exploit the temporal information latent in functional magnetic resonance imaging data, as well as overcoming scanner noise and head‐motion challenges during overt language tasks. We captured real‐time information flows as coherent hemodynamic waves traveling over the cortical surface during listening, reading aloud, reciting, and oral cross‐language interpreting tasks. We were able to observe the timing, location, direction, and surge of traveling waves in all language tasks, which were visualized as "brainstorms" on brain "weather" maps. The paths of hemodynamic traveling waves provide direct evidence for dual‐stream models of the visual and auditory systems as well as logistics models for crossmodal and cross‐language processing. Specifically, we have tracked down the step‐by‐step processing of written or spoken sentences first being received and processed by the visual or auditory streams, carried across language and domain‐general cognitive regions, and finally delivered as overt speeches monitored through the auditory cortex, which gives a complete picture of information flows across the brain during natural language functioning. Practitioner Points Phase‐encoded fMRI enables simultaneous imaging of high spatial and temporal resolution, capturing continuous spatiotemporal dynamics of the entire brain during real‐time overt natural language tasks. Spatiotemporal traveling wave patterns provide direct evidence for constructing comprehensive and explicit models of human information processing. This study unlocks the potential of applying rapid phase‐encoded fMRI to indirectly track the underlying neural information flows of sequential sensory, motor, and high‐order cognitive processes.

Revealing the Spatiotemporal Brain Dynamics of Covert Speech compared with Overt Speech: A Simultaneous EEG-fMRI Study

Statistical Learning in Patients in the Minimally Conscious State.

Revealing Spatiotemporal Brain Dynamics Of Speech Production Based On Eeg And Eye Movement

Spatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task

A pilot exploration of resting state brain default mode network by using fMRI (Ⅱ): with auditory language tasks

Imagined Speech Increases the Hemodynamic Response and Functional Connectivity of the Dorsal Motor Cortex.

A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech

Decoding Covert Speech From EEG-A Comprehensive Review

Continuous and discrete decoding of overt speech with electroencephalography

Temporal-Spatial-Spectral Investigation of Brain Network Dynamics in Human Speech Perception

Gender difference in spontaneous deception: A hyperscanning study using functional near-infrared spectroscopy

A comparison and classification of oscillatory characteristics in speech perception and covert speech

Voice of Your Brain: Cognitive Representations of Imagined Speech,Overt Speech, and Speech Perception Based on EEG

Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

Phase‐encoded fMRI tracks down brainstorms of natural language processing with subsecond precision

Spatiotemporal Dissociation of Brain Activity underlying Subjective Awareness, Objective Performance and Confidence

Speech Activity Detection from Stereotactic EEG

Speech decoding using cortical and subcortical electrophysiological signals

Let ear speak:an auricular frontal-lobe-point's near-infrared spectroscope brain-computer interface

Imagined speech can be decoded from low- and cross-frequency intracranial EEG features

Towards Decoding Brain Activity During Passive Listening of Speech