Abstract:In recent years, electroencephalograph (EEG) studies on speech comprehension have been extended from a controlled paradigm to a natural paradigm. Under the hypothesis that the brain can be approximated as a linear time-invariant system, the neural response to natural speech has been investigated extensively using temporal response functions (TRFs). However, most studies have modeled TRFs in the electrode space, which is a mixture of brain sources and thus cannot fully reveal the functional mechanism underlying speech comprehension. In this paper, we propose methods for investigating the brain networks of natural speech comprehension using TRFs on the basis of EEG source reconstruction. We first propose a functional hyper-alignment method with an additive average method to reduce EEG noise. Then, we reconstruct neural sources within the brain based on the EEG signals to estimate TRFs from speech stimuli to source areas, and then investigate the brain networks in the neural source space on the basis of the community detection method. To evaluate TRF-based brain networks, EEG data were recorded in story listening tasks with normal speech and time-reversed speech. To obtain reliable structures of brain networks, we detected TRF-based communities from multiple scales. As a result, the proposed functional hyper-alignment method could effectively reduce the noise caused by individual settings in an EEG experiment and thus improve the accuracy of source reconstruction. The detected brain networks for normal speech comprehension were clearly distinctive from those for non-semantically driven (time-reversed speech) audio processing. Our result indicates that the proposed source TRFs can reflect the cognitive processing of spoken language and that the multi-scale community detection method is powerful for investigating brain networks.

Thread Reconstruction in Conversational Data using Neural Coherence Models

Coherence Modeling of Asynchronous Conversations: A Neural Entity Grid Approach

A Model of Coherence Based on Distributed Sentence Representation.

Text Coherence Analysis Based on Deep Neural Network.

Analyzing Neural Discourse Coherence Models

Neural Net Models for Open-Domain Discourse Coherence

Simultaneously Modeling Semantics And Structure Of Threaded Discussions: A Sparse Coding Approach And Its Applications

Modeling Coherence for Discourse Neural Machine Translation

Thread Structure Prediction for MOOC Discussion Forum.

Reconstruction of Noise-Driven Nonlinear Networks from Node Outputs by Using High-Order Correlations

NesTPP: Modeling Thread Dynamics in Online Discussion Forums

A Novel Computational and Modeling Foundation for Automatic Coherence Assessment

Conversation Modeling on Reddit Using a Graph-Structured LSTM

Modeling semantics and structure of discussion threads.

Toward Extractive Summarization of Online Forum Discussions via Hierarchical Attention Networks

Neural Discourse Modeling of Conversations

Detection of Brain Network Communities During Natural Speech Comprehension From Functionally Aligned EEG Sources

Coherence-Aware Neural Topic Modeling

Learning The Structures Of Online Asynchronous Conversations

Structural Modeling for Dialogue Disentanglement

POSLAN: Disentangling Chat with Positional and Language encoded Post Embeddings