Abstract:Spoken word recognition and production require fast transformations between acoustic, phonological, and conceptual neural representations. Bilinguals perform these transformations in native and non-native languages, deriving unified semantic concepts from equivalent, but acoustically different words. Here we exploit this capacity of bilinguals to investigate input invariant semantic representations in the brain. We acquired EEG data while Dutch subjects, highly proficient in English listened to four monosyllabic and acoustically distinct animal words in both languages (e.g., "paard"-"horse"). Multivariate pattern analysis (MVPA) was applied to identify EEG response patterns that discriminate between individual words within one language (within-language discrimination) and generalize meaning across two languages (across-language generalization). Furthermore, employing two EEG feature selection approaches, we assessed the contribution of temporal and oscillatory EEG features to our classification results. MVPA revealed that within-language discrimination was possible in a broad time-window (~50-620 ms) after word onset probably reflecting acoustic-phonetic and semantic-conceptual differences between the words. Most interestingly, significant across-language generalization was possible around 550-600 ms, suggesting the activation of common semantic-conceptual representations from the Dutch and English nouns. Both types of classification, showed a strong contribution of oscillations below 12 Hz, indicating the importance of low frequency oscillations in the neural representation of individual words and concepts. This study demonstrates the feasibility of MVPA to decode individual spoken words from EEG responses and to assess the spectro-temporal dynamics of their language invariant semantic-conceptual representations. We discuss how this method and results could be relevant to track the neural mechanisms underlying conceptual encoding in comprehension and production.

EEG decoding of spoken words in bilingual listeners: from words to language invariant semantic-conceptual representations

Classifying native versus foreign speech perception from EEG using linguistic speech features

Early language dissociation in bilingual minds: magnetoencephalography evidence through a machine learning approach

Parallel or sequential? Decoding conceptual and phonological/phonetic information from MEG signals during language production

Unconstrained multivariate EEG decoding can help detect lexical-semantic processing in individual children

Decoding syntactic class from EEG during spoken word recognition

Analyzing Differences in Processing Nouns and Verbs in the Human Brain using Combined EEG and MEG Measurements

Classifying coherent versus nonsense speech perception from EEG using linguistic speech features

Decoding individual words from non-invasive brain recordings across 723 participants

Decoding EEG Brain Activity for Multi-Modal Natural Language Processing

Semantic Features Reveal Different Networks During Word Processing: An EEG Source Localization Study

Decoding Imagined Speech from EEG Data: A Hybrid Deep Learning Approach to Capturing Spatial and Temporal Features

Decoding speech perception from non-invasive brain recordings

Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

Decoding speech from non-invasive brain recordings

The neural dynamics of auditory word recognition and integration

Continuous and discrete decoding of overt speech with electroencephalography

Decoding bilingualism from resting-state oscillatory network organization

Deep Representation Learning for Open Vocabulary Electroencephalography-to-Text Decoding

Neural Decoding Reveals Concurrent Phonemic and Subphonemic Representations of Speech Across Tasks

Decoding Semantics from Dynamic Brain Activation Patterns: From Trials to Task in EEG/MEG Source Space