Abstract:Objetive. Decoding speech from brain activity can enable communication for individuals with speech disorders. Deep neural networks have shown great potential for speech decoding applications. However, the limited availability of large datasets containing neural recordings from speech-impaired subjects poses a challenge. Leveraging data from healthy participants can mitigate this limitation and expedite the development of speech neuroprostheses while minimizing the need for patient-specific training data. Approach. In this study, we collected a substantial dataset consisting of recordings from 56 healthy participants using 64 EEG channels. Multiple neural networks were trained to classify perceived sentences in the Spanish language using subject-independent, mixed-subjects, and fine-tuning approaches. The dataset has been made publicly available to foster further research in this area. Main results. Our results demonstrate a remarkable level of accuracy in distinguishing sentence identity across 30 classes, showcasing the feasibility of training Deep Neural Networks (DNNs) to decode sentence identity from perceived speech using EEG. Notably, the subject-independent approach rendered accuracy comparable to the mixed-subjects approach, although with higher variability among subjects. Additionally, our fine-tuning approach yielded even higher accuracy, indicating an improved capability to adapt to individual subject characteristics, which enhances performance. This suggests that DNNs have effectively learned to decode universal features of brain activity across individuals while also being adaptable to specific participant data. Furthermore, our analyses indicate that EEGNet and DeepConvNet exhibit comparable performance, outperforming ShallowConvNet for sentence identity decoding. Finally, our Grad-CAM visualization analysis identifies key areas influencing the network's predictions, offering valuable insights into the neural processes underlying language perception and comprehension. Significance. These findings advance our understanding of EEG-based speech perception decoding and hold promise for the development of speech neuroprostheses, particularly in scenarios where subjects cannot provide their own training data.

Unraveling Brain Synchronisation Dynamics by Explainable Neural Networks using EEG Signals: Application to Dyslexia Diagnosis

Detecting Phase-Synchrony Connectivity Anomalies in EEG Signals. Application to Dyslexia Diagnosis

DSMN-ESS: Dual-Stream Multitask Network for Epilepsy Syndrome Classification and Seizure Detection.

A Translational Framework of Educational Neuroscience in Learning Disorders

Dyslexia Diagnosis by EEG Temporal and Spectral Descriptors: An Anomaly Detection Approach

Modelling Brain Connectivity Networks by Graph Embedding for Dyslexia Diagnosis

Complex network modelling of EEG band coupling in dyslexia: an exploratory analysis of auditory processing and diagnosis

Dyslexia detection from EEG signals using SSA component correlation and Convolutional Neural Networks

EEG Connectivity Analysis Using Denoising Autoencoders for the Detection of Dyslexia

Visual Explanation for Identification of the Brain Bases for Dyslexia on fMRI Data

Features and Machine Learning for Correlating and Classifying between Brain Areas and Dyslexia

Neural source/sink phase connectivity in developmental dyslexia by means of interchannel causality

Atypical low-frequency cortical encoding of speech identifies children with developmental dyslexia

Assisting Schizophrenia Diagnosis Using Clinical Electroencephalography and Interpretable Graph Neural Networks: a Real-World and Cross-Site Study

Temporal EigenPAC for dyslexia diagnosis

eDeeplepsy: An artificial neural framework to reveal different brain states in children with epileptic spasms

Interpretable SincNet-based Deep Learning for Emotion Recognition from EEG brain activity

Real-Time Non-Invasive Imaging and Detection of Spreading Depolarizations through EEG: An Ultra-Light Explainable Deep Learning Approach

Identification of perceived sentences using deep neural networks in EEG

Personalized identification, prediction, and stimulation of neural oscillations via data-driven models of epileptic network dynamics

Automatic classification of dyslexic children by applying machine learning to fMRI images