Abstract:Our brains selectively attend to current task-relevant stimuli while ignore those sensory inputs irrelevant in plenty of information from different senses every day. The attention mechanism can help the brain select and filter effective information. Attention can affect single sensory information, as well as multiple sensory systems, in a top-down manner based on the goals and intentions of observers. Attention is an important factor affecting cognition, and can modulate various stages of the cognitive process. The comparison of attended versus unattended audiovisual multisensory EEGs showed some significant differences, providing the possibility for us to classify the cognitive process with or without attention involvement. The classification and recognition of cognitive processes with or without attention involvement is helpful for the diagnosis and recognition of mental disorders related to attention deficits. Here, we designed an audiovisual integration experiment using semantically congruent audiovisual stimuli to record the EEG signals associated with attended and unattended audiovisual stimuli. Then, statistical tests were used to detect the time and corresponding electrodes with significant differences between these two types EEGs of audiovisual integration. The peak amplitude and latency of these electrodes with significant differences were entered into SVM classifier as feature vector sets for training and testing. We further used the sequential forward searching (SFS) method to minimize the eigenvectors set. The result showed that the peak amplitude and latency of channel FP2, F1, FZ, F8, FC1, C5, AF3, F2, F4, FC5, FC3, FCZ, T7, F7, F3, F5, FC2, FC6, C1, AF4, F6, FT7, AF4, F6, FT7, FC4, C3, C6, T8, FT8 in time period of 260-300 milliseconds as the eigenvector reached the highest classification accuracy of 71.43%. This indicated that the difference between attended and unattended audiovisual integration in fronto-central area are the most significant, further indicating that the attention in the frontal lobe has the strongest modulation effect on audiovisual integration in this time range. In addition, a SVM classification model was obtained through a novel feature analysis method, which increased the classification accuracy to more than 70%, indicating that the evaluation model based on this method was effective. We hope that our work will provide effective help for objective diagnosis of attention-related cognitive impairment.

Classification of visual comprehension based on EEG data using sparse optimal scoring

Locked in Syndrome Machine Learning Classification using Sentence Comprehension EEG Data

Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning

An Extended Computer-Aided Diagnosis System for Multidomain EEG Classification

Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

ChatGPT-BCI: Word-Level Neural State Classification Using GPT, EEG, and Eye-Tracking Biomarkers in Semantic Inference Reading Comprehension

Mapping EEG Signals to Visual Stimuli: A Deep Learning Approach to Match Vs. Mismatch Classification

Integrating LLM, EEG, and Eye-Tracking Biomarker Analysis for Word-Level Neural State Classification in Semantic Inference Reading Comprehension

Decoding Visual Recognition of Objects from EEG Signals based on Attention-Driven Convolutional Neural Network

EEG-Based Classification of Spoken Words Using Machine Learning Approaches

Applying advanced machine learning models to classify electro-physiological activity of human brain for use in biometric identification

EEG classification for visual brain decoding with spatio-temporal and transformer based paradigms

Integrating Large Language Model, EEG, and Eye-Tracking for Word-Level Neural State Classification in Reading Comprehension

EEG Correlates of Language Function in Traumatic Disorders of Consciousness

Continuous and discrete decoding of overt speech with electroencephalography

Automated Classification of Cognitive Visual Objects Using Multivariate Swarm Sparse Decomposition From Multichannel EEG-MEG Signals

Decoding Musical Neural Activity in Patients with Disorders of Consciousness Through Self-Supervised Contrastive Domain Generalization

Combining Statistical Analysis and Machine Learning for EEG Scalp Topograms Classification

Investigating of Deaf Emotion Cognition Pattern by EEG and Facial Expression Combination

A Multi-channel EEG Data Analysis for Poor Neuro-prognostication in Comatose Patients with Self and Cross-channel Attention Mechanism

A Novel Feature Analysis Method for EEG Signal Classification of Attended and Unattended Audiovisual Integration