Abstract:OBJECTIVE: Despite the effective application of deep learning (DL) in brain-computer interface (BCI) systems, the successful execution of this technique, especially for inter-subject classification, in cognitive BCI has not been accomplished yet. In this paper, we propose a framework based on the deep convolutional neural network (CNN) to detect the attentive mental state from single-channel raw electroencephalography (EEG) data.APPROACH: We develop an end-to-end deep CNN to decode the attentional information from an EEG time series. We also explore the consequences of input representations on the performance of deep CNN by feeding three different EEG representations into the network. To ensure the practical application of the proposed framework and avoid time-consuming re-training, we perform inter-subject transfer learning techniques as a classification strategy. Eventually, to interpret the learned attentional patterns, we visualize and analyse the network perception of the attention and non-attention classes.MAIN RESULTS: The average classification accuracy is 79.26%, with only 15.83% of 120 subjects having an accuracy below 70% (a generally accepted threshold for BCI). This is while with the inter-subject approach, it is literally difficult to output high classification accuracy. This end-to-end classification framework surpasses conventional classification methods for attention detection. The visualization results demonstrate that the learned patterns from the raw data are meaningful.SIGNIFICANCE: This framework significantly improves attention detection accuracy with inter-subject classification. Moreover, this study sheds light on the research on end-to-end learning; the proposed network is capable of learning from raw data with the least amount of pre-processing, which in turn eliminates the extensive computational load of time-consuming data preparation and feature extraction.

Low-Dimensional Subject Representation-Based Transfer Learning in EEG Decoding

Transfer Learning with Large-Scale Data in Brain-Computer Interfaces.

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Selective Transfer Learning for EEG-Based Drowsiness Detection

Application of Transfer Learning in EEG Decoding Based on Brain-Computer Interfaces: A Review

Riemannian transfer learning based on log-Euclidean metric for EEG classification

Evaluating the structure of cognitive tasks with transfer learning

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

A subject-transfer framework for obviating inter- and intra-subject variability in EEG-based drowsiness detection

Transfer Learning for EEG-Based Brain-Computer Interfaces: A Review of Progress Made Since 2016

Learning joint space-time-frequency features for EEG decoding on small labeled data

A Survey on Deep Learning-Based Short/Zero-Calibration Approaches for EEG-Based Brain-Computer Interfaces

Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approach.

Cross-Subject Transfer Learning Improves the Practicality of Real-World Applications of Brain-Computer Interfaces

EEGNet-based multi-source domain filter for BCI transfer learning

Personalized Continual EEG Decoding Framework for Knowledge Retention and Transfer

Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface

Continuous Tracking using Deep Learning-based Decoding for Non-invasive Brain-Computer Interface

An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding

Deep Source Semi-Supervised Transfer Learning (DS3TL) for Cross-Subject EEG Classification.

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI