Abstract:Background: Incorporating the time-frequency localization properties of Gabor transform (GT), the complexity understandings of convolutional neural network (CNN), and histogram of oriented gradients (HOG) efficacy in distinguishing positive peaks can exhibit their characteristics to reveal an effective solution in the detection of P300 evoked related potential (ERP). By applying a drastic number of convolutional layers, the majority of deep networks elicit sufficient properties for the output determination, leading to gigantic and time-consuming structures. In this paper, we propose a novel deep learning framework by the combination of tuned GT, and modified HOG with the CNN as "TGT-MHOG-CNN" for detection of P300 ERP in EEG signal. Method: In the proposed method, GT is tuned based on triangular function for EEG signals, and then spectrograms including time-frequency information are captured. The function's parameters are justified to differentiate the signals with the P300 component. Furthermore, HOG is modified (MHOG) for the 2-D EEG signal, and consequently, gradients patterns are extracted for the target potentials. MHOG is potent in distinguishing the positive peak in the general waveform; however, GT unravels time-frequency information, which is ignored in the gradient histogram. These outputs of GT and MHOG do not share the same nature in the images nor overlap. Therefore, more extensive information is reached without redundancy or excessive information by fusing them. Combining GT and MHOG provides different patterns which benefit CNN for more precise detection. Consequently, TGT-MHOG-CNN ends in a more straightforward structure than other networks, and therefore, the whole performance is acceptable with faster rates and very high accuracy. Results: BCI Competition II and III datasets are used to evaluate the performance of the proposed method. These datasets include a complete record for P300 ERP with BCI2000 using a paradigm, and it has numerous noises, including power and muscle-based noises. The objective is to predict the correct character in each provided character selection epochs. Compared to state-of-the-art methods, simulation results indicate striking abilities of the proposed framework for P300 ERP detection. Our best record reached the P300 ERP classification rates of over 98.7% accuracy and 98.7% precision for BCI Competition II and 99% accuracy and 100% precision for BCI Competition III datasets, with superiority in execution time for the mentioned datasets.

Deep learning based on Batch Normalization for P300 signal detection

A Convolutional Neural Network Based on Batch Normalization and Residual Block for P300 Signal Detection of P300-speller System

A Novel Neural Network for P300 Brain-Computer Interface Signal Recognition

Towards Effective Deep Neural Network Approach for Multi-Trial P300-based Character Recognition in Brain-Computer Interfaces

Spatial-Temporal Neural Network for P300 Detection

Leveraging Deep Learning Techniques to Improve P300-Based Brain Computer Interfaces

P300 Event-Related Potential Detection Using One-Dimensional Convolutional Capsule Networks.

Novel Convolutional Neural Network with Variational Information Bottleneck for P300 Detection.

The Detection of P300 Potential Based on Deep Belief Network

A Shallow Spiking Neural Network for P300 Classification

A P300-Detection Method Based on Logistic Regression and a Convolutional Neural Network

Performance Enhancement of P300 Detection by Multiscale-CNN

Learning Invariant Patterns Based on a Convolutional Neural Network and Big Electroencephalography Data for Subject-Independent P300 Brain-Computer Interfaces

A Lightweight Multi-Scale Convolutional Neural Network for P300 Decoding: Analysis of Training Strategies and Uncovering of Network Decision

Eliminating or Shortening the Calibration for a P300 Brain–Computer Interface Based on a Convolutional Neural Network and Big Electroencephalography Data: An Online Study

An efficient deep learning framework for P300 evoked related potential detection in EEG signal

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

P300 Detection Using Boosting Neural Networks with Application to BCI

A New Dynamically Convergent Differential Neural Network for Brain Signal Recognition

Using Convolutional Neural Networks for Identification Based on EEG Signals

Fuzzy temporal convolutional neural networks in P300-based Brain-computer interface for smart home interaction