Electron Microscopic Observation of Magnetic Bubble Garnets

T. Suzuki,K. Hiraga,E. Aoyagi

DOI: https://doi.org/10.1109/TJMJ.1985.4548535

1985-05-01

IEEE Translation Journal on Magnetics in Japan

Abstract:

What problem does this paper attempt to address?

Riemannian transfer learning based on log-Euclidean metric for EEG classification

Fanbo Zhuo,Xiaocheng Zhang,Fengzhen Tang,Yaobo Yu,Lianqing Liu

DOI: https://doi.org/10.3389/fnins.2024.1381572

IF: 4.3

2024-05-30

Frontiers in Neuroscience

Abstract:Introduction: Brain computer interfaces (BCI), which establish a direct interaction between the brain and the external device bypassing peripheral nerves, is one of the hot research areas. How to effectively convert brain intentions into instructions for controlling external devices in real-time remains a key issue that needs to be addressed in brain computer interfaces. The Riemannian geometry-based methods have achieved competitive results in decoding EEG signals. However, current Riemannian classifiers tend to overlook changes in data distribution, resulting in degenerated classification performance in cross-session and/or cross subject scenarios. Methods: This paper proposes a brain signal decoding method based on Riemannian transfer learning, fully considering the drift of the data distribution. Two Riemannian transfer learning methods based log-Euclidean metric are developed, such that historical data (source domain) can be used to aid the training of the Riemannian decoder for the current task, or data from other subjects can be used to boost the training of the decoder for the target subject. Results: The proposed methods were verified on BCI competition III, IIIa, and IV 2a datasets. Compared with the baseline that without transfer learning, the proposed algorithm demonstrates superior classification performance. In contrast to the Riemann transfer learning method based on the affine invariant Riemannian metric, the proposed method obtained comparable classification performance, but is much more computationally efficient. Discussion: With the help of proposed transfer learning method, the Riemannian classifier obtained competitive performance to existing methods in the literature. More importantly, the transfer learning process is unsupervised and time-efficient, possessing potential for online learning scenarios.

neurosciences
Mutational alteration of the p16CDKN2a tumor suppressor gene is infrequent in Ewing's sarcoma.

Y. K. Park,S. Chi,Y. W. Kim,H. Park,K. Unni

DOI: https://doi.org/10.3892/OR.6.6.1261

1999-11-01

Abstract:Mutational alteration of the p16CDKN2a tumor suppressor gene has been frequently observed in a variety of human cell lines and tumor tissues. To assess whether alterations of the p16CDKN2a gene play an important role in the pathogenesis of Ewing's sarcoma, we examined the allelic deletion and point mutation of the gene in 27 primary tumors. In quantitative DNA/PCR analysis for three individual exons of the gene, none of the 27 specimens showed detectable reduction in the amplification levels compared to those of normal lymphocytes. To explore the presence of any subtle sequence changes within the protein coding region, we performed a comprehensive screening of sequence alteration in the three exons using DNA/PCR-SSCP analysis. However, no abnormal shift of SSCP bands indicative of sequence change was identified. In addition, no elevation of p16CDKN2a mRNA expression was observed in the RD-ES cell line following 5'-Aza-cytidine treatment, indicating that the promoter of the gene is not abnormally methylated in this cell line. Immunohistochemical study of the same tissue specimens for p16CDKN2a and pRB also revealed grade 2+ or 3+ nuclear staining of both proteins in most of the specimens we examined. Taken together, our results strongly suggest that the mutational inactivation of the p16CDKN2a gene might be a rare event, and thus not play a critical role in the pathogenesis of Ewing's sarcoma.
Transfer Learning: Rotation Alignment with Riemannian Mean for Brain-Computer Interfaces and Wheelchair Control

Xianlun Tang,Xingchen Li,Wei Li,Bohui Hao,Ying Xie,Xiaoyuan Dang

DOI: https://doi.org/10.1109/tcds.2021.3082648

IF: 4.546

2021-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:The cross-session and cross-subject classification of motor imagery (MI) electroencephalogram (EEG) signals is challenging. This article presents a transfer learning (TL) method to address the cross-session and cross-subject classification of MI EEG signals, a tricky procedure in brain–computer interface (BCI). Method: We propose a rotation alignment domain adaptation method with Riemannian mean (RMRA). The method uses covariance matrix to represent data feature, and achieves data alignment by rotating the symmetric positive-definite (SPD) matrix in Riemannian space. In this process, our proposed matrix-TCA extends the traditional transfer component analysis (TCA) to a matrix form in order to function in the Riemannian framework. Data labels are not required, so the proposed method is unsupervised. In addition, we simplify the calculation process through Riemannian mean. Results: We have performed both offline and online experiments on multiple MI EEG data sets. Our results show that RMRA improves the cross-session and cross-subject classification accuracy. Conclusion and Significance: This article presents a new approach to cross-domain learning, which achieves desirable results and shows great promise in real-life application of the service robot (intelligent wheelchair).

robotics,computer science, artificial intelligence,neurosciences
Riemannian Geometric Instance Filtering for Transfer Learning in Brain-Computer Interfaces.

Qianxin Hui,Xiaolin Liu,Yang Li,Susu Xu,Shuailei Zhang,Ying Sun,Shuai Wang,Xinlei Chen,Dezhi Zheng

DOI: https://doi.org/10.1145/3560905.3568434

2022-01-01

Abstract:Due to the inter-subject variability of Electroencephalogram(EEG) signals, a long calibration time is required to collect a large number of labeled trials to calibrate classifier parameters before using the Brain-computer Interface(BCI). This challenge greatly limits the practical roll-out of BCIs. To address this problem, we propose a novel instance-based transfer learning framework named Riemannian Geometric Instance Filtering (RGIF) to reduce calibration time without sacrificing accuracy. A new inter-subject similarity metric based on Riemannian geometry is proposed to measure the similarity between a few trials from the target subject and adequate trials from source subjects. The classification model for the target subject is then trained with the help of abundant trials from similar source subjects with high similarity to the target subject. We evaluate our method on two open-source EEG datasets. The results show that our approach improves significantly compared with other baselines. Furthermore, compared with using all source subjects data, our method reduces the training time by at least half and achieves slightly better accuracy.
Three-stage transfer learning for motor imagery EEG recognition

Junhao Li,Qingshan She,Ming Meng,Shengzhi Du,Yingchun Zhang

DOI: https://doi.org/10.1007/s11517-024-03036-9

2024-02-14

Medical & Biological Engineering & Computing

Abstract:Motor imagery (MI) paradigms have been widely used in neural rehabilitation and drowsiness state assessment. The progress in brain-computer interface (BCI) technology has emphasized the importance of accurately and efficiently detecting motor imagery intentions from electroencephalogram (EEG). Despite the recent breakthroughs made in developing EEG-based algorithms for decoding MI, the accuracy and efficiency of these models remain limited by technical challenges posed by cross-subject heterogeneity in EEG data processing and the scarcity of EEG data for training. Inspired by the optimal transport theory, this study aims to develop a novel three-stage transfer learning (TSTL) method, which uses the existing labeled data from a source domain to improve classification performance on an unlabeled target domain. Notably, the proposed method comprises three components, namely, the Riemannian tangent space mapping (RTSM), source domain transformer (SDT), and optimal subspace mapping (OSM). The RTSM maps a symmetric positive definite matrix from the Riemannian space to the tangent space to minimize the marginal probability distribution drift. The SDT transforms the source domain to a target domain by finding the optimal transport mapping matrix to reduce the joint probability distribution differences. The OSM finally maps the transformed source domain and original target domain to the same subspace to further mitigate the distribution discrepancy. The performance of the proposed method was validated on two public BCI datasets, and the average accuracy of the algorithm on two datasets was 72.24% and 69.29%. Our results demonstrated the improved performance of EEG-based MI detection in comparison with state-of-the-art algorithms.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics
A novel heterogeneous transfer learning method based on data stitching for the sequential coding brain computer interface

Qianqian Zhan,Li Wang,Lingling Ren,Xuewen Huang

DOI: https://doi.org/10.1016/j.compbiomed.2022.106220

Abstract:Objective: For the brain computer interface (BCI), it is necessary to collect enough electroencephalography (EEG) signals to train the classification model. When the operation dimension of BCI is large, it will bring great burden to data acquisition. Fortunately, this problem can be solved by our proposed transfer learning method. Method: For the sequential coding experimental paradigm, the multi-band data stitching with label alignment and tangent space mapping (MDSLATSM) algorithm is proposed as a novel heterogeneous transfer learning method. After filtering by multi-band filtering, the artificial signals can be obtained by data stitching from the source domain, which build a bridge between the source domain and target domain. To make the distribution of two domains closer, their covariance matrices are aligned by label alignment. After mapping to the tangent space, the features are extracted from the Riemannian manifold. Finally, the classification results are obtained with feature selection and classification. Results: Our data set includes the EEG signals from 16 subjects. For the heterogeneous transfer learning of cross-label, the average classification accuracy is 78.28%. MDSLATSM is also tested for cross-subject, and the average classification accuracy is 64.01%, which is better than existing methods. Significance: Combining multi-band filtering, data stitching, label alignment and tangent space mapping, a novel heterogeneous transfer learning method can be achieved with superior performance, which promotes the practical application of the BCI systems.
Multi-Source Decentralized Transfer for Privacy-Preserving BCIs

Wen Zhang,Ziwei Wang,Dongrui Wu

DOI: https://doi.org/10.1109/tnsre.2022.3207494

IF: 4.9

2022-09-27

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Transfer learning, which utilizes labeled source domains to facilitate the learning in a target model, is effective in alleviating high intra- and inter-subject variations in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Existing transfer learning approaches usually use the source subjects' EEG data directly, leading to privacy concerns. This paper considers a decentralized privacy-preserving transfer learning scenario: there are multiple source subjects, whose data and computations are kept local, and only the parameters or predictions of their pre-trained models can be accessed for privacy-protection; then, how to perform effective cross-subject transfer for a new subject with unlabeled EEG trials? We propose an offline unsupervised multi-source decentralized transfer (MSDT) approach, which first generates a pre-trained model from each source subject, and then performs decentralized transfer using the source model parameters (in gray-box settings) or predictions (in black-box settings). Experiments on two datasets from two BCI paradigms, motor imagery and affective BCI, demonstrated that MSDT outperformed several existing approaches, which do not consider privacy-protection at all. In other words, MSDT achieved both high privacy-protection and better classification performance.

engineering, biomedical,rehabilitation
A novel dual-step transfer framework based on domain selection and feature alignment for motor imagery decoding

Jin, Jing

DOI: https://doi.org/10.1007/s11571-023-10053-1

2024-05-25

Cognitive Neurodynamics

Abstract:In brain-computer interfaces (BCIs) based on motor imagery (MI), reducing calibration time is gradually becoming an urgent issue in practical applications. Recently, transfer learning (TL) has demonstrated its effectiveness in reducing calibration time in MI-BCI. However, the different data distribution of subjects greatly affects the application effect of TL in MI-BCI. Therefore, this paper combines data alignment, source domain selection, and feature alignment into the MI-TL. We propose a novel dual-step transfer framework based on source domain selection and feature alignment. First, the source and target domains are aligned using a pre-calibration strategy (PS), and then a sequential reverse selection method is proposed to match the optimal source domain for each target domain with the designed dual model selection strategy. We use filter bank regularization common space pattern (FBRCSP) to obtain more features and introduce manifold embedded distribution alignment (MEDA) to correct the prediction results of the support vector machine (SVM). The experimental results on two competition public datasets (BCI competition IV Dataset 1 and Dataset 2a) and our dataset show that the average classification accuracy of the proposed framework is higher than the baseline method (no domain selection and no feature alignment), which reaches 84.12%, 79.91%, and 78.45%, respectively. And the computational cost is reduced by half compared with the baseline method.

neurosciences
Multi-source manifold feature transfer learning with domain selection for brain-computer interfaces

Qingshan She,Yinhao Cai,Shengzhi Du,Yun Chen

DOI: https://doi.org/10.1016/j.neucom.2022.09.124

IF: 6

2022-12-01

Neurocomputing

Abstract:Transfer learning uses the knowledge in source domains to improve the learning performance in the target domain, which is useful in electroencephalogram (EEG) based brain-computer interfaces (BCIs) with small training datasets. However, the existing transfer learning methods for EEG based BCI mainly consider the knowledge transfer from single-to-single (STS) domain or simply merge different source domains into a bigger one. In this paper, we propose a multi-source manifold feature transfer learning (MMFT) framework to transfer multi-source knowledge for EEG signals classification. MMFT minimizes marginal probability distribution on the Riemannian manifold using Riemannian alignment and Grassmann manifold feature learning, then transfers the manifold features with a conditional probability distribution adaptation in the structural risk minimization (SRM) function. Based on MMFT, w-MMFT is proposed to tackle the class imbalance issue for SRM, and the label similarity analysis (LSA) is proposed to select source domains for MMFT, forming a new LSA-MMFT framework. Experimental results on six datasets demonstrate that the proposed MMFT has achieved superior performance in classification accuracy and computational efficiency compared to state-of-the-art methods. The LSA-MMFT can get more stable performance than two other domain selection methods.

computer science, artificial intelligence
Parameter transfer and Riemannian space coordinate alignment for EEG intention recognition

Xingchen Li,Xianlun Tang,Jieyu Liu,Qing Liu,Huiming Wang,Ke Liu

DOI: https://doi.org/10.1016/j.bspc.2024.106044

IF: 5.1

2024-06-01

Biomedical Signal Processing and Control

Abstract:In brain-computer interface (BCI) system, local and temporal information of brain signals are often distorted and different subjects are variable, which leaves the brain-computer interfaces based on motor imagery (MI) challenging in cross-subject variability. This paper proposes a novel transfer learning method and a data alignment algorithm based on Riemannian space to reduce the difference between subjects. Through these methods, the target classification parameters will be close enough to that of the previous subjects which have a similar feature distribution to the target one. Therefore, even when only small amount of subject-specific trials of current target subject are labeled, the classification accuracy will not be compromised. The proposed two algorithms are evaluated using three motor imagery EEG data sets. Furthermore, an intelligent wheelchair steering system is designed based on the proposed algorithms. The experiment results show that in contrast with the subject-specific classifier, the proposed approaches achieve greater cross-subject classification accuracy. Moreover, the improvement is more salient when there are fewer trials available for the current target subject. In addition, the two algorithms proposed in this paper are combined to obtain optimal results.

engineering, biomedical
A cross-dataset adaptive domain selection transfer learning framework for motor imagery-based brain-computer interfaces

Jing Jin,Guanglian Bai,Ren Xu,Ke Qin,Hao Sun,Xingyu Wang,Andrzej Cichocki

DOI: https://doi.org/10.1088/1741-2552/ad593b

IF: 5.043

2024-06-19

Journal of Neural Engineering

Abstract:In brain-computer interfaces (BCIs) that utilize motor imagery (MI), minimizing calibration time has become increasingly critical for real-world applications. Recently, transfer learning (TL) has been shown to effectively reduce the calibration time in MI-BCIs. However, variations in data distribution among subjects can significantly influence the performance of TL in MI-BCIs. To address this, we propose a cross-dataset adaptive domain selection transfer learning framework (ADSTL) that integrates domain selection, data alignment, and an enhanced common spatial pattern (CSP) algorithm. Our approach uses a huge dataset of 109 subjects as the source domain. We begin by identifying non-BCI illiterate subjects from this huge dataset, then determine the source domain subjects most closely aligned with the target subjects using maximum mean discrepancy. After undergoing Euclidean alignment processing, features are extracted by multiple composite CSP. The final classification is carried out using the support vector machine. Our findings indicate that the proposed technique outperforms existing methods, achieving classification accuracies of 75.05% and 76.82% in two cross-dataset experiments, respectively. By reducing the need for extensive training data, yet maintaining high accuracy, our method optimizes the practical implementation of MI-BCIs.

neurosciences,engineering, biomedical
Multi-layer transfer learning algorithm based on improved common spatial pattern for brain-computer interfaces

Zhuo Cai,Yunyuan Gao,Feng Fang,Yingchun Zhang,Shunlan Du

DOI: https://doi.org/10.1016/j.jneumeth.2024.110332

IF: 2.987

2024-12-01

Journal of Neuroscience Methods

Abstract:In the application of brain-computer interface, the differences in imaging methods and brain structure between subjects hinder the effectiveness of decoding algorithms when applied on different subjects. Transfer learning has been designed to solve this problem. There have been many applications of transfer learning in motor imagery (MI), however the effectiveness is still limited due to the inconsistent domain alignment, lack of prominent data features and allocation of weights in trails. In this paper, a Multi-layer transfer learning algorithm based on improved Common Spatial Patterns (MTICSP) was proposed to solve these problems. Firstly, the source domain data and target domain data were aligned by Target Alignment (TA)method to reduce distribution differences between subjects. Secondly, the mean covariance matrix of the two classes was re-weighted by calculating the distance between the covariance matrix of each trial in the source domain and the target domain. Thirdly, the improved Common Spatial Patterns (CSP) by introducing regularization coefficient was proposed to further reduce the difference between source domain and target domain to extract features. Finally, the feature blocks of the source domain and target domain were aligned again by Joint Distribution Adaptation (JDA) method. Experiments on two public datasets in two transfer paradigms multi-source to single-target (MTS) and single-source to single-target (STS) verified the effectiveness of our proposed method. The MTS and STS in the 5-person dataset were 80.21% and 77.58%, respectively, and 80.10% and 73.91%, respectively, in the 9-person dataset. Experimental results also showed that the proposed algorithm was superior to other state-of-the-art algorithms. In addition, the generalization ability of our algorithm MTICSP was validated on the fatigue EEG dataset collected by ourselves, and obtained 94.83% and 87.41% accuracy in MTS and STS experiments respectively. The proposed method combines improved CSP with transfer learning to extract the features of source and target domains effectively, providing a new method for combining transfer learning with motor imagination.

neurosciences,biochemical research methods
A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Zilin Liang,Zheng Zheng,Weihai Chen,Zhongcai Pei,Jianhua Wang,Jianer Chen

DOI: https://doi.org/10.1016/j.bspc.2024.106311

IF: 5.1

2024-04-19

Biomedical Signal Processing and Control

Abstract:The statistical variability of electroencephalographic (EEG) signals across individuals poses a common challenge for brain–computer interfaces (BCI). Specifically, the reuse of pre-recorded data from previous subjects presents a significant obstacle in decoding new subjects. To address these challenges, this paper introduces EEGTransferNet, an end-to-end modular transfer learning framework that enhances the similarity of statistical distributions across subjects. It utilizes convolutional neural networks as backbones for feature extraction and incorporates statistical distribution alignment and domain adaptation in different network layers to learn general features and domain-specific features respectively. The robust generalization design of EEGTransferNet enables it to handle multiple BCI paradigms using a single network making it efficient and effective. Its modular structure facilitates customization of backbone and transfer modules for diverse tasks. The optimal structure of EEGTransferNet was determined through analysis and extensive experimentation. We validated it on motor imagery (MI), error-related negativity (ERN), and rapid serial visual presentation (RSVP) datasets, which exhibits competitive performance compared to state-of-the-art methods. The experimental results confirm the effectiveness and superiority of EEGTransferNet.

engineering, biomedical
Transfer learning with data alignment and optimal transport for EEG based motor imagery classification

Chao Chu,Lei Zhu,Aiai Huang,Ping Xu,Nanjiao Ying,Jianhai Zhang

DOI: https://doi.org/10.1088/1741-2552/ad1f7a

IF: 5.043

2024-01-19

Journal of Neural Engineering

Abstract:The non-stationarity of electroencephalogram signals and the variability of different subjects pose major challenges in current Brain-Computer Interfaces research, which requires a time-consuming specific calibration procedure to address. Transfer Learning can make use of data or models from one or more source domains to encourage learning in the target domain, so as to address the challenges of EEG non-stationarity and inter-subject variability. In this paper, a Multi-source domain Transfer Learning Fusion (MTLF) framework is proposed to address the non-stationarity of EEG signals and the complexity of the calibration process. Firstly, the method transforms the source domain data with the resting state segment, so as to decrease the differences between the source domain and the target domain. Then, CSP is used to extract features. After that, Optimal Transport is employed to further refine the source domain data to increase the similarity of the probability distribution between the target and source domains. Finally, an improved transfer learning classifier is employed to classify the target samples. This method does not require the label information of target domain samples and can reduce the calibration workload. The proposed MTLF is assessed on Datasets IIa and IIb of the BCI Competition IV. Compared with seven other algorithms, our method performed relatively the best and achieved mean classification accuracy of 73.69% and 70.83% on Datasets IIa and IIb respectively. Experimental results demonstrate that MTLF can effectively decrease the discrepancy between the source and target domain, and acquire better classification performance on two MI-EEG datasets.

engineering, biomedical,neurosciences
Decoding Movement Imagination and Execution from EEG Signals using BCI-Transfer Learning Method based on Relation Network

D.-Y. Lee,J.-H. Jeong,K.-H. Shim,S.-W. Lee

DOI: https://doi.org/10.48550/arXiv.2002.00538

2020-02-03

Abstract:A brain-computer interface (BCI) is used not only to control external devices for healthy people but also to rehabilitate motor functions for motor-disabled patients. Decoding movement intention is one of the most significant aspects for performing arm movement tasks using brain signals. Decoding movement execution (ME) from electroencephalogram (EEG) signals have shown high performance in previous works, however movement imagination (MI) paradigm-based intention decoding has so far failed to achieve sufficient accuracy. In this study, we focused on a robust MI decoding method with transfer learning for the ME and MI paradigm. We acquired EEG data related to arm reaching for 3D directions. We proposed a BCI-transfer learning method based on a Relation network (BTRN) architecture. Decoding performances showed the highest performance compared to conventional works. We confirmed the possibility of the BTRN architecture to contribute to continuous decoding of MI using ME datasets.

Signal Processing
Minimizing subject-dependent calibration for BCI with Riemannian transfer learning

Salim Khazem,Sylvain Chevallier,Quentin Barthélemy,Karim Haroun,Camille Noûs

DOI: https://doi.org/10.48550/arXiv.2111.12071

IF: 4.729

2021-11-23

Signal Processing

Abstract:Calibration is still an important issue for user experience in Brain-Computer Interfaces (BCI). Common experimental designs often involve a lengthy training period that raises the cognitive fatigue, before even starting to use the BCI. Reducing or suppressing this subject-dependent calibration is possible by relying on advanced machine learning techniques, such as transfer learning. Building on Riemannian BCI, we present a simple and effective scheme to train a classifier on data recorded from different subjects, to reduce the calibration while preserving good performances. The main novelty of this paper is to propose a unique approach that could be applied on very different paradigms. To demonstrate the robustness of this approach, we conducted a meta-analysis on multiple datasets for three BCI paradigms: event-related potentials (P300), motor imagery and SSVEP. Relying on the MOABB open source framework to ensure the reproducibility of the experiments and the statistical analysis, the results clearly show that the proposed approach could be applied on any kind of BCI paradigm and in most of the cases to significantly improve the classifier reliability. We point out some key features to further improve transfer learning methods.
Joint multi-feature extraction and transfer learning in motor imagery brain computer interface

Miao Cai,Jie Hong

DOI: https://doi.org/10.1080/10255842.2024.2404541

2024-09-17

Abstract:Motor imagery brain computer interface (BCI) systems are considered one of the most crucial paradigms and have received extensive attention from researchers worldwide. However, the non-stationary from subject-to-subject transfer is a substantial challenge for robust BCI operations. To address this issue, this paper proposes a novel approach that integrates joint multi-feature extraction, specifically combining common spatial patterns (CSP) and wavelet packet transforms (WPT), along with transfer learning (TL) in motor imagery BCI systems. This approach leverages the time-frequency characteristics of WPT and the spatial characteristics of CSP while utilizing transfer learning to facilitate EEG identification for target subjects based on knowledge acquired from non-target subjects. Using dataset IVa from BCI Competition III, our proposed approach achieves an impressive average classification accuracy of 93.4%, outperforming five kinds of state-of-the-art approaches. Furthermore, it offers the advantage of enabling the design of various auxiliary problems to learn different aspects of the target problem from unlabeled data through transfer learning, thereby facilitating the implementation of innovative ideas within our proposed approach. Simultaneously, it demonstrates that integrating CSP and WPT while transferring knowledge from other subjects is highly effective in enhancing the average classification accuracy of EEG signals and it provides a novel solution to address subject-to-subject transfer challenges in motor imagery BCI systems.
Enhancing transfer performance across datasets for brain-computer interfaces using a combination of alignment strategies and adaptive batch normalization

Lichao Xu,Minpeng Xu,Zhen Ma,Kun Wang,Tzyy-Ping Jung,Dong Ming

DOI: https://doi.org/10.1088/1741-2552/ac1ed2

IF: 5.043

2021-08-01

Journal of Neural Engineering

Abstract:Abstract Objective . Recently, transfer learning (TL) and deep learning (DL) have been introduced to solve intra- and inter-subject variability problems in brain-computer interfaces (BCIs). However, current TL and DL algorithms are usually validated within a single dataset, assuming that data of the test subjects are acquired under the same condition as that of training (source) subjects. This assumption is generally violated in practice because of different acquisition systems and experimental settings across studies and datasets. Thus, the generalization ability of these algorithms needs further validations in a cross-dataset scenario, which is closer to the actual situation. This study compared the transfer performance of pre-trained deep-learning models with different preprocessing strategies in a cross-dataset scenario. Approach . This study used four publicly available motor imagery datasets, each was successively selected as a source dataset, and the others were used as target datasets. EEGNet and ShallowConvNet with four preprocessing strategies, namely channel normalization, trial normalization, Euclidean alignment, and Riemannian alignment, were trained with the source dataset. The transfer performance of pre-trained models was validated on the target datasets. This study also used adaptive batch normalization (AdaBN) for reducing interval covariate shift across datasets. This study compared the transfer performance of using the four preprocessing strategies and that of a baseline approach based on manifold embedded knowledge transfer (MEKT). This study also explored the possibility and performance of fusing MEKT and EEGNet. Main results . The results show that DL models with alignment strategies had significantly better transfer performance than the other two preprocessing strategies. As an unsupervised domain adaptation method, AdaBN could also significantly improve the transfer performance of DL models. The transfer performance of DL models that combined AdaBN and alignment strategies significantly outperformed MEKT. Moreover, the generalizability of EEGNet models that combined AdaBN and alignment strategies could be further improved via the domain adaptation step in MEKT, achieving the best generalization ability among multiple datasets (BNCI2014001: 0.788, PhysionetMI: 0.679, Weibo2014: 0.753, Cho2017: 0.650). Significance . The combination of alignment strategies and AdaBN could easily improve the generalizability of DL models without fine-tuning. This study may provide new insights into the design of transfer neural networks for BCIs by separating source and target batch normalization layers in the domain adaptation process.

engineering, biomedical,neurosciences
[Value of serological diagnosis of celiac disease for the determination of intolerance to prolamines of certain varieties of oats in patients with celiac disease].

V. Emanuel,N. Vokhmianina,I. P. Gavriliuk,V. Krasil’nikov,N. V. Alpat’eva

Abstract:
Multi-Source Fusion Domain Adaptation Using Resting-State Knowledge for Motor Imagery Classification Tasks

Lei Zhu,Junting Yang,Wangpan Ding,Jieping Zhu,Ping Xu,Nanjiao Ying,Jianhai Zhang

DOI: https://doi.org/10.1109/jsen.2021.3101684

IF: 4.3

2021-10-01

IEEE Sensors Journal

Abstract:Transfer learning is the method that makes use of knowledge from other fields to solve problems in related fields. It has been shown that it can deal with the problem of insufficient labeled data for new users or new tasks in the brain-computer interface. Domain adaptation is one of the transfer learning methods which is widely used for its excellent performance. Here, the offline cross-subject EEG signal classification is mainly focused on. The unlabeled EEG trials of the new user are classified by using the EEG trials with labels from source subjects. In this paper, a novel transfer learning method called multi-source fusion adaptation regularization (MFAR) is proposed. MFAR preprocesses the EEG signal by aligning the motor imagery trials to their resting state trials, and can reduce the differences among subjects. It also defines a learning framework by combining weighted balanced distribution adaptation (W-BDA), source empirical risk, and manifold regularization to further reduce the variation between source and target domains. We validated the method on two BCI Competition IV datasets for motor imagery tasks. In the absence of labeled EEG trials of the target subject, compared with the excellent counterparts, the classification accuracy increases by 9.28% and 11.73%. After the alignment algorithm is added, the accuracy of the MFAR is improved by 9.36% and 4.17% on the basis. The experimental results show that our learning framework outperformed several state-of-the-art transfer learning algorithms. Even when the training data from the new user are sufficient, the proposed approach achieves good performance.

engineering, electrical & electronic,instruments & instrumentation,physics, applied

Electron Microscopic Observation of Magnetic Bubble Garnets

Riemannian transfer learning based on log-Euclidean metric for EEG classification

Mutational alteration of the p16CDKN2a tumor suppressor gene is infrequent in Ewing's sarcoma.

Transfer Learning: Rotation Alignment with Riemannian Mean for Brain-Computer Interfaces and Wheelchair Control

Riemannian Geometric Instance Filtering for Transfer Learning in Brain-Computer Interfaces.

Three-stage transfer learning for motor imagery EEG recognition

A novel heterogeneous transfer learning method based on data stitching for the sequential coding brain computer interface

Multi-Source Decentralized Transfer for Privacy-Preserving BCIs

A novel dual-step transfer framework based on domain selection and feature alignment for motor imagery decoding

Multi-source manifold feature transfer learning with domain selection for brain-computer interfaces

Parameter transfer and Riemannian space coordinate alignment for EEG intention recognition

A cross-dataset adaptive domain selection transfer learning framework for motor imagery-based brain-computer interfaces

Multi-layer transfer learning algorithm based on improved common spatial pattern for brain-computer interfaces

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Transfer learning with data alignment and optimal transport for EEG based motor imagery classification

Decoding Movement Imagination and Execution from EEG Signals using BCI-Transfer Learning Method based on Relation Network

Minimizing subject-dependent calibration for BCI with Riemannian transfer learning

Joint multi-feature extraction and transfer learning in motor imagery brain computer interface

Enhancing transfer performance across datasets for brain-computer interfaces using a combination of alignment strategies and adaptive batch normalization

[Value of serological diagnosis of celiac disease for the determination of intolerance to prolamines of certain varieties of oats in patients with celiac disease].

Multi-Source Fusion Domain Adaptation Using Resting-State Knowledge for Motor Imagery Classification Tasks