Process Intensification of Biodiesel Production Through Reactive Distillation and Supercritical Fluids By Timothy Risteski Thesis Report – Part B Supervisors Prof

S. Thennadil

Abstract:

What problem does this paper attempt to address?

A novel interactive deep cascade spectral graph convolutional network with multi-relational graphs for disease prediction

Sihui Li,Rui Zhang

DOI: https://doi.org/10.1016/j.neunet.2024.106285

IF: 7.8

2024-07-01

Neural Networks

Abstract:Graph neural networks (GNNs) have recently grown in popularity for disease prediction. Existing GNN-based methods primarily build the graph topological structure around a single modality and combine it with other modalities to acquire feature representations of acquisitions. The complicated relationship in each modality, however, may not be well highlighted due to its specificity. Further, relatively shallow networks restrict adequate extraction of high-level features, affecting disease prediction performance. Accordingly, this paper develops a new interactive deep cascade spectral graph convolutional network with multi-relational graphs (IDCGN) for disease prediction tasks. Its crucial points lie in constructing multiple relational graphs and dual cascade spectral graph convolution branches with interaction (DCSGBI). Specifically, the former designs a pairwise imaging-based edge generator and a pairwise non-imaging-based edge generator from different modalities by devising two learnable networks, which adaptively capture graph structures and provide various views of the same acquisition to aid in disease diagnosis. Again, DCSGBI is established to enrich high-level semantic information and low-level details of disease data. It devises a cascade spectral graph convolution operator for each branch and incorporates the interaction strategy between different branches into the network, successfully forming a deep model and capturing complementary information from diverse branches. In this manner, more favorable and sufficient features are learned for a reliable diagnosis. Experiments on several disease datasets reveal that IDCGN exceeds state-of-the-art models and achieves promising results.

computer science, artificial intelligence,neurosciences
Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

Jiadong Yan,Yuzhong Chen,Zhenxiang Xiao,Shu Zhang,Mingxin Jiang,Tianqi Wang,Tuo Zhang,Jinglei Lv,Benjamin Becker,Rong Zhang,Dajiang Zhu,Junwei Han,Dezhong Yao,Keith M. Kendrick,Tianming Liu,Xi Jiang

DOI: https://doi.org/10.1016/j.media.2022.102518

IF: 10.9

2022-08-01

Medical Image Analysis

Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis

Xiaoxiao Li,Yuan Zhou,Nicha Dvornek,Muhan Zhang,Siyuan Gao,Juntang Zhuang,Dustin Scheinost,Lawrence Staib,Pamela Ventola,James Duncan

DOI: https://doi.org/10.1101/2020.05.16.100057

2020-05-17

Abstract:Abstract Understanding which brain regions are related to a specific neurological disorder or cognitive stimuli has been an important area of neuroimaging research. We propose BrainGNN, a graph neural network (GNN) framework to analyze functional magnetic resonance images (fMRI) and discover neurological biomarkers. Considering the special property of brain graphs, we design novel ROI-aware graph convolutional (Ra-GConv) layers that leverage the topological and functional information of fMRI. Motivated by the need for transparency in medical image analysis, our BrainGNN contains ROI-selection pooling layers (R-pool) that highlight salient ROIs (nodes in the graph), so that we can infer which ROIs are important for prediction. Furthermore, we propose regularization terms—unit loss, topK pooling (TPK) loss and group-level consistency (GLC) loss—on pooling results to encourage reasonable ROI-selection and provide flexibility to encourage either fully individual- or patterns that agree with group-level data. We apply the BrainGNN framework on two independent fMRI datasets: an Autism Spectrum Disorder (ASD) fMRI dataset and data from the Human Connectome Project (HCP) 900 Subject Release. We investigate different choices of the hyper-parameters and show that BrainGNN outperforms the alternative fMRI image analysis methods in terms of four different evaluation metrics. The obtained community clustering and salient ROI detection results show a high correspondence with the previous neuroimaging-derived evidence of biomarkers for ASD and specific task states decoded for HCP. We will make BrainGNN codes public available after acceptance.
Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

Hejie Cui,Wei Dai,Yanqiao Zhu,Xiaoxiao Li,Lifang He,Carl Yang

DOI: https://doi.org/10.48550/arXiv.2207.00813

2022-07-23

Abstract:Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit for neuroscience research and clinical disorder therapy. Mapping the connections of the human brain as a network is one of the most pervasive paradigms in neuroscience. Graph Neural Networks (GNNs) have recently emerged as a potential method for modeling complex network data. Deep models, on the other hand, have low interpretability, which prevents their usage in decision-critical contexts like healthcare. To bridge this gap, we propose an interpretable framework to analyze disorder-specific Regions of Interest (ROIs) and prominent connections. The proposed framework consists of two modules: a brain-network-oriented backbone model for disease prediction and a globally shared explanation generator that highlights disorder-specific biomarkers including salient ROIs and important connections. We conduct experiments on three real-world datasets of brain disorders. The results verify that our framework can obtain outstanding performance and also identify meaningful biomarkers. All code for this work is available at <a class="link-external link-https" href="https://github.com/HennyJie/IBGNN.git" rel="external noopener nofollow">this https URL</a>.

Neurons and Cognition,Artificial Intelligence,Computational Engineering, Finance, and Science,Machine Learning
Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

Yanqiao Zhu,Hejie Cui,Lifang He,Lichao Sun,Carl Yang

DOI: https://doi.org/10.48550/arXiv.2107.03220

2022-05-25

Abstract:Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become a de facto model for analyzing graph-structured data. However, how to employ GNNs to extract effective representations from brain networks in multiple modalities remains rarely explored. Moreover, as brain networks provide no initial node features, how to design informative node attributes and leverage edge weights for GNNs to learn is left unsolved. To this end, we develop a novel multiview GNN for multimodal brain networks. In particular, we regard each modality as a view for brain networks and employ contrastive learning for multimodal fusion. Then, we propose a GNN model which takes advantage of the message passing scheme by propagating messages based on degree statistics and brain region connectivities. Extensive experiments on two real-world disease datasets (HIV and Bipolar) demonstrate the effectiveness of our proposed method over state-of-the-art baselines.

Neurons and Cognition,Machine Learning,Medical Physics,Quantitative Methods
EEG-GCN: Spatio-Temporal and Self-Adaptive Graph Convolutional Networks for Single and Multi-View EEG-Based Emotion Recognition

Yue Gao,Xiangling Fu,Tianxiong Ouyang,Yi Wang

DOI: https://doi.org/10.1109/lsp.2022.3179946

2022-07-26

IEEE Signal Processing Letters

Abstract:Graph networks are naturally suitable for modeling multi-channel features of EEG signals. However, the existing study that attempts to utilize graph-based neural networks for EEG-based emotion recognition doesn't take the spatio-temporal redundancy of EEG features and differences in brain topology into account. In this paper, we propose EEG-GCN, a paradigm that adopts spatio-temporal and self-adaptive graph convolutional networks for single and multi-view EEG-based emotion recognition. With spatio-temporal attention mechanism employed, EEG-GCN can adaptively capture significant sequential segments and spatial location information in EEG signals. Meanwhile, a self-adaptive brain network adjacency matrix is designed to quantify the connection strength between the channels, in which way to represent the diverse activation patterns under different emotion scenarios. Additionally, we propose a multi-view EEG-based emotion recognition method, which effectively integrates the diverse features of EEG signals. Extensive experiments conducted on two benchmark datasets SEED and DEAP demonstrate that our proposed method outperforms other representative methods from both single and multiple views.

engineering, electrical & electronic
Characterization of the reverse transcriptase from a new retrovirus (HTLV) produced by a human cutaneous T-cell lymphoma cell line.

H. Rho,B. Poiesz,F. Ruscetti,R. Gallo

DOI: https://doi.org/10.1016/0042-6822(81)90642-5

IF: 3.513

1981-07-15

Virology

Abstract:
Multi-Modal Diagnosis of Alzheimer's Disease using Interpretable Graph Convolutional Networks

Houliang Zhou,Lifang He,Brian Y Chen,Li Shen,Yu Zhang

DOI: https://doi.org/10.1109/TMI.2024.3432531

2024-07-23

Abstract:The interconnection between brain regions in neurological disease encodes vital information for the advancement of biomarkers and diagnostics. Although graph convolutional networks are widely applied for discovering brain connection patterns that point to disease conditions, the potential of connection patterns that arise from multiple imaging modalities has yet to be fully realized. In this paper, we propose a multi-modal sparse interpretable GCN framework (SGCN) for the detection of Alzheimer's disease (AD) and its prodromal stage, known as mild cognitive impairment (MCI). In our experimentation, SGCN learned the sparse regional importance probability to find signature regions of interest (ROIs), and the connective importance probability to reveal disease-specific brain network connections. We evaluated SGCN on the Alzheimer's Disease Neuroimaging Initiative database with multi-modal brain images and demonstrated that the ROI features learned by SGCN were effective for enhancing AD status identification. The identified abnormalities were significantly correlated with AD-related clinical symptoms. We further interpreted the identified brain dysfunctions at the level of large-scale neural systems and sex-related connectivity abnormalities in AD/MCI. The salient ROIs and the prominent brain connectivity abnormalities interpreted by SGCN are considerably important for developing novel biomarkers. These findings contribute to a better understanding of the network-based disorder via multi-modal diagnosis and offer the potential for precision diagnostics. The source code is available at https://github.com/Houliang-Zhou/SGCN.
Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

Guangqiang Li,Ning Chen,Jing Jin

DOI: https://doi.org/10.1088/1741-2552/ac63ec

2022-04-14

Abstract:Objective. To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies.Approach. A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and similarity network fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation.Main results. Experimental results demonstrated that: (a) When 5.30%of SEED and 7.20%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52%on SEED and 13.14%on SEED-IV, respectively. (b) When 8.00%of SEED and 9.60%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75 s and 22.55 s, respectively. (c) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. (d) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance.Significance. This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.
A Spiking Neural Network With Adaptive Graph Convolution and LSTM for EEG-Based Brain-Computer Interfaces

Peiliang Gong,Pengpai Wang,Yueying Zhou,Daoqiang Zhang

DOI: https://doi.org/10.1109/tnsre.2023.3246989

IF: 4.9

2023-03-04

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Electroencephalography (EEG) signals classification is essential for the brain-computer interface (BCI). Recently, energy-efficient spiking neural networks (SNNs) have shown great potential in EEG analysis due to their ability to capture the complex dynamic properties of biological neurons while also processing stimulus information through precisely timed spike trains. However, most existing methods do not effectively mine the specific spatial topology of EEG channels and temporal dependencies of the encoded EEG spikes. Moreover, most are designed for specific BCI tasks and lack some generality. Hence, this study presents a novel SNN model with the customized spike-based adaptive graph convolution and long short-term memory (LSTM), termed SGLNet, for EEG-based BCIs. Specifically, we first adopt a learnable spike encoder to convert the raw EEG signals into spike trains. Then, we tailor the concepts of the multi-head adaptive graph convolution to SNN so that it can make good use of the intrinsic spatial topology information among distinct EEG channels. Finally, we design the spike-based LSTM units to further capture the temporal dependencies of the spikes. We evaluate our proposed model on two publicly available datasets from two representative fields of BCI, notably emotion recognition, and motor imagery decoding. The empirical evaluations demonstrate that SGLNet consistently outperforms existing state-of-the-art EEG classification algorithms. This work provides a new perspective for exploring high-performance SNNs for future BCIs with rich spatiotemporal dynamics.

engineering, biomedical,rehabilitation
MGSN: Depression EEG lightweight detection based on multiscale DGCN and SNN for multichannel topology

Xin Chen,Youyong Kong,Hongli Chang,Yuan Gao,Zidong Liu,Jean-Louis Coatrieux,Huazhong Shu

DOI: https://doi.org/10.1016/j.bspc.2024.106051

IF: 5.1

2024-02-17

Biomedical Signal Processing and Control

Abstract:As the global public health risk intensifies, the number of patients with depression is increasing. Since the current clinical scale assessments may be influenced by subjective patient factors and physician diagnostic experience, we need to explore objective biomarkers from complex electroencephalographic (EEG). Addressing the multichannel topology characteristic of depression, we innovatively propose a lightweight depression detection method based on multiscale dynamic graph convolutional networks and spiking neural networks. By constructing a foundational detection framework utilizing a spiking neural network, the model processes information in the form of discrete spikes and highly fits biological neuron mechanisms. To handle the complexity issue arising from topological information and channel features, we introduce dynamic graph convolution for effective spatiotemporal attribute aggregation. Moreover, to circumvent the costly resource consumption associated with graph computation, we design multiple diffusion branches with different receptive field levels, and obtain multiscale topological information in parallel. By strengthening the learning of neighboring node information, the framework is optimized. Additionally, the integration of EEG under both positive and negative stimulation significantly improves the model's representation of multichannel topology. Our method achieves a classification accuracy of 90.51%, and improves the detection efficiency without neglecting multichannel structural relationships. In addition, after visualizing the network output features, it shows that patients with depression exhibit distinct frontal and temporal EEG abnormalities compared to healthy controls.

engineering, biomedical
Resting-State Functional MRI Adaptation with Attention Graph Convolution Network for Brain Disorder Identification

Ying Chu,Haonan Ren,Lishan Qiao,Mingxia Liu

DOI: https://doi.org/10.3390/brainsci12101413

IF: 3.333

2022-10-21

Brain Sciences

Abstract:Multi-site resting-state functional magnetic resonance imaging (rs-fMRI) data can facilitate learning-based approaches to train reliable models on more data. However, significant data heterogeneity between imaging sites, caused by different scanners or protocols, can negatively impact the generalization ability of learned models. In addition, previous studies have shown that graph convolution neural networks (GCNs) are effective in mining fMRI biomarkers. However, they generally ignore the potentially different contributions of brain regions- of-interest (ROIs) to automated disease diagnosis/prognosis. In this work, we propose a multi-site rs-fMRI adaptation framework with attention GCN (A2GCN) for brain disorder identification. Specifically, the proposed A2GCN consists of three major components: (1) a node representation learning module based on GCN to extract rs-fMRI features from functional connectivity networks, (2) a node attention mechanism module to capture the contributions of ROIs, and (3) a domain adaptation module to alleviate the differences in data distribution between sites through the constraint of mean absolute error and covariance. The A2GCN not only reduces data heterogeneity across sites, but also improves the interpretability of the learning algorithm by exploring important ROIs. Experimental results on the public ABIDE database demonstrate that our method achieves remarkable performance in fMRI-based recognition of autism spectrum disorders.

neurosciences
HAGCN: A hybrid-order brain network-based graph convolution learning framework with multi-head attention for brain disorder classification

Xubin Wu,Xin Wen,Jie Sun,Yanqing Dong,Chenyu Wu,Bin Wang,Jie Xiang

DOI: https://doi.org/10.1016/j.bspc.2024.106944

IF: 5.1

2024-10-11

Biomedical Signal Processing and Control

Abstract:Brain networks provide essential insights in diagnosing many brain disorders, such as autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD). However, current works often fail to fully capture the potential interaction characteristics of inter-regional functional connectivity within the brain network. To address this limitation, we propose a Hybrid-Attention Graph Convolution Network (HAGCN) for brain disorder classification. The learning framework designs a hybrid-order effective network (graph) for representing the lower-order and higher-order spatial interaction relations between brain regions, proposes a prior graph based on statistical tests to eliminate the noisy edges effectively, presents a dual-channel graph convolution module for simultaneously capturing information flow features of each brain region in out-degree and in-degree directions, and implement a multi-head attention module to focus and discern the significant features from the multidimensional interaction relations for improving the expressiveness of the model. Experiments on ADHD-200 and ABIDE-I datasets show the effectiveness and advantages of our proposed method, achieving the highest average accuracy values of 77.95 % and 78.17 %, respectively. The results demonstrate that integrating multidimensional and directional interaction characteristics can enhance the network's capacity and improve learning efficiency. Additionally, our approach identifies and analyzes several key brain regions linked to brain disorders.

engineering, biomedical
Attention Spiking Neural Networks

Man Yao,Guangshe Zhao,Hengyu Zhang,Yifan Hu,Lei Deng,Yonghong Tian,Bo Xu,Guoqi Li

DOI: https://doi.org/10.1109/tpami.2023.3241201

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Brain-inspired spiking neural networks (SNNs) are becoming a promising energy-efficient alternative to traditional artificial neural networks (ANNs). However, the performance gap between SNNs and ANNs has been a significant hindrance to deploying SNNs ubiquitously. To leverage the full potential of SNNs, in this paper we study the attention mechanisms, which can help human focus on important information. We present our idea of attention in SNNs with a multi-dimensional attention module, which infers attention weights along the temporal, channel, as well as spatial dimension separately or simultaneously. Based on the existing neuroscience theories, we exploit the attention weights to optimize membrane potentials, which in turn regulate the spiking response. Extensive experimental results on event-based action recognition and image classification datasets demonstrate that attention facilitates vanilla SNNs to achieve sparser spiking firing, better performance, and energy efficiency concurrently. In particular, we achieve top-1 accuracy of 75.92% and 77.08% on ImageNet-1 K with single/4-step Res-SNN-104, which are state-of-the-art results in SNNs. Compared with counterpart Res-ANN-104, the performance gap becomes -0.95/+0.21 percent and the energy efficiency is 31.8×/7.4×. To analyze the effectiveness of attention SNNs, we theoretically prove that the spiking degradation or the gradient vanishing, which usually holds in general SNNs, can be resolved by introducing the block dynamical isometry theory. We also analyze the efficiency of attention SNNs based on our proposed spiking response visualization method. Our work lights up SNN's potential as a general backbone to support various applications in the field of SNN research, with a great balance between effectiveness and energy efficiency.
Identifying Disease-Related Subnetwork Connectome Biomarkers by Sparse Hypergraph Learning

Chen Zu,Yue Gao,Brent Munsell,Minjeong Kim,Ziwen Peng,Jessica R. Cohen,Daoqiang Zhang,Guorong Wu

DOI: https://doi.org/10.1007/s11682-018-9899-8

2018-01-01

Brain Imaging and Behavior

Abstract:The functional brain network has gained increased attention in the neuroscience community because of its ability to reveal the underlying architecture of human brain. In general, majority work of functional network connectivity is built based on the correlations between discrete-time-series signals that link only two different brain regions. However, these simple region-to-region connectivity models do not capture complex connectivity patterns between three or more brain regions that form a connectivity subnetwork, or subnetwork for short. To overcome this current limitation, a hypergraph learning-based method is proposed to identify subnetwork differences between two different cohorts. To achieve our goal, a hypergraph is constructed, where each vertex represents a subject and also a hyperedge encodes a subnetwork with similar functional connectivity patterns between different subjects. Unlike previous learning-based methods, our approach is designed to jointly optimize the weights for all hyperedges such that the learned representation is in consensus with the distribution of phenotype data, i.e. clinical labels. In order to suppress the spurious subnetwork biomarkers, we further enforce a sparsity constraint on the hyperedge weights, where a larger hyperedge weight indicates the subnetwork with the capability of identifying the disorder condition. We apply our hypergraph learning-based method to identify subnetwork biomarkers in Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD). A comprehensive quantitative and qualitative analysis is performed, and the results show that our approach can correctly classify ASD and ADHD subjects from normal controls with 87.65 and 65.08% accuracies, respectively.
Graph Convolutional Network with Connectivity Uncertainty for EEG-based Emotion Recognition

Hongxiang Gao,Xiangyao Wang,Zhenghua Chen,Min Wu,Zhipeng Cai,Lulu Zhao,Jianqing Li,Chengyu Liu

2023-10-22

Abstract:Automatic emotion recognition based on multichannel Electroencephalography (EEG) holds great potential in advancing human-computer interaction. However, several significant challenges persist in existing research on algorithmic emotion recognition. These challenges include the need for a robust model to effectively learn discriminative node attributes over long paths, the exploration of ambiguous topological information in EEG channels and effective frequency bands, and the mapping between intrinsic data qualities and provided labels. To address these challenges, this study introduces the distribution-based uncertainty method to represent spatial dependencies and temporal-spectral relativeness in EEG signals based on Graph Convolutional Network (GCN) architecture that adaptively assigns weights to functional aggregate node features, enabling effective long-path capturing while mitigating over-smoothing phenomena. Moreover, the graph mixup technique is employed to enhance latent connected edges and mitigate noisy label issues. Furthermore, we integrate the uncertainty learning method with deep GCN weights in a one-way learning fashion, termed Connectivity Uncertainty GCN (CU-GCN). We evaluate our approach on two widely used datasets, namely SEED and SEEDIV, for emotion recognition tasks. The experimental results demonstrate the superiority of our methodology over previous methods, yielding positive and significant improvements. Ablation studies confirm the substantial contributions of each component to the overall performance.

Machine Learning,Artificial Intelligence,Signal Processing
Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Mingkun Xu,Faqiang Liu,Yifan Hu,Hongyi Li,Yuanyuan Wei,Shuai Zhong,Jing Pei,Lei Deng

DOI: https://doi.org/10.1109/TNNLS.2024.3373599

2024-03-27

Abstract:Synaptic plasticity plays a critical role in the expression power of brain neural networks. Among diverse plasticity rules, synaptic scaling presents indispensable effects on homeostasis maintenance and synaptic strength regulation. In the current modeling of brain-inspired spiking neural networks (SNN), backpropagation through time is widely adopted because it can achieve high performance using a small number of time steps. Nevertheless, the synaptic scaling mechanism has not yet been well touched. In this work, we propose an experience-dependent adaptive synaptic scaling mechanism (AS-SNN) for spiking neural networks. The learning process has two stages: First, in the forward path, adaptive short-term potentiation or depression is triggered for each synapse according to afferent stimuli intensity accumulated by presynaptic historical neural activities. Second, in the backward path, long-term consolidation is executed through gradient signals regulated by the corresponding scaling factor. This mechanism shapes the pattern selectivity of synapses and the information transfer they mediate. We theoretically prove that the proposed adaptive synaptic scaling function follows a contraction map and finally converges to an expected fixed point, in accordance with state-of-the-art results in three tasks on perturbation resistance, continual learning, and graph learning. Specifically, for the perturbation resistance and continual learning tasks, our approach improves the accuracy on the N-MNIST benchmark over the baseline by 44% and 25%, respectively. An expected firing rate callback and sparse coding can be observed in graph learning. Extensive experiments on ablation study and cost evaluation evidence the effectiveness and efficiency of our nonparametric adaptive scaling method, which demonstrates the great potential of SNN in continual learning and robust learning.
Whole-brain Prediction Analysis with GraphNet

Logan Grosenick,Brad Klingenberg,Kiefer Katovich,Brian Knutson,Jonathan E. Taylor

DOI: https://doi.org/10.48550/arXiv.1110.4139

2012-12-27

Abstract:Multivariate machine learning methods are increasingly used to analyze neuroimaging data, often replacing more traditional "mass univariate" techniques that fit data one voxel at a time. In the functional magnetic resonance imaging (fMRI) literature, this has led to broad application of "off-the-shelf" classification and regression methods. These generic approaches allow investigators to use ready-made algorithms to accurately decode perceptual, cognitive, or behavioral states from distributed patterns of neural activity. However, when applied to correlated whole-brain fMRI data these methods suffer from coefficient instability, are sensitive to outliers, and yield dense solutions that are hard to interpret without arbitrary thresholding. Here, we develop variants of the the Graph-constrained Elastic Net (GraphNet), ..., we (1) extend GraphNet to include robust loss functions that confer insensitivity to outliers, (2) equip them with "adaptive" penalties that asymptotically guarantee correct variable selection, and (3) develop a novel sparse structured Support Vector GraphNet classifier (SVGN). When applied to previously published data, these efficient whole-brain methods significantly improved classification accuracy over previously reported VOI-based analyses on the same data while discovering task-related regions not documented in the original VOI approach. Critically, GraphNet estimates generalize well to out-of-sample data collected more than three years later on the same task but with different subjects and stimuli. By enabling robust and efficient selection of important voxels from whole-brain data taken over multiple time points (>100,000 "features"), these methods enable data-driven selection of brain areas that accurately predict single-trial behavior within and across individuals.

Applications
BrainGB: A Benchmark for Brain Network Analysis With Graph Neural Networks

Hejie Cui,Wei Dai,Yanqiao Zhu,Xuan Kan,Antonio Aodong Chen Gu,Joshua Lukemire,Liang Zhan,Lifang He,Ying Guo,Carl Yang

DOI: https://doi.org/10.1109/tmi.2022.3218745

IF: 10.6

2023-02-03

IEEE Transactions on Medical Imaging

Abstract:Mapping the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not yet been a systematic study of how to design effective GNNs for brain network analysis. To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs. BrainGB standardizes the process by (1) summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and (2) modularizing the implementation of GNN designs. We conduct extensive experiments on datasets across cohorts and modalities and recommend a set of general recipes for effective GNN designs on brain networks. To support open and reproducible research on GNN-based brain network analysis, we host the BrainGB website at https://braingb.us with models, tutorials, examples, as well as an out-of-box Python package. We hope that this work will provide useful empirical evidence and offer insights for future research in this novel and promising direction.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
EEG-Based Emotion Recognition Using Regularized Graph Neural Networks

Peixiang Zhong,Di Wang,Chunyan Miao

DOI: https://doi.org/10.1109/taffc.2020.2994159

IF: 13.99

2020-01-01

IEEE Transactions on Affective Computing

Abstract:Electroencephalography (EEG) measures the neuronal activities in different brain regions via electrodes. Many existing studies on EEG-based emotion recognition do not fully exploit the topology of EEG channels. In this article, we propose a regularized graph neural network (RGNN) for EEG-based emotion recognition. RGNN considers the biological topology among different brain regions to capture both local and global relations among different EEG channels. Specifically, we model the inter-channel relations in EEG signals via an adjacency matrix in a graph neural network where the connection and sparseness of the adjacency matrix are inspired by neuroscience theories of human brain organization. In addition, we propose two regularizers, namely node-wise domain adversarial training (NodeDAT) and emotion-aware distribution learning (EmotionDL), to better handle cross-subject EEG variations and noisy labels, respectively. Extensive experiments on two public datasets, SEED, and SEED-IV, demonstrate the superior performance of our model than state-of-the-art models in most experimental settings. Moreover, ablation studies show that the proposed adjacency matrix and two regularizers contribute consistent and significant gain to the performance of our RGNN model. Finally, investigations on the neuronal activities reveal important brain regions and inter-channel relations for EEG-based emotion recognition.

computer science, cybernetics, artificial intelligence

Process Intensification of Biodiesel Production Through Reactive Distillation and Supercritical Fluids By Timothy Risteski Thesis Report – Part B Supervisors Prof

A novel interactive deep cascade spectral graph convolutional network with multi-relational graphs for disease prediction

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

EEG-GCN: Spatio-Temporal and Self-Adaptive Graph Convolutional Networks for Single and Multi-View EEG-Based Emotion Recognition

Characterization of the reverse transcriptase from a new retrovirus (HTLV) produced by a human cutaneous T-cell lymphoma cell line.

Multi-Modal Diagnosis of Alzheimer's Disease using Interpretable Graph Convolutional Networks

Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

A Spiking Neural Network With Adaptive Graph Convolution and LSTM for EEG-Based Brain-Computer Interfaces

MGSN: Depression EEG lightweight detection based on multiscale DGCN and SNN for multichannel topology

Resting-State Functional MRI Adaptation with Attention Graph Convolution Network for Brain Disorder Identification

HAGCN: A hybrid-order brain network-based graph convolution learning framework with multi-head attention for brain disorder classification

Attention Spiking Neural Networks

Identifying Disease-Related Subnetwork Connectome Biomarkers by Sparse Hypergraph Learning

Graph Convolutional Network with Connectivity Uncertainty for EEG-based Emotion Recognition

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Whole-brain Prediction Analysis with GraphNet

BrainGB: A Benchmark for Brain Network Analysis With Graph Neural Networks

EEG-Based Emotion Recognition Using Regularized Graph Neural Networks