Abstract:Objective. Recently, deep learning models have been successfully applied in functional magnetic resonance imaging (fMRI) modeling and associated applications. However, there still exist at least two challenges. Firstly, due to the lack of sufficient data, deep learning models tend to suffer from overfitting in the training process. Secondly, it is still challenging to model the temporal dynamics from fMRI, due to that the brain state is continuously changing over scan time. In addition, existing methods rarely studied and applied fMRI data augmentation.Approach. In this work, we construct a deep recurrent variational auto-encoder (DRVAE) that combined variational auto-encoder and recurrent neural network, aiming to address all of the above mentioned challenges. The encoder of DRVAE can extract more generalized temporal features from assumed Gaussian distribution of input data, and the decoder of DRVAE can generate new data to increase training samples and thus partially relieve the overfitting issue. The recurrent layers in DRVAE are designed to effectively model the temporal dynamics of functional brain activities. LASSO (least absolute shrinkage and selection operator) regression is applied on the temporal features and input fMRI data to estimate the corresponding spatial networks.Main results. Extensive experimental results on seven tasks from HCP dataset showed that the DRVAE and LASSO framework can learn meaningful temporal patterns and spatial networks from both real data and generated data. The results on group-wise data and single subject suggest that the brain activities may follow certain distribution. Moreover, we applied DRVAE on four resting state fMRI datasets from ADHD-200 for data augmentation, and the results showed that the classification performances on augmented datasets have been considerably improved.Significance. The proposed method can not only derive meaningful temporal features and spatial networks from fMRI, but also generate high-quality new data for fMRI data augmentation and associated applications.

Causal Recurrent Variational Autoencoder for Medical Time Series Generation

TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generation

Time-Causal VAE: Robust Financial Time Series Generator

A VAE-based Framework for Learning Multi-Level Neural Granger-Causal Connectivity

Neural Additive Vector Autoregression Models for Causal Discovery in Time Series

Leveraging VQ-VAE tokenization for autoregressive modeling of medical time series

Causal Graph Discovery from Self and Mutually Exciting Time Series

VACA: Designing Variational Graph Autoencoders for Causal Queries

Bayesian Vector AutoRegression with Factorised Granger-Causal Graphs

Anomaly Detection of Time Series With Smoothness-Inducing Sequential Variational Auto-Encoder

Predictive variational autoencoder for learning robust representations of time-series data

Conditional out-of-sample generation for unpaired data using trVAE

Learning domain-specific causal discovery from time series

Variational Autoencoder: An Unsupervised Model for Modeling and Decoding fMRI Activity in Visual Cortex

Optimizing VarLiNGAM for Scalable and Efficient Time Series Causal Discovery

Causal Flow-based Variational Auto-Encoder for Disentangled Causal Representation Learning

SCM-VAE: Learning Identifiable Causal Representations Via Structural Knowledge.

Learning Causal Relations in Multivariate Time Series Data

Modeling and augmenting of fMRI data using deep recurrent variational auto-encoder

Deep Recurrent Modelling of Granger Causality with Latent Confounding

Hybrid Variational Autoencoder for Time Series Forecasting