Abstract:Whole-brain functional connectivity ( FC ) measured with functional MRI (fMRI) evolves over time in meaningful ways at temporal scales going from years (e.g., development) to seconds [e.g., within-scan time-varying FC ( tvFC )]. Yet, our ability to explore tvFC is severely constrained by its large dimensionality (several thousands). To overcome this difficulty, researchers often seek to generate low dimensional representations (e.g., 2D and 3D scatter plots) hoping those will retain important aspects of the data (e.g., relationships to behavior and disease progression). Limited prior empirical work suggests that manifold learning techniques ( MLTs )—namely those seeking to infer a low dimensional non-linear surface (i.e., the manifold) where most of the data lies—are good candidates for accomplishing this task. Here we explore this possibility in detail. First, we discuss why one should expect tv FC data to lie on a low dimensional manifold. Second, we estimate what is the intrinsic dimension ( ID ; i.e., minimum number of latent dimensions) of tvFC data manifolds. Third, we describe the inner workings of three state-of-the-art MLTs : Laplacian Eigenmaps ( LEs ), T-distributed Stochastic Neighbor Embedding ( T-SNE ), and Uniform Manifold Approximation and Projection ( UMAP ). For each method, we empirically evaluate its ability to generate neuro-biologically meaningful representations of tvFC data, as well as their robustness against hyper-parameter selection. Our results show that tvFC data has an ID that ranges between 4 and 26, and that ID varies significantly between rest and task states. We also show how all three methods can effectively capture subject identity and task being performed: UMAP and T-SNE can capture these two levels of detail concurrently, but LE could only capture one at a time. We observed substantial variability in embedding quality across MLTs , and within- MLT as a function of hyper-parameter selection. To help alleviate this issue, we provide heuristics that can inform future studies. Finally, we also demonstrate the importance of feature normalization when combining data across subjects and the role that temporal autocorrelation plays in the application of MLTs to tvFC data. Overall, we conclude that while MLTs can be useful to generate summary views of labeled tvFC data, their application to unlabeled data such as resting-state remains challenging.

Convergence of Manifold Filter-Combine Networks

Manifold Filter-Combine Networks

A Convergence Rate for Manifold Neural Networks

ManifoldNet: A Deep Network Framework for Manifold-valued Data

Deep Manifold Computing and Visualization

Stability to Deformations of Manifold Filters and Manifold Neural Networks

Geometric Graph Filters and Neural Networks: Limit Properties and Discriminability Trade-offs

Hypergraph Induced Convolutional Manifold Networks.

Transfer Learning with Manifold Regularized Convolutional Neural Network.

Exploring the Manifold of Neural Networks Using Diffusion Geometry

Manifold GCN: Diffusion-based Convolutional Neural Network for Manifold-valued Graphs

Deep Manifold Part 1: Anatomy of Neural Network Manifold

FMGNN: Fused Manifold Graph Neural Network

Matrix Manifold Neural Networks++

Parallel Transport Convolution: A New Tool for Convolutional Neural Networks on Manifolds

Graph Convolutional Network Based on Manifold Similarity Learning

The Manifold Scattering Transform for High-Dimensional Point Cloud Data

Ensemble Manifold Regularized Multi-Modal Graph Convolutional Network for Cognitive Ability Prediction

Neural Manifold Clustering and Embedding

Manifold learning for fMRI time-varying functional connectivity