Abstract:Whole-brain functional connectivity ( FC ) measured with functional MRI (fMRI) evolves over time in meaningful ways at temporal scales going from years (e.g., development) to seconds [e.g., within-scan time-varying FC ( tvFC )]. Yet, our ability to explore tvFC is severely constrained by its large dimensionality (several thousands). To overcome this difficulty, researchers often seek to generate low dimensional representations (e.g., 2D and 3D scatter plots) hoping those will retain important aspects of the data (e.g., relationships to behavior and disease progression). Limited prior empirical work suggests that manifold learning techniques ( MLTs )—namely those seeking to infer a low dimensional non-linear surface (i.e., the manifold) where most of the data lies—are good candidates for accomplishing this task. Here we explore this possibility in detail. First, we discuss why one should expect tv FC data to lie on a low dimensional manifold. Second, we estimate what is the intrinsic dimension ( ID ; i.e., minimum number of latent dimensions) of tvFC data manifolds. Third, we describe the inner workings of three state-of-the-art MLTs : Laplacian Eigenmaps ( LEs ), T-distributed Stochastic Neighbor Embedding ( T-SNE ), and Uniform Manifold Approximation and Projection ( UMAP ). For each method, we empirically evaluate its ability to generate neuro-biologically meaningful representations of tvFC data, as well as their robustness against hyper-parameter selection. Our results show that tvFC data has an ID that ranges between 4 and 26, and that ID varies significantly between rest and task states. We also show how all three methods can effectively capture subject identity and task being performed: UMAP and T-SNE can capture these two levels of detail concurrently, but LE could only capture one at a time. We observed substantial variability in embedding quality across MLTs , and within- MLT as a function of hyper-parameter selection. To help alleviate this issue, we provide heuristics that can inform future studies. Finally, we also demonstrate the importance of feature normalization when combining data across subjects and the role that temporal autocorrelation plays in the application of MLTs to tvFC data. Overall, we conclude that while MLTs can be useful to generate summary views of labeled tvFC data, their application to unlabeled data such as resting-state remains challenging.

Manifold-based Unsupervised Metric Learning, with Applications in Individualized Predictions Based on Functional Connectivity.

Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation

Simultaneous reconstruction and segmentation of MRI image by manifold learning

BSNMani: Bayesian Scalar-on-network Regression with Manifold Learning

Manifold learning for fMRI time-varying functional connectivity

Neural manifold analysis of brain circuit dynamics in health and disease

Manifold Learning of Dynamic Functional Connectivity Reliably Identifies Functionally Consistent Coupling Patterns in Human Brains.

Unsupervised Image Classifier based on Manifold Learning

Ensemble Manifold Regularized Multi-Modal Graph Convolutional Network for Cognitive Ability Prediction

Learning Brain Dynamics of Evolving Manifold Functional MRI Data Using Geometric-Attention Neural Network.

Ensemble manifold based regularized multi-modal graph convolutional network for cognitive ability prediction

Overview of Manifold Learning

Manifold Learning in Detecting the Transitions of Dynamic Functional Connectivities Boosts Brain State-Specific Recognition.

Connectivity Maps via Function-on-Scalar Regression

Detecting Brain State Changes via Manifold Mean Shifting.

Manifold learning through locally linear reconstruction based on Euclidean distance

Nonlinear manifold learning in functional magnetic resonance imaging uncovers a low‐dimensional space of brain dynamics

Discriminant Analysis of Functional Connectivity Patterns on Grassmann Manifold

Learning Implicit Brain MRI Manifolds with Deep Learning

Manifold Preserving: an Intrinsic Approach for Semisupervised Distance Metric Learning

Image Classification with Manifold Learning for Out-of-sample Data