Abstract:In this paper we propose a web-based approach for quick visualization of big data from brain magnetic resonance imaging (MRI) scans using a combination of an automated image capture and processing system, nonlinear embedding, and interactive data visualization tools. We draw upon thousands of MRI scans captured via the COllaborative Imaging and Neuroinformatics Suite (COINS). We then interface the output of several analysis pipelines based on structural and functional data to a t-distributed stochastic neighbor embedding (t-SNE) algorithm which reduces the number of dimensions for each scan in the input data set to two dimensions while preserving the local structure of data sets. Finally, we interactively display the output of this approach via a web-page, based on data driven documents (D3) JavaScript library. Two distinct approaches were used to visualize the data. In the first approach, we computed multiple quality control (QC) values from pre-processed data, which were used as inputs to the t-SNE algorithm. This approach helps in assessing the quality of each data set relative to others. In the second case, computed variables of interest (e.g., brain volume or voxel values from segmented gray matter images) were used as inputs to the t-SNE algorithm. This approach helps in identifying interesting patterns in the data sets. We demonstrate these approaches using multiple examples from over 10,000 data sets including (1) quality control measures calculated from phantom data over time, (2) quality control data from human functional MRI data across various studies, scanners, sites, (3) volumetric and density measures from human structural MRI data across various studies, scanners and sites. Results from (1) and (2) show the potential of our approach to combine t-SNE data reduction with interactive color coding of variables of interest to quickly identify visually unique clusters of data (i.e., data sets with poor QC, clustering of data by site) quickly. Results from (3) demonstrate interesting patterns of gray matter and volume, and evaluate how they map onto variables including scanners, age, and gender. In sum, the proposed approach allows researchers to rapidly identify and extract meaningful information from big data sets. Such tools are becoming increasingly important as datasets grow larger.

THINGS-data, a multimodal collection of large-scale datasets for investigating object representations in human brain and behavior

Caltech Conte Center, a multimodal data resource for exploring social cognition and decision-making

THINGSplus: New norms and metadata for the THINGS database of 1854 object concepts and 26,107 natural object images

A multimodal fMRI dataset unifying naturalistic processes with a rich array of experimental tasks

Main Existing Datasets for Open Brain Research on Humans

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

A Tool for Interactive Data Visualization: Application to Over 10,000 Brain Imaging and Phantom MRI Data Sets

Release of cognitive and multimodal MRI data including real-world tasks and hippocampal subfield segmentations

BOLD5000: A public fMRI dataset of 5000 images

Individual Brain Charting dataset extension, third release for movie watching and retinotopy data

An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI

The Brain Image Library: A Community-Contributed Microscopy Resource for Neuroscientists

A large and rich EEG dataset for modeling human visual object recognition

The Transdiagnostic Connectome Project: a richly phenotyped open dataset for advancing the study of brain-behavior relationships in psychiatry

Data-Driven Network Neuroscience: On Data Collection and Benchmark

BrainTACO: an explorable multi-scale multi-modal brain transcriptomic and connectivity data resource

Multimodal Precision Neuroimaging of the Individual Human Brain at Ultra-high fields

THÖR-MAGNI: A Large-scale Indoor Motion Capture Recording of Human Movement and Robot Interaction

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling

fMRI-3D: A Comprehensive Dataset for Enhancing fMRI-based 3D Reconstruction

CAT: a computational anatomy toolbox for the analysis of structural MRI data