Abstract:Reducing contributions from non-neuronal sources is a crucial step in functional magnetic resonance imaging (fMRI) connectivity analyses. Many viable strategies for denoising fMRI are used in the literature, and practitioners rely on denoising benchmarks for guidance in the selection of an appropriate choice for their study. However, fMRI denoising software is an ever-evolving field, and the benchmarks can quickly become obsolete as the techniques or implementations change. In this work, we present a denoising benchmark featuring a range of denoising strategies, datasets and evaluation metrics for connectivity analyses, based on the popular fMRIprep software. The benchmark prototypes an implementation of a reproducible framework, where the provided Jupyter Book enables readers to reproduce or modify the figures on the Neurolibre reproducible preprint server (https://neurolibre.org/). We demonstrate how such a reproducible benchmark can be used for continuous evaluation of research software, by comparing two versions of the fMRIprep. Most of the benchmark results were consistent with prior literature. Scrubbing, a technique which excludes time points with excessive motion, combined with global signal regression, is generally effective at noise removal. Scrubbing was generally effective, but is incompatible with statistical analyses requiring the continuous sampling of brain signal, for which a simpler strategy, using motion parameters, average activity in select brain compartments, and global signal regression, is preferred. Importantly, we found that certain denoising strategies behave inconsistently across datasets and/or versions of fMRIPrep, or had a different behavior than in previously published benchmarks. This work will hopefully provide useful guidelines for the fMRIprep users community, and highlight the importance of continuous evaluation of research methods. Many strategies exist to denoise fMRI signal. However, denoising software is ever-evolving, and benchmarks quickly become obsolete. Here, we present a denoising benchmark featuring several strategies and datasets to evaluate functional connectivity analysis, based on fMRIprep. The benchmark is implemented in a fully reproducible framework. The provided Jupyter Book enables readers to reproduce core computations and figures from the Neurolibre reproducible preprint server (https://neurolibre.org/). Most results were consistent with prior literature. Scrubbing was generally effective, but is incompatible with statistical analyses requiring the continuous sampling of brain signals, for which a simpler strategy is preferred. Importantly, we found that certain denoising strategies behaved inconsistently across datasets and/or fMRIPrep versions, or differently from the literature. Our benchmark can enable the continuous evaluation of research software and provide up-to-date denoising guidelines to fMRIprep users. This generic reproducible infrastructure can facilitate the continuous evaluation of research tools across various fields.

Voxel-wise or Region-wise Nuisance Regression for Functional Connectivity Analyses: Does it matter?

Reproducibility and Sensitivity of Resting-State Fmri in Patients with Parkinson's Disease Using Cross Validation-Based Data Censoring

An evaluation of the efficacy, reliability, and sensitivity of motion correction strategies for resting-state functional MRI

Nuisance Regression of High-Frequency Functional Magnetic Resonance Imaging Data: Denoising Can Be Noisy

The efficacy of resting-state fMRI denoising pipelines for motion correction and behavioural prediction.

Disentangling time series between brain tissues improves fMRI data quality using a time-dependent deep neural network

Comparing data-driven physiological denoising approaches for resting-state fMRI: implications for the study of aging

Advancing motion denoising of multiband resting-state functional connectivity fMRI data

Effects of Physiological Signal Removal on Resting-State Functional MRI Metrics

A Comparison of Denoising Approaches for Spoken Word Production Related Artefacts in Continuous Multiband fMRI Data

A robust deep neural network for denoising task-based fMRI data: An application to working memory and episodic memory

Feature-Specific Denoising of Neural Activity for Natural Image Identification

Denoising Improves Cross-Scanner and Cross-Protocol Test-Retest Reproducibility of Higher-Order Diffusion Metrics

Evaluation of noise regression techniques in resting-state fMRI studies using data of 434 older adults

Standardizing the intrinsic brain: Towards robust measurement of inter-individual variation in 1000 functional connectomes.

Denoise Functional Magnetic Resonance Imaging with Random Matrix Theory Based Principal Component Analysis

A Mixed Model Approach for Estimating Regional Functional Connectivity from Voxel-level BOLD Signals

NOise Reduction with DIstribution Corrected (NORDIC) principal component analysis improves brain activity detection across rodent and human functional MRI contexts

Identification of Effective Connectivity Subregions

Continuous evaluation of denoising strategies in resting-state fMRI connectivity using fMRIPrep and Nilearn

Critical Factors in Achieving Fine‐scale Functional MRI: Removing Sources of Inadvertent Spatial Smoothing