Abstract:Background: Although biofeedback using electrophysiology has been explored extensively, the approach of using neurofeedback corresponding to hemodynamic response is a relatively young field. Real time functional magnetic resonance imaging-based neurofeedback (rt-fMRI-NF) uses sensory feedback to operantly reinforce patterns of neural response. It can be used, for example, to alter visual perception, increase brain connectivity, and reduce depression symptoms. Within recent years, interest in rt-fMRI-NF in both research and clinical contexts has expanded considerably. As such, building a consensus regarding best practices is of great value.Objective: This systematic review is designed to describe and evaluate the variations in methodology used in previous rt-fMRI-NF studies to provide recommendations for rt-fMRI-NF study designs that are mostly likely to elicit reproducible and consistent effects of neurofeedback.Methods: We conducted a database search for fMRI neurofeedback papers published prior to September 26th, 2019. Of 558 studies identified, 146 met criteria for inclusion. The following information was collected from each study: sample size and type, task used, neurofeedback calculation, regulation procedure, feedback, whether feedback was explicitly related to changing brain activity, feedback timing, control group for active neurofeedback, how many runs and sessions of neurofeedback, if a follow-up was conducted, and the results of neurofeedback training.Results: rt-fMRI-NF is typically upregulation practice based on hemodynamic response from a specific region of the brain presented using a continually updating thermometer display. Most rt-fMRI-NF studies are conducted in healthy samples and half evaluate its effect on immediate changes in behavior or affect. The most popular control group method is to provide sham signal from another region; however, many studies do not compare use a comparison group.Conclusions: We make several suggestions for designs of future rt-fMRI-NF studies. Researchers should use feedback calculation methods that consider neural response across regions (i.e., SVM or connectivity), which should be conveyed as intermittent, auditory feedback. Participants should be given explicit instructions and should be assessed on individual differences. Future rt-fMRI-NF studies should use clinical samples; effectiveness of rt-fMRI-NF should be evaluated on clinical/behavioral outcomes at follow-up time points in comparison to both a sham and no feedback control group.

Ten simple rules for neuroimaging meta-analysis

Scanning the horizon: towards transparent and reproducible neuroimaging research

The coordinate-based meta-analysis of neuroimaging data

Small effect size leads to reproducibility failure in resting-state fMRI studies

ENIGMA's simple seven: Recommendations to enhance the reproducibility of resting-state fMRI in traumatic brain injury

The multiverse of data preprocessing and analysis in graph-based fMRI: A systematic literature review of analytical choices fed into a decision support tool for informed analysis

Common Critiques and Recommendations for Studies in Neurology Using Machine Learning Methods

Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility

Open and reproducible neuroimaging: From study inception to publication

Guidelines for the content and format of PET brain data in publications and archives: A consensus paper

Moving Beyond Processing and Analysis-Related Variation in Neuroscience

Exploration, inference and prediction in neuroscience and biomedicine

How to optimize neuroscience data utilization and experiment design for advancing primate visual and linguistic brain models?

A Guide to Literature Informed Decisions in the Design of Real Time fMRI Neurofeedback Studies: A Systematic Review

Quality over quantity: powering neuroimaging samples in psychiatry

Current Challenges in Translational and Clinical fMRI and Future Directions

Minimal specifications for non-human primate MRI: Challenges in standardizing and harmonizing data collection

Statistical learning methods for neuroimaging data analysis with applications

Interpreting Brain Biomarkers: Challenges and solutions in interpreting machine learning-based predictive neuroimaging

NeuroMark: a fully automated ICA method to identify effective fMRI markers of brain disorders