Abstract:Background: Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)-based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility. Objective: This systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects. Methods: EBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings. Results: The search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments. Conclusions: Although it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.

Ecological validity of neuropsychological interventions: A systematic review

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.

Ecological validity in exercise neuroscience research: A systematic investigation

Towards enhancing ecological validity in user studies: a systematic review of guidelines and implications for QoE research

Developmental, Behavioural and NDBI Interventions in Autistic Children or at Elevated Likelihood of Autism: A Systematic Review of Neural Outcomes

Experiences of psychological interventions in neurodegenerative diseases: a systematic review and thematic synthesis

Neuroimaging of learning and development: improving ecological validity

How are nature-based interventions defined in mild cognitive impairment and dementia studies? A conceptual systematic review and novel taxonomy

Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review

Efficacy of psychosocial interventions for Autism spectrum disorder: an umbrella review

A review of online and gamified psychoeducational interventions for children with neurodevelopmental disorders and their parents

Implementation of Cognitive (Neuropsychological) Interventions for Older Adults in Clinical or Community Settings: A Scoping Review

Efficacy of Nonpharmacological Interventions in Cognitive Impairment: Systematic Review And Network Meta-Analysis

Effectiveness of remote neuropsychological interventions: A systematic review

Ecological assessment of cognitive functions in children with acquired brain injury: A systematic review

Nature-Based Interventions for Adults with Developmental Disabilities: A Scoping Review Centering Autistic Adults

Neurofeedback and the Aging Brain: A Systematic Review of Training Protocols for Dementia and Mild Cognitive Impairment

A systematic review evaluating the implementation of technologies to assess, monitor and treat neurodevelopmental disorders: A map of the current evidence

Advancing Neuropsychological Rehabilitation in Primary Progressive Aphasia Based on Principles of Cognitive Neuroscience: A Scoping Review and Systematic Analysis of the Data

Neuropsychological assessments to evaluate cognition in music therapy and music-based interventions for mild cognitive impairment and dementia: A descriptive systematic review