Abstract:Background: The field of rehabilitation has seen a recent rise in technologies to support shared decision-making (SDM). Usability testing during the design process of SDM technologies is needed to optimize adoption and realize potential benefits. There is variability in how usability is defined and measured. Given the complexity of usability, a thorough examination of the methodologies used to measure usability to develop the SDM technologies used in rehabilitation care is needed. Objective: This scoping review aims to answer the following research questions: which methods and measures have been used to produce knowledge about the usability of rehabilitation technologies aimed at supporting SDM at the different phases of development and implementation? Which parameters of usability have been measured and reported? Methods: This review followed the Arksey and O'Malley framework. An electronic search was performed in the Ovid MEDLINE, Embase, CINAHL, and PsycINFO databases from January 2005 up to November 2020. In total, 2 independent reviewers screened all retrieved titles, abstracts, and full texts according to the inclusion criteria and extracted the data. The International Organization for Standardization framework was used to define the scope of usability (effectiveness, efficiency, and satisfaction). The characteristics of the studies were outlined in a descriptive summary. Findings were categorized based on usability parameters, technology interventions, and measures of usability. Results: A total of 38 articles were included. The most common SDM technologies were web-based aids (15/33, 46%). The usability of SDM technologies was assessed during development, preimplementation, or implementation, using 14 different methods. The most frequent methods were questionnaires (24/38, 63%) and semistructured interviews (16/38, 42%). Satisfaction (27/38, 71%) was the most common usability parameter mapped to types of SDM technologies and usability evaluation methods. User-centered design (9/15, 60%) was the most frequently used technology design framework. Conclusions: The results from this scoping review highlight the importance and the complexity of usability evaluation. Although various methods and measures were shown to be used to evaluate the usability of technologies to support SDM in rehabilitation, very few evaluations used in the included studies were found to adequately span the selected usability domains. This review identified gaps in usability evaluation, as most studies (24/38, 63%) relied solely on questionnaires rather than multiple methods, and most questionnaires simply focused on the usability parameter of satisfaction. The consideration of end users (such as patients and clinicians) is of particular importance for the development of technologies to support SDM, as the process of SDM itself aims to improve patient-centered care and integrate both patient and clinician voices into their rehabilitation care.

Usability of Social, Emotional, and Behavioral Assessments in Schools: A Systematic Review From 2009 to 2019

Self-Assessment Survey: Evaluation of a Revised Measure Assessing Positive Behavioral Interventions and Supports

Exploring Social, Emotional, and Behavioral Screening Approaches in U.S. Public School Districts

Developing a Whole Child School Screening Instrument: Evaluating Perceived Usability as an Initial Step in Planning for Consequential Validity

Secondary and Tertiary Support Systems in Schools Implementing School-Wide Positive Behavioral Interventions and Supports

Universal screening for social-emotional and behavioral risk: Differential item functioning on the SAEBRS

Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review

Timing and frequency of screening in schools: A latent variable analysis of behavioral stability over time.

Methodologies for Evaluating the Usability of Rehabilitation Technologies Aimed at Supporting Shared Decision-Making: Scoping Review

Psychometric Properties of the Behavior Assessment System for Children-3 Behavioral and Emotional Screening System Student-Report Form among a Predominantly Latinx Elementary School Sample

A Systematic Review of Instruments Measuring Social and Emotional Skills in School-Aged Children and Adolescents

An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review

Enhancement and Standardization of a Universal Social-Emotional Health Measure for Students’ Psychological Strengths

A Systematic Review of Student Disability and Race Representation in Universal School-Based Social and Emotional Learning Interventions for Elementary School Students

Gender, racial-ethnic, and socioeconomic disparities in the development of social-emotional competence among elementary school students

Web-Based Assessment of Children’s Social-Emotional Comprehension

Usability Evaluations of Mobile Mental Health Technologies: Systematic Review

An Empirical Evaluation of the System Usability Scale

Multi-Informant Universal Mental Health Screening for Preschool-Aged Children by Parents and Educators: A PRISMA Systematic Review

User-Friendly Measures of Meaningful Outcomes: Evaluating Behavioral Interventions

Family Involvement in School-Based Behavioral Screening: A Review of Six School Psychology Journals from 2004 to 2014