Abstract:Background: Many mobile health (mHealth) apps for mental health have been made available in recent years. Although there is reason to be optimistic about their effect on improving health and increasing access to care, there is a call for more knowledge concerning how mHealth apps are used in practice. Objective: This study aimed to review the literature on how usability is being addressed and measured in mHealth interventions for mental health problems. Methods: We conducted a systematic literature review through a search for peer-reviewed studies published between 2001 and 2018 in the following electronic databases: EMBASE, CINAHL, PsycINFO, PubMed, and Web of Science. Two reviewers independently assessed all abstracts against the inclusion and exclusion criteria, following the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines. Results: A total of 299 studies were initially identified based on the inclusion keywords. Following a review of the title, abstract, and full text, 42 studies were found that fulfilled the criteria, most of which evaluated usability with patients (n=29) and health care providers (n=11) as opposed to healthy users (n=8) and were directed at a wide variety of mental health problems (n=24). Half of the studies set out to evaluate usability (n=21), and the remainder focused on feasibility (n=10) or acceptability (n=10). Regarding the maturity of the evaluated systems, most were either prototypes or previously tested versions of the technology, and the studies included few accounts of sketching and participatory design processes. The most common reason referred to for developing mobile mental health apps was the availability of mobile devices to users, their popularity, and how people in general became accustomed to using them for various purposes. Conclusions: This study provides a detailed account of how evidence of usability of mHealth apps is gathered in the form of usability evaluations from the perspective of computer science and human-computer interaction, including how users feature in the evaluation, how the study objectives and outcomes are stated, which research methods and techniques are used, and what the notion of mobility features is for mHealth apps. Most studies described their methods as trials, gathered data from a small sample size, and carried out a summative evaluation using a single questionnaire, which indicates that usability evaluation was not the main focus. As many studies described using an adapted version of a standard usability questionnaire, there may be a need for developing a standardized mHealth usability questionnaire.

Design and validation of a usability evaluation questionnaire (UEQ) for mobile learning applications

A Comprehensive Usability Measurement Tool for m-Learning Applications

The Evaluation of User Experience on Learning Management Systems Using UEQ

The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study

Comparison of Perceptual Differences Between Users and Designers in Mobile Shopping App Interface Design: Implications for Evaluation Practice

User Experience Analysis on Mobile Application Design Using User Experience Questionnaire

Conceptualization and survey instrument development for mobile application usability

Attitudes, perceptions and prospectings on mobile information literacy training: Design and validation of the MOBILE-APP questionnaire

User Experience Evaluation Method Based on Online Product Reviews

Evaluation of User Experience in Integrated Learning Information Systems Using User Experience Questionnaire (UEQ)

User Interface (UI) Design and User Experience Questionnaire (UEQ) Evaluation of a To-Do List Mobile Application to Support Day-To-Day Life of Older Adults

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps

The most used questionnaires for evaluating the usability of robots and smart wearables: A scoping review

Evaluating User Experience of a Mobile Health Application ‘Halodoc’ using User Experience Questionnaire and Usability Testing

Assessing user experience of interactive products: a Chinese questionnaire

Psychometric validation of the internet related experiences questionnaire and mobile related experiences questionnaire among Ecuadorian teenagers

Cocreative Development of the QoL-ME: A Visual and Personalized Quality of Life Assessment App for People With Severe Mental Health Problems

User interface design in mobile learning applications: Developing and evaluating a questionnaire for measuring learners' extraneous cognitive load

Usability Evaluation of a Mobile Application in Extraordinary Environment for Extraordinary People

Usability Evaluations of Mobile Mental Health Technologies: Systematic Review

Methodology for Evaluating Product Design at the Early Stage of Life Cycle