Abstract:BACKGROUND COVID 2019 restrictions severely curtailed empirical endeavors that involved in-person human interaction. The pandemic also stimulated our team to embrace technology in a two-fold manner. First, we created novel technology to help us to overcome pandemic restrictions in teaching empathic communication in the traditional classroom. A web-based training portal was created for users to learn empathy in an accessible, compelling, self-directed, and interactive online environment. Second, we harnessed technology to engage in remote usability testing and data collection with prospective users of our training portal. In developing our protocol, we discovered gaps in the literature on moderator and silent observer roles and experiences in conducting remote usability testing. OBJECTIVE The aim of this paper is to share our remote moderator and silent observer experiences and their use of certain tools to capture user feedback and experiences with the app. METHODS The larger-scale project employed a quantitative and think-aloud qualitative problem-discovery usability study design. Three trained research assistants collected and utilized user feedback from eight users who were asked to complete tasks in three sessions. Each research assistant had assigned roles and were asked to qualitatively describe their roles, experiences and reactions to the usability testing protocol, and suggestions for improved techniques and strategies for conducting remote usability testing. RESULTS Major results are described in relation to the research assistant experiences with the study protocol followed by recommendations for the design of future remote testing activities as well as evidence-informed training materials for usability project personnel. CONCLUSIONS Our findings highlighted that as we move towards greater remote usability testing, we also need more comprehensive understanding of human-computer interaction and its impact on usability testing outcomes. Our team realized that accessible comprehensive web-conferencing platform to conduct remote sessions is not sufficient. Lead moderator and silent observers offered their insights and recommendations for the ongoing creation and testing of training materials for their respective roles with a focus on: online interpersonal communication skills, conducting user testing protocols, troubleshooting technology and test user issues, proficiency in web-conferencing plus behavior analysis and feedback technologies, and time management. CLINICALTRIAL None.

I feel for you! The effect of empathy exercises on accessibility awareness

Evoking empathy with visually impaired people through an augmented reality embodiment experience

Cultivating empathy and upgrading design decisions of students: the impact of simulating public transit experiences of individuals with mild visual impairments

Enhancing empathy through virtual reality: Developing a universal design training application for students

Accessible Adventures: Teaching Accessibility to High School Students Through Games

Extreme-user conditions to enhance design creativity and empathy- application using visual impairment

Presenting and evaluating the impact of experiential learning in computing accessibility education

Encouraging Awareness and Empathy for Diversity Through Experiential Practiced Simulations

Accessibility in Software Practice: A Practitioner's Perspective

Access for autistic student-actors: interrogating the role of empathy within actor-training methods

Achieving empathy with users: the effects of different sources of information

The effect of a serious game on empathy and prejudice of psychology students towards persons with disabilities

Evaluating a Multi-Component Classroom Intervention to Teach Accessibility in Higher Education: A Case Study With Persona Cards

Virtual reality to foster empathy in disability workers: A feasibility study during COVID‐19

Nuanced Perspectives Toward Disability Simulations from Digital Designers, Blind, Low Vision, and Color Blind People

Using Virtual Patients to Support Empathy Training in Health Care Education: An Exploratory Study

Exploring the Need of Accessibility Education in the Software Industry: Insights from a Survey of Software Professionals in India

Empathic Design Research: Disability Plus Relevant Design

The Effect of Emotional Awareness Exercises on Adaptiveness in Coping and Empathy with Pre-Service Teachers in Mixed Reality Simulations

Moderator and observer experiences and decision-making: Remote usability testing of a web-based empathy training portal (Preprint)

Integrating Accessibility in a Mobile App Development Course