To Animate or Not to Animate Usability Scales: The Effect of Animation on Questionnaire Experience and Psychometric Properties

Juergen BaumgartnerAndreas SondereggerJuergen Sauera Department of Psychology,University of Fribourg,Fribourg,Switzerlandb We Are Cube,Bern,Switzerlandc Business School,Institute for New Work,Bern University of Applied Sciences,Bern,SwitzerlandJuergen Baumgartner is a PhD student in Psychology at the University of Fribourg (CH) and a Senior UX Consultant at Puzzle ITC in Bern (CH). He received his MSc in Work and Organisational Psychology from the University of Fribourg (CH) in 2015.Andreas Sonderegger is Professor at Bern University of Applied Sciences (Business Department,Institute for New Work) and Lecturer at the University of Fribourg (Department of Psychology) (both CH). He received his PhD in 2010 and his MSc in Work and Organisational Psychology in 2003 from the University of Fribourg (CH).Juergen Sauer is Full Professor of Cognitive Ergonomics at the Department of Psychology at the University of Fribourg (CH). He received an MSc in Occupational Psychology from the University of Sheffield (UK) in 1990 and a PhD in Psychology from the University of Hull (UK) in 1997.

DOI: https://doi.org/10.1080/10447318.2024.2338333

IF: 4.92

2024-04-15

International Journal of Human-Computer Interaction

Abstract:The Hybrid Usability Inventory (HUI) is a usability questionnaire that uses a combination of pictorial and verbal information to express the meaning of its items. This study aimed to extend the static pictorial representation by using animations. Previous research has not yet addressed the positive or negative outcomes of using animations in pictorial questionnaires. We hypothesized that an animated questionnaire would have an additional positive effect on respondents' questionnaire experience, motivation, and preferences without impinging psychometric properties. The goal of the present study was to compare the static HUI with an animated version (AniHUI) in an online test setting. Respondent-centered aspects (questionnaire experience) and psychometric properties (sensitivity, validity, reliability) were assessed. Participants ( N = 192) interacted with a website prototype (either high or low usability) and subsequently assessed the website's usability either with HUI or AniHUI, the System Usability Scale (SUS), and further measures of interest. Results suggest that AniHUI did not differ substantially from HUI. However, both the static and animated scales were superior to the SUS regarding respondent-centred measures. Findings suggest that the HUI and the AniHUI are engaging and reliable scales that can be used in research and practice.

computer science, cybernetics,ergonomics