Measuring User Experience of Adaptive User Interfaces using EEG: A Replication Study

Daniel Gaspar-Figueiredo,Silvia Abrahão,Emilio Insfrán,Jean Vanderdonckt

DOI: https://doi.org/10.1145/3593434.3593452

2023-06-06

Abstract:Adaptive user interfaces have the advantage of being able to dynamically change their aspect and/or behaviour depending on the characteristics of the context of use, i.e. to improve user experience(UX). UX is an important quality factor that has been primarily evaluated with classical measures but to a lesser extent with physiological measures, such as emotion recognition, skin response, or brain <a class="link-external link-http" href="http://activity.In" rel="external noopener nofollow">this http URL</a> a previous exploratory experiment involving users with different profiles and a wide range of ages, we analysed user experience in terms of cognitive load, engagement, attraction and memorisation when employing twenty graphical adaptive menus through the use of an Electroencephalogram (EEG) device. The results indicated that there were statistically significant differences for these four variables. However, we considered that it was necessary to confirm or reject these findings using a more homogeneous group of users.We conducted an operational internal replication study with 40 participants. We also investigated the potential correlation between EEG signals and the participants' user experience ratings, such as their preferences.The results of this experiment confirm that there are statistically significant differences between the EEG variables when the participants interact with the different adaptive menus. Moreover, there is a high correlation among the participants' UX ratings and the EEG signals, and a trend regarding performance has emerged from our analysis.These findings suggest that EEG signals could be used to evaluate UX. With regard to the menus studied, our results suggest that graphical menus with different structures and font types produce more differences in users' brain responses, while menus which use colours produce more similarities in users' brain responses. Several insights with which to improve users' experience of graphical adaptive menus are outlined.

Human-Computer Interaction,Software Engineering

What problem does this paper attempt to address?

The paper attempts to address the issue of evaluating the impact of Adaptive User Interfaces (AUIs) on User Experience (UX), particularly by measuring UX metrics such as cognitive load, engagement, attractiveness, and memory through Electroencephalogram (EEG) technology. Specifically, the goals of the paper include:

1. **Validating previous research results**: By conducting internal replication experiments among different user groups, the paper aims to verify whether the results found in previous exploratory experiments regarding the impact of different types of graphical adaptive menus on users' brainwave activity and user experience can be generalized to other populations.

2. **Exploring new research questions**: In addition to validating previous findings, the paper also aims to investigate the correlation between EEG signals and user experience scores obtained through traditional questionnaires, i.e., whether there is a connection between objective physiological data and subjective user experience evaluations.

By addressing these questions, the researchers hope to provide empirical evidence for software designers, helping them understand the specific impact of different types of graphical adaptive menus on the emotional state and cognitive load of end-users, thereby guiding the design of more efficient and user-friendly adaptive user interfaces.