SERENE: The Semi-Automatic User Experience Detector

Andrea Esposito

2024-05-29

Abstract:SERENE (uSer ExpeRiENce dEtector), also known as UX-SAD (User eXperience-Smells Automatic Detector), is a research project born in 2020, which comprises different components. As its name suggests, its primary goal is to provide a way to quickly and (semi-) automatically detect problems in the user experience of websites and web-based systems. Through a set of Artificial Intelligence (AI) models, SERENE detects users' emotions in web pages while guaranteeing users' privacy. Its main strength over typical user experience and usability evaluation is in the generalizability of its detections. While traditional methods use samples (that may not be representative), SERENE allows to tap into data provided by the whole user population. The platform is available at <a class="link-external link-https" href="https://serene.ddns.net" rel="external noopener nofollow">this https URL</a>.

Human-Computer Interaction

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on improving the efficiency and accuracy of user experience (UX) evaluation for websites and web - based systems. Specifically, it aims to overcome several key challenges in traditional UX and usability evaluation methods by developing a semi - automatic user experience detection platform named SERENE (or UX - SAD):

1. **Resource - intensive problems**: Traditional UX evaluation methods usually require a great deal of time and resources, including hiring professional UX experts for evaluation. These methods are often overlooked by many companies and practitioners because of their high cost.

2. **Insufficient sample representativeness**: Traditional methods usually rely on limited sample data, which may not represent the entire user group, thus affecting the general applicability and reliability of the evaluation results.

3. **Lack of support from automated tools**: Although automatic or semi - automatic tools can significantly improve evaluation efficiency and better meet the specific needs of companies, effective tools in this field are still relatively scarce.

To address the above challenges, the SERENE platform utilizes artificial intelligence (AI) technology, especially machine - learning models, to detect users' emotional reactions on web pages, thereby identifying potential problems in user experience. Compared with traditional methods, the main advantage of SERENE lies in its ability to extract information from the data of the entire user group, which not only improves the breadth of detection but also ensures users' privacy security. In addition, by providing different levels of automated visualization tools, SERENE helps evaluators more effectively discover and understand the "smells" (i.e., negative experiences) in user experience, thereby promoting the continuous improvement and optimization of products.