The Case for Scrutable, Personal, Long-Term User Models for Information Retrieval

Judy Kay

DOI: https://doi.org/10.1145/3406522.3444755

2021-03-14

Abstract:Information retrieval systems are a ubiquitous part of people's daily lives. The personalised services of such systems are driven by user models that are typically built from data collected from large numbers of people. There is a growing demand that we build such "intelligent systems" in ways that ensure the user can understand and control them. This is the spirit of legislation across many countries, such as the European Union General Data protection Regulation (GDPR). Essentially, this reflects people's demand to control their own data and its use. The talk presents my work and vision to meet this demand by the systematic design and creation of scrutable personalised systems. I will explain the rationale for scrutability --- where systems are designed, from their very foundations, so that people can scrutinise them to understand and control how their personal data is captured and transformed into a user model and used in personalised smart systems. I will argue the importance of understanding the three very different definitions of user models across research communities of (1) human-computer interaction, (2) large scale personalisation such as information retrieval and (3) personal user models that have been a mainstay of intelligent tutoring systems. I will discuss how all three fit with human aspects of information retrieval and argue the need for more work on personalised user models, including ones that support client-side personalisation, in combination with more conventional approaches. I will discuss the challenges of the dealing with the uncertainty that is the norm in much user modelling and personalisation and share decades of experience in building interfaces to support scrutability and user control and work that explores challenges of long-term personal data.