A sensemaking system for grouping and suggesting stories from multiple affective viewpoints in museums

Antonio Lieto,Manuel Striani,Cristina Gena,Enrico Dolza,Anna Maria Marras,Gian Luca Pozzato,Rossana Damiano
2023-04-27
Abstract:This article presents an affective based sensemaking system for grouping and suggesting stories created by the users about the items of a museum. By relying on the TCL commonsense reasoning framework1, the system exploits the spatial structure of the Plutchik's wheel of emotions to organize the stories according to their extracted emotions. The process of emotion extraction, reasoning and suggestion is triggered by an app, called GAMGame, and integrated with the sensemaking engine. Following the framework of Citizen Curation, the system allows classifying and suggesting stories encompassing cultural items able to evoke not only the very same emotions of already experienced or preferred museum objects, but also novel items sharing different emotional stances and, therefore, able to break the filter bubble effect and open the users' view towards more inclusive and empathy-based interpretations of cultural content. The system has been designed tested, in the context of the H2020EU SPICE project (Social cohesion, Participation, and Inclusion through Cultural Engagement), in cooperation the community of the d/Deaf and on the collection of the Gallery of Modern Art (GAM) in Turin. We describe the user centered design process of the web app and of its components and we report the results concerning the effectiveness of the of the diversity seeking, affective driven, recommendations of stories.
Human-Computer Interaction
What problem does this paper attempt to address?
The paper attempts to address the issue of how to support museum visitors' reflection on cultural artifacts from an emotional perspective and to break the "filter bubble" effect through emotionally diverse and inclusive recommendations, thereby promoting broader cultural understanding and empathy. Specifically, the paper introduces an emotion-based explanation system that can classify and recommend stories created by users about museum collections. This system utilizes Plutchik's wheel of emotions to organize the stories and triggers the process of emotion extraction, reasoning, and recommendation through an application called GAMGame. The design of this application aims to support the concept of "Citizen Curation," allowing users to create and share personal stories that not only evoke the same emotions as the museum items they have experienced or prefer but also recommend new items that trigger similar or opposite emotions. This breaks the filter bubble effect, broadens users' perspectives, and makes them more inclusive and empathetic. The system was designed and tested within the EU H2020 SPICE project, with a particular focus on the needs of the deaf community, and was applied to the collections of the Gallery of Modern Art (GAM) in Turin. The research results indicate that this emotion-driven, diversity-seeking recommendation system has a significant effect on enhancing user experience and promoting social inclusion.