Transformers Meet ACT-R: Repeat-Aware and Sequential Listening Session Recommendation

Viet-Anh Tran,Guillaume Salha-Galvan,Bruno Sguerra,Romain Hennequin
2024-08-29
Abstract:Music streaming services often leverage sequential recommender systems to predict the best music to showcase to users based on past sequences of listening sessions. Nonetheless, most sequential recommendation methods ignore or insufficiently account for repetitive behaviors. This is a crucial limitation for music recommendation, as repeatedly listening to the same song over time is a common phenomenon that can even change the way users perceive this song. In this paper, we introduce PISA (Psychology-Informed Session embedding using ACT-R), a session-level sequential recommender system that overcomes this limitation. PISA employs a Transformer architecture learning embedding representations of listening sessions and users using attention mechanisms inspired by Anderson's ACT-R (Adaptive Control of Thought-Rational), a cognitive architecture modeling human information access and memory dynamics. This approach enables us to capture dynamic and repetitive patterns from user behaviors, allowing us to effectively predict the songs they will listen to in subsequent sessions, whether they are repeated or new ones. We demonstrate the empirical relevance of PISA using both publicly available listening data from <a class="link-external link-http" href="http://Last.fm" rel="external noopener nofollow">this http URL</a> and proprietary data from Deezer, a global music streaming service, confirming the critical importance of repetition modeling for sequential listening session recommendation. Along with this paper, we publicly release our proprietary dataset to foster future research in this field, as well as the source code of PISA to facilitate its future use.
Information Retrieval,Machine Learning
What problem does this paper attempt to address?
The paper aims to address the issue of sequential recommendation systems in music streaming services failing to adequately consider repetitive behavior. Specifically: - **Problem Background**: Most current sequential recommendation systems ignore users' repetitive behavior (e.g., repeatedly listening to the same song), which is very common and important in music recommendations because repeated listening can change users' perception of a song. - **Research Objective**: A method named PISA (Psychology-Inspired Session Embedding using ACT-R) is proposed. This is a recommendation system based on the Transformer architecture, which combines Anderson's ACT-R cognitive framework to model users' dynamic and repetitive behavior patterns. - **Method Advantages**: PISA can accurately predict the songs users will listen to in future sessions, whether they are repeats or new songs, by capturing the sequential and repetitive patterns in users' past listening sessions. The paper validates the effectiveness of PISA using the publicly available Last.fm dataset and Deezer's proprietary dataset, emphasizing the importance of modeling repetitive behavior in music recommendation scenarios. Additionally, the authors have made the code and datasets publicly available to facilitate further research in this field.