EEG-SVRec: An EEG Dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation

Shaorun Zhang,Zhiyu He,Ziyi Ye,Peijie Sun,Qingyao Ai,Min Zhang,Yiqun Liu

2024-04-01

Abstract:In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations when inferring user preferences due to issues such as data sparsity and noise from accidental interactions or personal habits. To address these challenges and provide a more comprehensive understanding of user affective experience and cognitive activity, we propose EEG-SVRec, the first EEG dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation. The study involves 30 participants and collects 3,657 interactions, offering a rich dataset that can be used for a deeper exploration of user preference and cognitive activity. By incorporating selfassessment techniques and real-time, low-cost EEG signals, we offer a more detailed understanding user affective experiences (valence, arousal, immersion, interest, visual and auditory) and the cognitive mechanisms behind their behavior. We establish benchmarks for rating prediction by the recommendation algorithm, showing significant improvement with the inclusion of EEG signals. Furthermore, we demonstrate the potential of this dataset in gaining insights into the affective experience and cognitive activity behind user behaviors in recommender systems. This work presents a novel perspective for enhancing short video recommendation by leveraging the rich information contained in EEG signals and multidimensional affective engagement scores, paving the way for future research in short video recommendation systems.

Information Retrieval

What problem does this paper attempt to address?

This paper aims to address the main reliance of existing short video recommendation systems on user behavior data (such as likes, watch time, etc.) to infer user preferences. However, these data may suffer from sparsity, noise caused by occasional interactions or personal habits, which limits the comprehensive understanding of user emotional experiences and cognitive activities. To tackle these issues, the paper proposes a novel EEG (electroencephalogram) dataset called EEG-SVRec, which includes multi-dimensional emotional engagement labels of users during short video browsing. By collecting 3,657 interaction data from 30 participants, the researchers provide an in-depth understanding of user emotional experiences (such as positive/negative emotions, arousal, immersion, interest, visual and auditory aspects) and the underlying cognitive mechanisms behind their behaviors, combining self-report techniques and real-time low-cost EEG signals. The paper also demonstrates the significant performance improvement by incorporating EEG signals into recommendation algorithm rating predictions, opening new avenues for short video recommendation system research.