Pacer and Runner: Cooperative Learning Framework between Single- and Cross-Domain Sequential Recommendation

Chung Park,Taesan Kim,Hyungjun Yoon,Junui Hong,Yelim Yu,Mincheol Cho,Minsung Choi,Jaegul Choo
2024-07-24
Abstract:Cross-Domain Sequential Recommendation (CDSR) improves recommendation performance by utilizing information from multiple domains, which contrasts with Single-Domain Sequential Recommendation (SDSR) that relies on a historical interaction within a specific domain. However, CDSR may underperform compared to the SDSR approach in certain domains due to negative transfer, which occurs when there is a lack of relation between domains or different levels of data sparsity. To address the issue of negative transfer, our proposed CDSR model estimates the degree of negative transfer of each domain and adaptively assigns it as a weight factor to the prediction loss, to control gradient flows through domains with significant negative transfer. To this end, our model compares the performance of a model trained on multiple domains (CDSR) with a model trained solely on the specific domain (SDSR) to evaluate the negative transfer of each domain using our asymmetric cooperative network. In addition, to facilitate the transfer of valuable cues between the SDSR and CDSR tasks, we developed an auxiliary loss that maximizes the mutual information between the representation pairs from both tasks on a per-domain basis. This cooperative learning between SDSR and CDSR tasks is similar to the collaborative dynamics between pacers and runners in a marathon. Our model outperformed numerous previous works in extensive experiments on two real-world industrial datasets across ten service domains. We also have deployed our model in the recommendation system of our personal assistant app service, resulting in 21.4% increase in click-through rate compared to existing models, which is valuable to real-world business.
Information Retrieval,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the negative transfer problem in cross - domain sequential recommendation (CDSR). Specifically, when using historical interaction data from multiple domains to predict a user's next action in a specific domain, if the relationships between these domains are weak or the data sparsity levels are different, it may lead to the recommendation performance in some domains being worse than that of a single - domain data - only recommendation system (SDSR). This phenomenon is called negative transfer, which limits the performance improvement of cross - domain recommendation systems. To address this challenge, the paper proposes a model named SyNCRec, which improves the performance of cross - domain recommendation through the following methods: 1. **Evaluating negative transfer**: SyNCRec estimates the degree of negative transfer in each domain and assigns it as a weight factor to the prediction loss, thereby controlling the gradient flow in domains with significant negative transfer. This helps to reduce the impact of negative transfer on recommendation performance. 2. **Asymmetric cooperation network**: By comparing the performance of multi - domain training models (CDSR tasks) with single - domain training models (SDSR tasks), the model can evaluate the degree of negative transfer in each domain. This process is carried out in an asymmetric cooperation network, which partially decouples the learning processes of the two tasks to avoid mutual interference. 3. **Auxiliary loss function**: To promote the transfer of valuable clues between SDSR and CDSR tasks, the model develops an auxiliary loss function that maximizes the mutual information between representation pairs from the two tasks. This helps to enhance positive information transfer. Through the above mechanisms, SyNCRec can significantly improve recommendation performance on multiple real - world datasets, especially in those domains that perform poorly due to negative transfer. In addition, this model has also been deployed in the service recommendation system of personal assistant applications, achieving a significant increase in click - through rates.