A Unified Framework for Adaptive Representation Enhancement and Inversed Learning in Cross-Domain Recommendation

Luankang Zhang,Hao Wang,Suojuan Zhang,Mingjia Yin,Yongqiang Han,Jiaqing Zhang,Defu Lian,Enhong Chen
2024-03-30
Abstract:Cross-domain recommendation (CDR), aiming to extract and transfer knowledge across domains, has attracted wide attention for its efficacy in addressing data sparsity and cold-start problems. Despite significant advances in representation disentanglement to capture diverse user preferences, existing methods usually neglect representation enhancement and lack rigorous decoupling constraints, thereby limiting the transfer of relevant information. To this end, we propose a Unified Framework for Adaptive Representation Enhancement and Inversed Learning in Cross-Domain Recommendation (AREIL). Specifically, we first divide user embeddings into domain-shared and domain-specific components to disentangle mixed user preferences. Then, we incorporate intra-domain and inter-domain information to adaptively enhance the ability of user representations. In particular, we propose a graph convolution module to capture high-order information, and a self-attention module to reveal inter-domain correlations and accomplish adaptive fusion. Next, we adopt domain classifiers and gradient reversal layers to achieve inversed representation learning in a unified framework. Finally, we employ a cross-entropy loss for measuring recommendation performance and jointly optimize the entire framework via multi-task learning. Extensive experiments on multiple datasets validate the substantial improvement in the recommendation performance of AREIL. Moreover, ablation studies and representation visualizations further illustrate the effectiveness of adaptive enhancement and inversed learning in CDR.
Information Retrieval
What problem does this paper attempt to address?
The problems that this paper attempts to solve are data sparsity and cold - start problems in cross - domain recommendation systems. Specifically, the paper focuses on how to improve the performance of recommendation systems by extracting and transferring knowledge from different domains. Although significant progress has been made in representation disentanglement techniques to capture diverse user preferences, existing methods usually overlook representation enhancement and lack strict decoupling constraints, which limit the effective transfer of relevant information. Therefore, the paper proposes a unified framework - Adaptive Representation Enhancement and Inverse Learning for Cross - Domain Recommendation (AREIL), aiming to solve the following two key problems: 1. **Adaptive Representation Enhancement**: Existing work usually assumes that the shared representations of the same user in different domains are exactly the same, resulting in the inability to capture the differences in embedding quality caused by unbalanced data distribution and inconsistent shared user preferences among different domains. Exploring the representational correlation between domains and adaptively transferring important and generalized knowledge is a nontrivial challenge. 2. **Inverse Representation Learning**: Although some studies use self - supervised methods such as Variational Auto - Encoder (VAE) and contrastive learning to achieve mutual exclusion of disentangled representations, they cannot ensure that domain - shared and domain - specific factors are assigned to the corresponding representations. Ideally, these factors should exhibit a complementary relationship and encode complementary information. Implementing such inverse constraints within a unified framework to learn disentangled user representations remains a key challenge. To address the above challenges, the paper proposes the AREIL framework. The specific steps include: - Initializing item and user representations and decomposing user representations into domain - shared and domain - specific components to disentangle mixed user preferences. - Enhancing user representations through the Adaptive Representation Enhancement Module (AREM), especially using the graph convolution module to capture high - order information, and the self - attention module to reveal inter - domain correlations and complete adaptive fusion. - Introducing a domain classifier and a Gradient Reversal Layer (GRL) to achieve inverse representation learning within a unified framework. The GRL reverses the gradient direction to achieve the inverse constraint objective, and the domain classifier distinguishes the input sources and generates comprehensive supervision signals to constrain the disentangling process. - Finally, optimizing the entire framework using the multi - task learning paradigm in an end - to - end manner. Through extensive experimental verification, the recommendation performance of AREIL on multiple datasets has been significantly improved. Further ablation studies and representation visualizations also prove the effectiveness of adaptive enhancement and inverse learning in cross - domain recommendation.