Abstract:Recently, contextual multiarmed bandits (CMAB)-based recommendation has shown promise for applications in dynamic domains such as news or short video recommendation, where items are changing over time. There are two key challenges in constructing a CMAB-based system. First, a user’s historical rating data are usually sparse, which restricts the precise representation of dynamic contextual information. Second, it is difficult to design a personalized recommendation policy because of the high diversity of users’ selection behaviors over time. Therefore, existing CMAB-based recommendation methods mainly focus on the improvement of recommendation accuracy. This leads to difficulty in capturing the dynamic personalized preferences of users. To overcome these limitations, we design a novel knowledge-enhanced contextual-bandit approach that combines the dynamic recommendation strategy of the bandit algorithm and the knowledge representation of the knowledge graph. We argue that a user’s selection history for items reflects his/her favorite attributes, which will be repeated in the future. Accordingly we propose the knowledge-enhanced CMAB model, which leverages the contextual information of both users and items obtained by knowledge graph-based embedding. We validate the performance of the proposed model using two public datasets. Experimental results show that our method outperforms state-of-the-art methods in terms of both recommendation accuracy and diversity. • We combine a knowledge graph and the bandit method for constructing personalized, dynamic recommendations. • We propose an intention-selection mechanism for item selection in recommender systems. • We propose the one choice multi change strategy for a contextual multiarmed bandit. • Knowledge graphs effectively address the lack of knowledge in recommender systems.

A Knowledge-Enhanced Contextual Bandit Approach for Personalized Recommendation in Dynamic Domains

A Contextual-Bandit Approach to Personalized News Article Recommendation

Two-Stage Neural Contextual Bandits for Personalised News Recommendation

Neural Contextual Bandits for Personalized Recommendation

Hierarchical Adaptive Contextual Bandits for Resource Constraint based Recommendation

Contextual Bandit Approach-based Recommendation System for Personalized Web-based Services

BiUCB: A Contextual Bandit Algorithm for Cold-Start and Diversified Recommendation

Con-CNAME: A Contextual Multi-armed Bandit Algorithm for Personalized Recommendations

Latent Contextual Bandits and their Application to Personalized Recommendations for New Users

Collaborative Filtering Bandits

BanditMF: Multi-Armed Bandit Based Matrix Factorization Recommender System

Knowledge Enhancement for Contrastive Multi-Behavior Recommendation

Context-Aware Bandits

Bandit Learning for Diversified Interactive Recommendation

Contextual Dependent Click Bandit Algorithm For Web Recommendation

Fairness-aware Bandit-based Recommendation

Conversational Contextual Bandit: Algorithm and Application

Exploration, Exploitation, and Engagement in Multi-Armed Bandits with Abandonment

Learning Contextual Bandits in a Non-stationary Environment

Achieving User-Side Fairness in Contextual Bandits

Personalized recommendation system based on knowledge embedding and historical behavior