Abstract:Many recent recommendation systems leverage the large quantity of reviews placed by users on items. However, it is both challenging and important to accurately measure the usefulness of such reviews for effective recommendation. In particular, users have been shown to exhibit distinct preferences over different types of reviews (e.g., preferring longer versus shorter or recent versus old reviews), indicating that users might differ in their viewpoints on what makes the reviews useful. Yet, there have been limited studies that account for the personalised usefulness of reviews when estimating the users’ preferences. In this article, we propose a novel neural model, called BanditProp, which addresses this gap in the literature. It first models reviews according to both their content and associated properties (e.g., length, sentiment and recency). Thereafter, it constructs a multi-task learning (MTL) framework to model the reviews’ content encoded with various properties.In such an MTL framework, each task corresponds to producing recommendations focusing on an individual property. Next, we address the selection of the features from reviews with different review properties as a bandit problem using multinomial rewards. We propose a neural contextual bandit algorithm (i.e., ConvBandit) and examine its effectiveness in comparison to eight existing bandit algorithms in addressing the bandit problem. Our extensive experiments on two well-known Amazon and Yelp datasets show that BanditProp can significantly outperform one classic and six existing state-of-the-art recommendation baselines. Moreover, BanditProp using ConvBandit consistently outperforms the use of other bandit algorithms over the two used datasets. In particular, we experimentally demonstrate the effectiveness of our proposed customised multinomial rewards in comparison to binary rewards, when addressing our bandit problem.

Neural Contextual Bandits for Personalized Recommendation

Interactive Recommendation Via Deep Neural Memory Augmented Contextual Bandits

Two-Stage Neural Contextual Bandits for Personalised News Recommendation

A Contextual-Bandit Approach to Personalized News Article Recommendation

Latent Contextual Bandits and their Application to Personalized Recommendations for New Users

Selectively Contextual Bandits

A Knowledge-Enhanced Contextual Bandit Approach for Personalized Recommendation in Dynamic Domains

Learning Contextual Bandits in a Non-stationary Environment

Contextual Bandit Approach-based Recommendation System for Personalized Web-based Services

Simulated Contextual Bandits for Personalization Tasks from Recommendation Datasets

HyperBandit: Contextual Bandit with Hypernewtork for Time-Varying User Preferences in Streaming Recommendation

Meta Clustering of Neural Bandits

Convolutional Neural Bandit for Visual-aware Recommendation

Uncertainty of Joint Neural Contextual Bandit

Diversity in News Recommendations Using Contextual Bandits

Neural Combinatorial Clustered Bandits for Recommendation Systems

Con-CNAME: A Contextual Multi-armed Bandit Algorithm for Personalized Recommendations

Conversational Contextual Bandit: Algorithm and Application

Contextual Bandit with Herding Effects: Algorithms and Recommendation Applications

Towards Domain Adaptive Neural Contextual Bandits

BanditProp: Bandit Selection of Review Properties for Effective Recommendation