Abstract:Many recent recommendation systems leverage the large quantity of reviews placed by users on items. However, it is both challenging and important to accurately measure the usefulness of such reviews for effective recommendation. In particular, users have been shown to exhibit distinct preferences over different types of reviews (e.g., preferring longer versus shorter or recent versus old reviews), indicating that users might differ in their viewpoints on what makes the reviews useful. Yet, there have been limited studies that account for the personalised usefulness of reviews when estimating the users’ preferences. In this article, we propose a novel neural model, called BanditProp, which addresses this gap in the literature. It first models reviews according to both their content and associated properties (e.g., length, sentiment and recency). Thereafter, it constructs a multi-task learning (MTL) framework to model the reviews’ content encoded with various properties.In such an MTL framework, each task corresponds to producing recommendations focusing on an individual property. Next, we address the selection of the features from reviews with different review properties as a bandit problem using multinomial rewards. We propose a neural contextual bandit algorithm (i.e., ConvBandit) and examine its effectiveness in comparison to eight existing bandit algorithms in addressing the bandit problem. Our extensive experiments on two well-known Amazon and Yelp datasets show that BanditProp can significantly outperform one classic and six existing state-of-the-art recommendation baselines. Moreover, BanditProp using ConvBandit consistently outperforms the use of other bandit algorithms over the two used datasets. In particular, we experimentally demonstrate the effectiveness of our proposed customised multinomial rewards in comparison to binary rewards, when addressing our bandit problem.

Convolutional Neural Bandit for Visual-aware Recommendation

Conversational Contextual Bandit: Algorithm and Application

Neural Contextual Bandits for Personalized Recommendation

Neural Combinatorial Clustered Bandits for Recommendation Systems

Robust and Efficient Algorithms for Conversational Contextual Bandit

Contextual Dependent Click Bandit Algorithm For Web Recommendation

Learning Contextual Bandits in a Non-stationary Environment

Con-CNAME: A Contextual Multi-armed Bandit Algorithm for Personalized Recommendations

BanditProp: Bandit Selection of Review Properties for Effective Recommendation

A Contextual-Bandit Approach to Personalized News Article Recommendation

Counterfactual contextual bandit for recommendation under delayed feedback

Convolutional Attention Model for Restaurant Recommendation with Multi-View Visual Features.

Interactive Recommendation Via Deep Neural Memory Augmented Contextual Bandits

Contextual Combinatorial Cascading Bandits.

Meta Clustering of Neural Bandits

Hierarchical Adaptive Contextual Bandits for Resource Constraint based Recommendation

Neural Exploitation and Exploration of Contextual Bandits

Two-Stage Neural Contextual Bandits for Personalised News Recommendation

Contextual Bandit Approach-based Recommendation System for Personalized Web-based Services

Transferable Contextual Bandits with Prior Observations

Uncertainty of Joint Neural Contextual Bandit