Abstract:Recommender system plays a crucial role in modern E-commerce platform. Due to the lack of historical interactions between users and items, cold-start recommendation is a challenging problem. In order to alleviate the cold-start issue, most existing methods introduce content and contextual information as the auxiliary information. Nevertheless, these methods assume the recommended items behave steadily over time, while in a typical E-commerce scenario, items generally have very different performances throughout their life period. In such a situation, it would be beneficial to consider the long-term return from the item perspective, which is usually ignored in conventional methods. Reinforcement learning (RL) naturally fits such a long-term optimization problem, in which the recommender could identify high potential items, proactively allocate more user impressions to boost their growth, therefore improve the multi-period cumulative gains. Inspired by this idea, we model the process as a Partially Observable and Controllable Markov Decision Process (POC-MDP), and propose an actor-critic RL framework (RL-LTV) to incorporate the item lifetime values (LTV) into the recommendation. In RL-LTV, the critic studies historical trajectories of items and predict the future LTV of fresh item, while the actor suggests a score-based policy which maximizes the future LTV expectation. Scores suggested by the actor are then combined with classical ranking scores in a dual-rank framework, therefore the recommendation is balanced with the LTV consideration. Our method outperforms the strong live baseline with a relative improvement of 8.67% and 18.03% on IPV and GMV of cold-start items, on one of the largest E-commerce platform.

RaPare: A Generic Strategy for Cold-Start Rating Prediction Problem

Ice-Breaking: Mitigating Cold-Start Recommendation Problem by Rating Comparison

RBPR: A hybrid model for the new user cold start problem in recommender systems

A Cross-Domain Recommendation Mechanism for Cold-Start Users Based on Partial Least Squares Regression

Learning to Learn a Cold-start Sequential Recommender

RACRec: Review Aware Cross-Domain Recommendation for Fully-Cold-Start User

All-in-One: Heterogeneous Interaction Modeling for Cold-Start Rating Prediction

Cold & Warm Net: Addressing Cold-Start Users in Recommender Systems

An autoencoder-based recommendation framework toward cold start problem

Addressing the Item Cold-Start Problem by Attribute-Driven Active Learning

Joint Prediction of Rating and Popularity for Cold-Start Item by Sentinel User Selection

A content-enhanced approach for cold-start problem in collaborative filtering

Promoting cold-start items in recommender systems

Conditional Restricted Boltzmann Machines for Cold Start Recommendations

A Feature-Based Regression Algorithm for Cold-Start Recommendation

Local Representative-Based Matrix Factorization for Cold-Start Recommendation

Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendation

Representative Item Selection for Cold Start Users

Task-Difficulty-Aware Meta-Learning with Adaptive Update Strategies for User Cold-Start Recommendation

Wisdom of the Better Few

Approaches and algorithms to mitigate cold start problems in recommender systems: a systematic literature review