Collaborative Filtering with A Synthetic Feedback Loop

Wenlin Wang,Hongteng Xu,Ruiyi Zhang,Wenqi Wang,Piyush Rai,Lawrence Carin
2019-01-01
Abstract:Traditional collaborative filtering (CF) based recommender systems tend toperform poorly when the user-item interactions/ratings are highly scarce. Toaddress this, we propose a learning framework that improves collaborativefiltering with a synthetic feedback loop (CF-SFL) to simulate the userfeedback. The proposed framework consists of a "recommender" and a "virtualuser". The "recommender" is formulated as a CF model, recommending itemsaccording to observed user preference. The "virtual user" estimates rewardsfrom the recommended items and generates a feedback in addition to theobserved user preference. The "recommender" connected with the "virtual user"constructs a closed loop, that recommends users with items and imitates theunobserved feedback of the users to the recommended items. The syntheticfeedback is used to augment the observed user preference and improverecommendation results. Theoretically, such model design can be interpreted asinverse reinforcement learning, which can be learned effectively via rollout(simulation). Experimental results show that the proposed framework is able toenrich the learning of user preference and boost the performance of existingcollaborative filtering methods on multiple datasets.
What problem does this paper attempt to address?