Abstract:Learning from implicit feedback is one of the most common cases in the application of recommender systems. Generally speaking, interacted examples are considered as positive while negative examples are sampled from uninteracted ones. However, noisy examples are prevalent in real-world implicit feedback. A noisy positive example could be interacted but it actually leads to negative user preference. A noisy negative example which is uninteracted because of unawareness of the user could also denote potential positive user preference. Conventional training methods overlook these noisy examples, leading to sub-optimal recommendation. In this work, we propose probabilistic and variational recommendation denoising for implicit feedback. Through an empirical study, we find that different models make relatively similar predictions on clean examples which denote the real user preference, while the predictions on noisy examples vary much more across different models. Motivated by this observation, we propose denoising with probabilistic inference (DPI) which aims to minimize the KL-divergence between the real user preference distributions parameterized by two recommendation models while maximize the likelihood of data observation. We then show that DPI recovers the evidence lower bound of an variational auto-encoder when the real user preference is considered as the latent variables. This leads to our second learning framework denoising with variational auto-encoder (DVAE). We employ the ∗Equal contribution, Xin Xin is the corresponding author. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACMmust be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. Conference’17, July 2017, Washington, DC, USA © 2018 Association for Computing Machinery. ACM ISBN 978-x-xxxx-xxxx-x/YY/MM. . . $15.00 https://doi.org/10.1145/nnnnnnn.nnnnnnn proposed DPI and DVAE on four state-of-the-art recommendation models and conduct experiments on three datasets. Experimental results demonstrate that DPI and DVAE significantly improve recommendation performance compared with normal training and other denoising methods. Codes will be open-sourced. CCS Concepts: • Mathematics of computing→ Probability and statistics; • Information systems→ Recommender systems.

VAE*: A Novel Variational Autoencoder via Revisiting Positive and Negative Samples for Top-N Recommendation

A Survey on Variational Autoencoders in Recommender Systems

A Collective Variational Autoencoder for Top-$N$ Recommendation with Side Information

Linear Variational Autoencoder for Top-N Recommendation

Self-supervised variational autoencoder towards recommendation by nested contrastive learning

VAEGAN: A Collaborative Filtering Framework based on Adversarial Variational Autoencoders

A Novel Top-N Recommendation Approach Based on Conditional Variational Auto-Encoder

Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation

Feature-Aware Attentive Variational Auto-Encoder for Top-N Recommendation.

ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendation

Improving Top-N Recommendation Performance Using Missing Data

Personalized Negative Reservoir for Incremental Learning in Recommender Systems

Reinforced Negative Sampling for Recommendation with Exposure Data

Neural Variational Collaborative Filtering for Top-K Recommendation.

Probabilistic and Variational Recommendation Denoising

Neural Variational Collaborative Filtering with Side Information for Top-K Recommendation

A Gain-Tuning Dynamic Negative Sampler for Recommendation

Semi-deterministic and Contrastive Variational Graph Autoencoder for Recommendation

Website Recommendation with Side Information Aided Variational Autoencoder

Addressing Class-Imbalance Problem in Personalized Ranking

Towards Amortized Ranking-Critical Training for Collaborative Filtering