Abstract:PurposeThe purpose of this paper is to alleviate the problem of poor robustness and over-fitting caused by large-scale data in collaborative filtering recommendation algorithms.Design/methodology/approachInterpreting user behavior from the probabilistic perspective of hidden variables is helpful to improve robustness and over-fitting problems. Constructing a recommendation network by variational inference can effectively solve the complex distribution calculation in the probabilistic recommendation model. Based on the aforementioned analysis, this paper uses variational auto-encoder to construct a generating network, which can restore user-rating data to solve the problem of poor robustness and over-fitting caused by large-scale data. Meanwhile, for the existing KL-vanishing problem in the variational inference deep learning model, this paper optimizes the model by the KL annealing and Free Bits methods.FindingsThe effect of the basic model is considerably improved after using the KL annealing or Free Bits method to solve KL vanishing. The proposed models evidently perform worse than competitors on small data sets, such as MovieLens 1 M. By contrast, they have better effects on large data sets such as MovieLens 10 M and MovieLens 20 M.Originality/valueThis paper presents the usage of the variational inference model for collaborative filtering recommendation and introduces the KL annealing and Free Bits methods to improve the basic model effect. Because the variational inference training denotes the probability distribution of the hidden vector, the problem of poor robustness and overfitting is alleviated. When the amount of data is relatively large in the actual application scenario, the probability distribution of the fitted actual data can better represent the user and the item. Therefore, using variational inference for collaborative filtering recommendation is of practical value.

Probabilistic Topic Model for Hybrid Recommender Systems: A Stochastic Variational Bayesian Approach

Hybrid Gaussian pLSA model and item based collaborative filtering recommendation

A Bayesian Recommender Model for User Rating and Review Profiling

Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments

Applying Probabilistic Latent Semantic Analysis to Multi-Criteria Recommender System

Collaborative Topic Regression for Online Recommender Systems: an Online and Bayesian Approach

A Probabilistic Recommendation Method Inspired by Latent Dirichlet Allocation Model

A Stochastic Model for Collaborative Recommendation

A Probabilistic Inference Model for Recommender Systems.

Modeling Product's Visual and Functional Characteristics for Recommender Systems

Modeling Product’s Visual and Functional Characteristics for Recommender Systems

A hybrid approach of topic model and matrix factorization based on two-step recommendation framework

Bayesian Inference Via Variational Approximation for Collaborative Filtering.

Collaborative Filtering Recommendation Algorithm Based on Variational Inference

Improving Collaborative Filtering based Recommenders using Topic Modelling

Estimating probabilities in recommendation systems

Context-Aware Collaborative Topic Regression with Social Matrix Factorization for Recommender Systems

Topic-Level Bayesian Surprise and Serendipity for Recommender Systems

Collaborative Topic Regression with Social Matrix Factorization for Recommendation Systems

Topic aspects-based generative mixture model for movie recommendation system using deep convolutional network

Recommendation Model Based on Probabilistic Matrix Factorization and Rated Item Relevance