Abstract:PurposeThe purpose of this paper is to alleviate the problem of poor robustness and over-fitting caused by large-scale data in collaborative filtering recommendation algorithms.Design/methodology/approachInterpreting user behavior from the probabilistic perspective of hidden variables is helpful to improve robustness and over-fitting problems. Constructing a recommendation network by variational inference can effectively solve the complex distribution calculation in the probabilistic recommendation model. Based on the aforementioned analysis, this paper uses variational auto-encoder to construct a generating network, which can restore user-rating data to solve the problem of poor robustness and over-fitting caused by large-scale data. Meanwhile, for the existing KL-vanishing problem in the variational inference deep learning model, this paper optimizes the model by the KL annealing and Free Bits methods.FindingsThe effect of the basic model is considerably improved after using the KL annealing or Free Bits method to solve KL vanishing. The proposed models evidently perform worse than competitors on small data sets, such as MovieLens 1 M. By contrast, they have better effects on large data sets such as MovieLens 10 M and MovieLens 20 M.Originality/valueThis paper presents the usage of the variational inference model for collaborative filtering recommendation and introduces the KL annealing and Free Bits methods to improve the basic model effect. Because the variational inference training denotes the probability distribution of the hidden vector, the problem of poor robustness and overfitting is alleviated. When the amount of data is relatively large in the actual application scenario, the probability distribution of the fitted actual data can better represent the user and the item. Therefore, using variational inference for collaborative filtering recommendation is of practical value.

Variational Bayesian inference for bipartite mixed-membership stochastic block model with applications to collaborative filtering

Mixed Membership Stochastic Blockmodels

Particle Mixed Membership Stochastic Block Model

Empirical Bayes estimation for the stochastic blockmodel

Variational Bayesian Inference and Complexity Control for Stochastic Block Models

Variational Estimators of the Degree-corrected Latent Block Model for Bipartite Networks

Mixed Membership Stochastic Blockmodels for Heterogeneous Networks

Dynamic Infinite Mixed-Membership Stochastic Blockmodel

Collaborative Filtering Recommendation Algorithm Based on Variational Inference

Probabilistic Topic Model for Hybrid Recommender Systems: A Stochastic Variational Bayesian Approach

Online Inference of Mixed Membership Stochastic Blockmodels for Network Data Streams

Incorporating Community Detection and Clustering Techniques into Collaborative Filtering Model

Modeling user and item biases with Gaussian distribution for collaborative filtering

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Distributed Robust Bayesian Filtering for State Estimation.

Mixed-membership of experts stochastic blockmodel

Bipartite mixed membership distribution-free model. A novel model for community detection in overlapping bipartite weighted networks

Mixture of multilayer stochastic block models for multiview clustering

Augmented Degree Correction for Bipartite Networks with Applications to Recommender Systems

Distributed Bayesian Inference Over Sensor Networks