Abstract:PurposeThe purpose of this paper is to alleviate the problem of poor robustness and over-fitting caused by large-scale data in collaborative filtering recommendation algorithms.Design/methodology/approachInterpreting user behavior from the probabilistic perspective of hidden variables is helpful to improve robustness and over-fitting problems. Constructing a recommendation network by variational inference can effectively solve the complex distribution calculation in the probabilistic recommendation model. Based on the aforementioned analysis, this paper uses variational auto-encoder to construct a generating network, which can restore user-rating data to solve the problem of poor robustness and over-fitting caused by large-scale data. Meanwhile, for the existing KL-vanishing problem in the variational inference deep learning model, this paper optimizes the model by the KL annealing and Free Bits methods.FindingsThe effect of the basic model is considerably improved after using the KL annealing or Free Bits method to solve KL vanishing. The proposed models evidently perform worse than competitors on small data sets, such as MovieLens 1 M. By contrast, they have better effects on large data sets such as MovieLens 10 M and MovieLens 20 M.Originality/valueThis paper presents the usage of the variational inference model for collaborative filtering recommendation and introduces the KL annealing and Free Bits methods to improve the basic model effect. Because the variational inference training denotes the probability distribution of the hidden vector, the problem of poor robustness and overfitting is alleviated. When the amount of data is relatively large in the actual application scenario, the probability distribution of the fitted actual data can better represent the user and the item. Therefore, using variational inference for collaborative filtering recommendation is of practical value.

Inducible Regularization for Low-Rank Matrix Factorizations for Collaborative Filtering

Estimate-Piloted Regularization and Fast ALS Algorithm for Collaborative Filtering

Improving One-Class Collaborative Filtering Via Ranking-Based Implicit Regularizer.

Theoretically Accurate Regularization Technique for Matrix Factorization based Recommender Systems

Regularization Methods for Low-Rank Factorization of Matrices with Missing Data

Social network recommendation based on low-rank matrix decomposition

A two-step Recommendation Algorithm via Iterative Local Least Squares

Low-Rank Matrix Approximation with Manifold Regularization.

Information Filtering Via Collaborative User Clustering Modeling.

Understanding and Scaling Collaborative Filtering Optimization from the Perspective of Matrix Rank

Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation Models

Incremental Regularized Least Squares for Dimensionality Reduction of Large-Scale Data.

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

Provable Inductive Matrix Completion

Alternating Iteratively Reweighted Minimization Algorithms for Low-Rank Matrix Factorization

Dual-regularized One-Class Collaborative Filtering with Implicit Feedback

Fast Low-Rank Matrix Learning with Nonconvex Regularization

Low-Rank Matrix Factorizations with Volume-based Constraints and Regularizations

Improving Implicit Alternating Least Squares with Ring-based Regularization

Regularized Matrix Regression

Collaborative Filtering Recommendation Algorithm Based on Variational Inference