Abstract:Matrix factorization (MF) is a simple collaborative filtering technique that achieves superior recommendation accuracy by decomposing the user-item interaction matrix into user and item latent matrices. Because the model typically learns each interaction independently, it may overlook the underlying shared dependencies between users and items, resulting in less stable and interpretable recommendations. Based on these insights, we propose "Hierarchical Matrix Factorization" (HMF), which incorporates clustering concepts to capture the hierarchy, where leaf nodes and other nodes correspond to users/items and clusters, respectively. Central to our approach, called hierarchical embeddings, is the additional decomposition of the latent matrices (embeddings) into probabilistic connection matrices, which link the hierarchy, and a root cluster latent matrix. The embeddings are differentiable, allowing simultaneous learning of interactions and clustering using a single gradient descent method. Furthermore, the obtained cluster-specific interactions naturally summarize user-item interactions and provide interpretability. Experimental results on ratings and ranking predictions show that HMF outperforms existing MF methods, in particular achieving a 1.37 point improvement in RMSE for sparse interactions. Additionally, it was confirmed that the clustering integration of HMF has the potential for faster learning convergence and mitigation of overfitting compared to MF, and also provides interpretability through a cluster-centered case study.

Collaborative filtering based on nonnegative/binary matrix factorization

An Efficient Non-Negative Matrix-Factorization-Based Approach to Collaborative Filtering for Recommender Systems

Improving Recommendations With Collaborative Factors

A Model-Based Collaborative Filtering Method for Bounded Support Data

A NMF-based Collaborative Filtering Recommendation Algorithm

Multi-linear Interactive Matrix Factorization.

Mining Intrinsic Information by Matrix Factorization-Based Approaches for Collaborative Filtering in Recommender Systems

Information Filtering Via Collaborative User Clustering Modeling.

Modeling user and item biases with Gaussian distribution for collaborative filtering

Negative Binomial Matrix Factorization for Recommender Systems

Multi-Task Matrix Factorization For Collaborative Filtering

Collaborative Filtering: Weighted Nonnegative Matrix Factorization Incorporating User and Item Graphs.

Sparse Matrix Prediction Filling in Collaborative Filtering

Kernelized Matrix Factorization for Collaborative Filtering

A Privacy-Preserving Collaborative Filtering Algorithm Based on Non-negative Matrix Factorization

Hierarchical Matrix Factorization for Interpretable Collaborative Filtering

Collaborative Filtering Using Probabilistic Matrix Factorization and a Bayesian Nonparametric Model

Incremental Learning for Dynamic Collaborative Filtering.

Factor-Bounded Nonnegative Matrix Factorization

Bayesian Deep Collaborative Matrix Factorization.