Bounded Matrix Low Rank Approximation

Ramakrishnan Kannan,Mariya Ishteva,Barry Drake,Haesun Park

DOI: https://doi.org/10.1007/978-3-662-48331-2_4

2015-09-26

Abstract:Low rank approximation is the problem of finding two matrices P∈Rm×k$$\mathbf {P} \in \mathbb {R}^{m \times k}$$ and Q∈Rk×n$$\mathbf {Q} \in \mathbb {R}^ {k \times n}$$ for input matrix R∈Rm×n$$\mathbf {R} \in \mathbb {R}^{m \times n}$$, such that R≈PQ$$\mathbf {R} \approx \mathbf {PQ} $$. It is common in recommender systems rating matrix, where the input matrix R$$\mathbf {R}$$ is bounded in the closed interval [rmin,rmax]$$[r_{min},r_{max}]$$ such as [1, 5]. In this chapter, we propose a new improved scalable low rank approximation algorithm for such bounded matrices called bounded matrix low rank approximation (BMA) that bounds every element of the approximation PQ$$\mathbf {PQ}$$. We also present an alternate formulation to bound existing recommender systems algorithms called BALS and discuss its convergence. Our experiments on real-world datasets illustrate that the proposed method BMA outperforms the state-of-the-art algorithms for recommender system such as stochastic gradient descent, alternating least squares with regularization, SVD++ and bias-SVD on real-world datasets such as Jester, Movielens, Book crossing, Online dating, and Netflix.