Distributed Design and Implementation of SVD plus plus Algorithm for E-commerce Personalized Recommender System

Jian Cao,Hengkui Hu,Tianyan Luo,Jia Wang,May Huang,Karl Wang,Zhonghai Wu,Xing Zhang
DOI: https://doi.org/10.1007/978-981-10-0421-6_4
2015-01-01
Abstract:Recommender systems can facilitate people to get effective information from the massive data, and it is the hot research currently in data mining. SVD++ is a kind of effective single model recommendation algorithm, which is based on the matrix decomposition combined with the neighborhood model. On the Spark, using the Stochastic Gradient Descent, this paper realized the distributed SVD++ algorithm through the Scala, deployed and applied the algorithm into an actual recommendation product for testing. The testing results represent that the distributed SVD++ algorithm succeeded in solving problems of terabytes of data processing in the e-commerce recommendation and the sparse data of user-item matrix, enhancing the quality in personalized commodity recommendation.
What problem does this paper attempt to address?