Design and Implementation of the Cross-Harmonic Recommender System Based on Spark

Huang Jie,Liu ChangSheng,Liu ChengLi
DOI: https://doi.org/10.1007/978-3-030-36405-2_47
2019-01-01
Abstract:With the rapid development of information technology, information overload has become an important challenge of Internet. In order to alleviate the growing contradiction between users and massive data, the researchers proposed the concept of the cross-harmonic recommender system. By analyzing characteristic of datasets, recommendation algorithms and method for weight calculation, we introduced a fast and general engine for large-scale data processing and implemented the cross-harmonic recommender system based on Spark, aiming at improving accuracy, diversity and efficiency of the recommender system.
What problem does this paper attempt to address?