Rethinking Recommender Systems: Cluster-based Algorithm Selection

Andreas Lizenberger,Ferdinand Pfeifer,Bastian Polewka
2024-05-28
Abstract:Cluster-based algorithm selection deals with selecting recommendation algorithms on clusters of users to obtain performance gains. No studies have been attempted for many combinations of clustering approaches and recommendation algorithms. We want to show that clustering users prior to algorithm selection increases the performance of recommendation algorithms. Our study covers eight datasets, four clustering approaches, and eight recommendation algorithms. We select the best performing recommendation algorithm for each cluster. Our work shows that cluster-based algorithm selection is an effective technique for optimizing recommendation algorithm performance. For five out of eight datasets, we report an increase in nDCG@10 between 19.28% (0.032) and 360.38% (0.191) compared to algorithm selection without prior clustering.
Information Retrieval
What problem does this paper attempt to address?
This paper discusses the method of selecting clustering-based recommendation algorithms, aiming to optimize the performance of recommendation systems through user clustering. In the study, the authors pointed out that previous research mainly focused on the combination of a single clustering method and recommendation algorithm, while they wanted to demonstrate that algorithm selection before user clustering can improve the performance of recommendation algorithms. The paper covers 8 datasets, 4 clustering methods, and 8 recommendation algorithms, and selects the best recommendation algorithm for each cluster. Experimental results show that compared with algorithm selection without clustering, this method improves the nDCG@10 indicator on 5 datasets, with improvement ranging from 19.28% to 360.38%. The main contribution of the research is the proposal of a clustering-based recommendation algorithm selection strategy, which significantly improves the average performance of recommendation systems. The authors call this method intermediate layer algorithm selection because it operates on user groups. They use different clustering techniques, including k-Means (based on interaction count and item interaction vector) and graph-based clustering methods (Louvain and greedy modularity), and conduct experiments with the automated recommendation system tool LensKit-Auto. The paper also compares the combination effect of different clustering methods and recommendation algorithms, as well as related work with other techniques such as meta-learning, automated recommendation systems, and ensemble recommendation systems. In the end, the authors found that clustering-based recommendation algorithm selection can effectively improve recommendation performance and plan to further develop it as a long-term goal.