Abstract:Top-K recommender systems aim to generate few but satisfactory personalized recommendations for various practical applications, such as item recommendation for e-commerce and link prediction for social networks. However, the numbers of users and items can be enormous, thereby leading to myriad potential recommendations as well as the bottleneck in evaluating and ranking all possibilities. Existing Maximum Inner Product Search (MIPS) based methods treat the item ranking problem for each user independently and the relationship between users has not been explored. In this paper, we propose a novel model for clustering and navigating for top-K recommenders (CANTOR) to expedite the computation of top-K recommendations based on latent factor models. A clustering-based framework is first presented to leverage user relationships to partition users into affinity groups, each of which contains users with similar preferences. CANTOR then derives a coreset of representative vectors for each affinity group by constructing a set cover with a theoretically guaranteed difference to user latent vectors. Using these representative vectors in the coreset, approximate nearest neighbor search is then applied to obtain a small set of candidate items for each affinity group to be used when computing recommendations for each user in the affinity group. This approach can significantly reduce the computation without compromising the quality of the recommendations. Extensive experiments are conducted on six publicly available large-scale real-world datasets for item recommendation and personalized link prediction. The experimental results demonstrate that CANTOR significantly speeds up matrix factorization models with high precision. For instance, CANTOR can achieve 355.1x speedup for inferring recommendations in a million-user network with 99.5% precision@1 to the original system while the state-of-the-art method can only obtain 93.7x speedup with 99.0% precision@1.

Clustering is Efficient for Approximate Maximum Inner Product Search

ProMIPS: Efficient High-Dimensional C-Approximate Maximum Inner Product Search with a Lightweight Index

Optimistic Query Routing in Clustering-based Approximate Maximum Inner Product Search

A Learning-to-Rank Formulation of Clustering-Based Approximate Nearest Neighbor Search

A Greedy Approach for Budgeted Maximum Inner Product Search

Efficient Retrieval with Learned Similarities

Diversity-Aware $k$-Maximum Inner Product Search Revisited

FARGO: Fast Maximum Inner Product Search Via Global Multi-Probing.

Query-Aware Quantization for Maximum Inner Product Search.

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

Clustering and Constructing User Coresets to Accelerate Large-scale Top-K Recommender Systems.

Exact and Approximate Maximum Inner Product Search with LEMP

Efficient Clustering with Limited Distance Information

Bi-Level Locality Sensitive Hashing Index Based on Clustering

Sk-Lsh : An Efficient Index Structure For Approximate Nearest Neighbor Search

Anisotropic Additive Quantization for Fast Inner Product Search

Accelerated Large Scale Optimization by Concomitant Hashing

Clustering Protein Sequences Given the Approximation Stability of the Min-Sum Objective Function

Scalable Kernel Clustering: Approximate Kernel k-means

mmLSH: A Practical and Efficient Technique for Processing Approximate Nearest Neighbor Queries on Multimedia Data

When Hashing Met Matching: Efficient Spatio-Temporal Search for Ridesharing