Abstract:Recommender systems (RS) are pivotal in managing information overload in modern digital services. A key challenge in RS is efficiently processing vast item pools to deliver highly personalized recommendations under strict latency constraints. Multi-stage cascade ranking addresses this by employing computationally efficient retrieval methods to cover diverse user interests, followed by more precise ranking models to refine the results. In the retrieval stage, multi-channel retrieval is often used to generate distinct item subsets from different candidate generators, leveraging the complementary strengths of these methods to maximize coverage. However, forwarding all retrieved items overwhelms downstream rankers, necessitating truncation. Despite advancements in individual retrieval methods, multi-channel fusion, the process of efficiently merging multi-channel retrieval results, remains underexplored. We are the first to identify and systematically investigate multi-channel fusion in the retrieval stage. Current industry practices often rely on heuristic approaches and manual designs, which often lead to suboptimal performance. Moreover, traditional gradient-based methods like SGD are unsuitable for this task due to the non-differentiable nature of the selection process. In this paper, we explore advanced channel fusion strategies by assigning systematically optimized weights to each channel. We utilize black-box optimization techniques, including the Cross Entropy Method and Bayesian Optimization for global weight optimization, alongside policy gradient-based approaches for personalized merging. Our methods enhance both personalization and flexibility, achieving significant performance improvements across multiple datasets and yielding substantial gains in real-world deployments, offering a scalable solution for optimizing multi-channel fusion in retrieval.

Improved Combination of Multiple Retrieval Systems Using a Dynamic Combinatorial Fusion Algorithm.

Combination of Multiple Retrieval Systems Using Rank-Score Function and Cognitive Diversity

Combining Multiple Retrieval Systems Using Combinatorial Fusion Analysis and Rank-Score Characteristic Function

Comparing System Selection Methods for the Combinatorial Fusion of Multiple Retrieval Systems

A Comparative Study on the Combination of Multiple Retrieval Systems

Combining similarity measures in content-based image retrieval guided by mutual information

Fusion of effective retrieval strategies in the same information retrieval system

Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach

Unleashing the Potential of Multi-Channel Fusion in Retrieval for Personalized Recommendations

Concept-Driven Multi-Modality Fusion for Video Search

A Term Co-Occurrence Algorithm and the Effect of Co-Occurrence Terms on Result Ranking for Information Retrieval

Improved System Fusion for Keyword Search

An Optimization Framework for Merging Multiple Result Lists

MFA-DMFS:new Multi-Classifier Fusion Method and Its Application

Dynamic Multimodal Fusion in Video Search

Task-Driven Dynamic Fusion: Reducing Ambiguity in Video Description

COS-Mix: Cosine Similarity and Distance Fusion for Improved Information Retrieval

Fusing Code Searchers

A multi-source heterogeneous spatial big data fusion method based on multiple similarity and voting decision

Combining Multiple Sensor Features for Stress Detection Using Combinatorial Fusion

Classifier Fusion with Contextual Reliability Evaluation