Abstract:Recommender systems (RS) are pivotal in managing information overload in modern digital services. A key challenge in RS is efficiently processing vast item pools to deliver highly personalized recommendations under strict latency constraints. Multi-stage cascade ranking addresses this by employing computationally efficient retrieval methods to cover diverse user interests, followed by more precise ranking models to refine the results. In the retrieval stage, multi-channel retrieval is often used to generate distinct item subsets from different candidate generators, leveraging the complementary strengths of these methods to maximize coverage. However, forwarding all retrieved items overwhelms downstream rankers, necessitating truncation. Despite advancements in individual retrieval methods, multi-channel fusion, the process of efficiently merging multi-channel retrieval results, remains underexplored. We are the first to identify and systematically investigate multi-channel fusion in the retrieval stage. Current industry practices often rely on heuristic approaches and manual designs, which often lead to suboptimal performance. Moreover, traditional gradient-based methods like SGD are unsuitable for this task due to the non-differentiable nature of the selection process. In this paper, we explore advanced channel fusion strategies by assigning systematically optimized weights to each channel. We utilize black-box optimization techniques, including the Cross Entropy Method and Bayesian Optimization for global weight optimization, alongside policy gradient-based approaches for personalized merging. Our methods enhance both personalization and flexibility, achieving significant performance improvements across multiple datasets and yielding substantial gains in real-world deployments, offering a scalable solution for optimizing multi-channel fusion in retrieval.

An Optimization Framework for Merging Multiple Result Lists

Multiple Level Visual Semantic Fusion Method for Image Re-Ranking.

Unleashing the Potential of Multi-Channel Fusion in Retrieval for Personalized Recommendations

Deep Neural Network Fusion via Graph Matching with Applications to Model Ensemble and Federated Learning.

A Multimodel Fusion Engine for Filtering Webpages.

A Fuzzy Integral Method to Merge Search Engine Results on Web

A General Image Fusion Framework Using Multi-Task Semi-Supervised Learning

Fusionmlp: A Mlp-Based Unified Image Fusion Framework

Deep Model Fusion: A Survey

A General Multi-Source Data Fusion Framework

Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System

Machine learning methods for results merging in patent retrieval

Fusion-in-T5: Unifying Document Ranking Signals for Improved Information Retrieval

Multimodal Fusion for Video Search Reranking

Improved Combination of Multiple Retrieval Systems Using a Dynamic Combinatorial Fusion Algorithm.

Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models

It's Morphing Time: Unleashing the Potential of Multiple LLMs via Multi-objective Optimization

Cool-Fusion: Fuse Large Language Models without Training

Weighted-Reward Preference Optimization for Implicit Model Fusion

FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts

CrowdFusion: A Crowdsourced Approach on Data Fusion Refinement