Abstract:Re-ranking draws increased attention on both academics and industries, which rearranges the ranking list by modeling the mutual influence among items to better meet users' demands. Many existing re-ranking methods directly take the initial ranking list as input, and generate the optimal permutation through a well-designed context-wise model, which brings the evaluation-before-reranking problem. Meanwhile, evaluating all candidate permutations brings unacceptable computational costs in practice. Thus, to better balance efficiency and effectiveness, online systems usually use a two-stage architecture which uses some heuristic methods such as beam-search to generate a suitable amount of candidate permutations firstly, which are then fed into the evaluation model to get the optimal permutation. However, existing methods in both stages can be improved through the following aspects. As for generation stage, heuristic methods only use point-wise prediction scores and lack an effective judgment. As for evaluation stage, most existing context-wise evaluation models only consider the item context and lack more fine-grained feature context modeling. This paper presents a novel end-to-end re-ranking framework named PIER to tackle the above challenges which still follows the two-stage architecture and contains two mainly modules named FPSM and OCPM. We apply SimHash in FPSM to select top-K candidates from the full permutation based on user's permutation-level interest in an efficient way. Then we design a novel omnidirectional attention mechanism in OCPM to capture the context information in the permutation. Finally, we jointly train these two modules end-to-end by introducing a comparative learning loss. Offline experiment results demonstrate that PIER outperforms baseline models on both public and industrial datasets, and we have successfully deployed PIER on Meituan food delivery platform.

Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders

Select & Re-Rank: Effectively and Efficiently Matching Multimodal Data with Dynamically Evolving Attention

Leveraging Passage Embeddings for Efficient Listwise Reranking with Large Language Models

SetRank: Learning a Permutation-Invariant Ranking Model for Information Retrieval

CROSS-JEM: Accurate and Efficient Cross-encoders for Short-text Ranking Tasks

Improving Conversational Passage Re-ranking with View Ensemble

A Thorough Comparison of Cross-Encoders and LLMs for Reranking SPLADE

Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information

Assessing the Benefits of Model Ensembles in Neural Re-Ranking for Passage Retrieval

Efficient Neural Ranking using Forward Indexes and Lightweight Encoders

A Systematic Investigation of Distilling Large Language Models into Cross-Encoders for Passage Re-ranking

Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP

Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems

Shallow Cross-Encoders for Low-Latency Retrieval

PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval.

PIER: Permutation-Level Interest-Based End-to-End Re-ranking Framework in E-commerce

Efficient Document Ranking with Learnable Late Interactions

Hybrid and Collaborative Passage Reranking.

Text–video retrieval re-ranking via multi-grained cross attention and frozen image encoders

Attention-aware Multi-encoder for Session-based Recommendation.

Investigating the Successes and Failures of BERT for Passage Re-Ranking