Abstract:In a multi-stage recommendation system, reranking plays a crucial role by modeling the intra-list correlations among items.The key challenge of reranking lies in the exploration of optimal sequences within the combinatorial space of permutations. Recent research proposes a generator-evaluator learning paradigm, where the generator generates multiple feasible sequences and the evaluator picks out the best sequence based on the estimated listwise score. Generator is of vital importance, and generative models are well-suited for the generator function. Current generative models employ an autoregressive strategy for sequence generation. However, deploying autoregressive models in real-time industrial systems is challenging. Hence, we propose a Non-AutoRegressive generative model for reranking Recommendation (NAR4Rec) designed to enhance efficiency and effectiveness. To address challenges related to sparse training samples and dynamic candidates impacting model convergence, we introduce a matching model. Considering the diverse nature of user feedback, we propose a sequence-level unlikelihood training objective to distinguish feasible from unfeasible sequences. Additionally, to overcome the lack of dependency modeling in non-autoregressive models regarding target items, we introduce contrastive decoding to capture correlations among these items. Extensive offline experiments on publicly available datasets validate the superior performance of our proposed approach compared to the existing state-of-the-art reranking methods. Furthermore, our method has been fully deployed in a popular video app Kuaishou with over 300 million daily active users, significantly enhancing online recommendation quality, and demonstrating the effectiveness and efficiency of our approach.

Deep Equilibrium Non-Autoregressive Sequence Learning

Deep Equilibrium Algorithmic Reasoning

Efficient Training of Deep Equilibrium Models

A Study of Non-autoregressive Model for Sequence Generation

Improving Adversarial Robustness of Deep Equilibrium Models with Explicit Regulations along the Neural Dynamics

Non-autoregressive Generative Models for Reranking Recommendation

Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics

Who Needs Decoders? Efficient Estimation of Sequence-level Attributes

On generalized residue network for deep learning of unknown dynamical systems

Fast Structured Decoding for Sequence Models

Dance revolution: long-term dance genera-

The Deep Equilibrium Algorithmic Reasoner

Alleviate Exposure Bias in Sequence Prediction \\ with Recurrent Neural Networks

On the Equivalence Between Deep NADE and Generative Stochastic Networks

Deep Reinforcement Learning For Sequence to Sequence Models

Alleviate Exposure Bias in Sequence Prediction \\ with Recurrent Neural Networks

A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models

Positive concave deep equilibrium models

Sequence to Sequence Learning with Neural Networks