Abstract:A large-scale recommender system usually consists of recall and ranking modules. The goal of ranking modules (aka rankers) is to elaborately discriminate users' preference on item candidates proposed by recall modules. With the success of deep learning techniques in various domains, we have witnessed the mainstream rankers evolve from traditional models to deep neural models. However, the way that we design and use rankers remains unchanged: offline training the model, freezing the parameters, and deploying it for online serving. Actually, the candidate items are determined by specific user requests, in which underlying distributions (e.g., the proportion of items for different categories, the proportion of popular or new items) are highly different from one another in a production environment. The classical parameter-frozen inference manner cannot adapt to dynamic serving circumstances, making rankers' performance compromised. In this paper, we propose a new training and inference paradigm, termed as Ada-Ranker, to address the challenges of dynamic online serving. Instead of using parameter-frozen models for universal serving, Ada-Ranker can adaptively modulate parameters of a ranker according to the data distribution of the current group of item candidates. We first extract distribution patterns from the item candidates. Then, we modulate the ranker by the patterns to make the ranker adapt to the current data distribution. Finally, we use the revised ranker to score the candidate list. In this way, we empower the ranker with the capacity of adapting from a global model to a local model which better handles the current task. As a first study, we examine our Ada-Ranker paradigm in the sequential recommendation scenario. Experiments on three datasets demonstrate that Ada-Ranker can effectively enhance various base sequential models and also outperform a comprehensive set of competitive baselines.

A Joint Dynamic Ranking System with DNN and Vector-based Clustering Bandit

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Optimizing Gross Merchandise Volume via DNN-MAB Dynamic Ranking Paradigm

An End-to-end Model of Predicting Diverse Ranking on Heterogeneous Feeds.

Ada-Ranker: A Data Distribution Adaptive Ranking Paradigm for Sequential Recommendation

Meta Clustering of Neural Bandits

Deep Page-Level Interest Network in Reinforcement Learning for Ads Allocation

Ada-Ranker

A Hybrid Bandit Model with Visual Priors for Creative Ranking in Display Advertising.

Jointly Learning to Recommend and Advertise

Rankmbpr: Rank-Aware Mutual Bayesian Personalized Ranking For Item Recommendationl

Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising

Cross DQN: Cross Deep Q Network for Ads Allocation in Feed

Towards the Better Ranking Consistency: A Multi-task Learning Framework for Early Stage Ads Ranking

Autor3: Au tomated R eal-time R anking with R einforcement Learning in E-commerce Sponsored Search Advertising

Know in AdVance: Linear-Complexity Forecasting of Ad Campaign Performance with Evolving User Interest

Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatments

Learning to Rank Audience for Behavioral Targeting in Display Ads

Adaptive Domain Interest Network for Multi-domain Recommendation

Approximate Nearest Neighbor Search under Neural Similarity Metric for Large-Scale Recommendation

RLMixer: A Reinforcement Learning Approach for Integrated Ranking with Contrastive User Preference Modeling.