Abstract:Modelling the user's multiple behaviors is an essential part of modern e-commerce, whose widely adopted application is to jointly optimize click-through rate (CTR) and conversion rate (CVR) predictions. Most of existing methods overlook the effect of two key characteristics of the user's behaviors: for each item list, (i) contextual dependence refers to that the user's behaviors on any item are not purely determinated by the item itself but also are influenced by the user's previous behaviors (e.g., clicks, purchases) on other items in the same sequence; (ii) multiple time scales means that users are likely to click frequently but purchase periodically. To this end, we develop a new multi-scale user behavior network named H ierarchical r E current R anking O n the E ntire S pace (HEROES) which incorporates the contextual information to estimate the user multiple behaviors in a multi-scale fashion. Concretely, we introduce a hierarchical framework, where the lower layer models the user's engagement behaviors while the upper layer estimates the user's satisfaction behaviors. The proposed architecture can automatically learn a suitable time scale for each layer to capture the dynamic user's behavioral patterns. Besides the architecture, we also introduce the Hawkes process to form a novel recurrent unit which can not only encode the items' features in the context but also formulate the excitation or discouragement from the user's previous behaviors. We further show that HEROES can be extended to build unbiased ranking systems through combinations with the survival analysis technique. Extensive experiments over three large-scale industrial datasets demonstrate the superiority of our model compared with the state-of-the-art methods. characteristics of the user's behaviors: for each item list, (i) contex- tual dependence refers to that the user's behaviors on any item are not purely determinated by the item itself but also are influenced by the user's previous behaviors (e.g., clicks, purchases) on other items in the same sequence; (ii) multiple time scales means that users are likely to click frequently but purchase periodically. To this end, we develop a new multi-scale user behavior network named Hierarchical rEcurrent Ranking On the Entire Space (HEROES) which incorporates the contextual information to estimate the user multiple behaviors in a multi-scale fashion. Concretely, we intro- duce a hierarchical framework, where the lower layer models the user's engagement behaviors while the upper layer estimates the user's satisfaction behaviors. The proposed architecture can auto- matically learn a suitable time scale for each layer to capture the dynamic user's behavioral patterns. Besides the architecture, we also introduce the Hawkes process to form a novel recurrent unit which can not only encode the items' features in the context but also formulate the excitation or discouragement from the user's previous behaviors. We further show that HEROES can be extended to build unbiased ranking systems through combinations with the survival analysis technique. Extensive experiments over three large- scale industrial datasets demonstrate the superiority of our model compared with the state-of-the-art methods.

Multi-view Improved Sequence Behavior with Adaptive Multi-Task Learning in Ranking

Task Adaptive Multi-learner Network for Joint CTR and CVR Estimation.

Improving Multi-Scenario Learning to Rank in E-commerce by Exploiting Task Relationships in the Label Space

A Multitask Learning Model with Multiperspective Attention and Its Application in Recommendation

Pairwise Ranking Loss for Multi-Task Learning in Recommender Systems

MISS: Multi-Interest Self-Supervised Learning Framework for Click-Through Rate Prediction

A Deep Multi-Task Representation Learning Method for Time Series Classification and Retrieval.

NCS4CVR: Neuron-Connection Sharing for Multi-Task Learning in Video Conversion Rate Prediction

Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertising.

Towards the Better Ranking Consistency: A Multi-task Learning Framework for Early Stage Ads Ranking

Large-scale Causal Approaches to Debiasing Post-click Conversion Rate Estimation with Multi-task Learning

Multi-task Ranking with User Behaviors for Text-video Search

Multi-Scenario Ranking with Adaptive Feature Learning

CPMR: Context-Aware Incremental Sequential Recommendation with Pseudo-Multi-Task Learning

Multi-granularity Interest Retrieval and Refinement Network for Long-Term User Behavior Modeling in CTR Prediction

Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems

Branches, Assemble! Multi-Branch Cooperation Network for Large-Scale Click-Through Rate Prediction at Taobao

DMMP: A distillation-based multi-task multi-tower learning model for personalized recommendation

Multi-Scale User Behavior Network for Entire Space Multi-Task Learning

SEQ+MD: Learning Multi-Task as a SEQuence with Multi-Distribution Data

Learning Recommender Systems from Multi-Behavior Data