Abstract:Click-through rate (CTR) prediction is critical for industrial applications such as recommender system and online advertising. Practically, it plays an important role for CTR modeling in these applications by mining user interest from rich historical behavior data. Driven by the development of deep learning, deep CTR models with ingeniously designed architecture for user interest modeling have been proposed, bringing remarkable improvement of model performance over offline metric. However, great efforts are needed to deploy these complex models to online serving system for realtime inference, facing massive traffic request. Things turn to be more difficult when it comes to long sequential user behavior data, as the system latency and storage cost increase approximately linearly with the length of user behavior sequence. In this paper, we face directly the challenge of long sequential user behavior modeling and introduce our hands-on practice with the co-design of machine learning algorithm and online serving system for CTR prediction task. (i) From serving system view, we decouple the most resource-consuming part of user interest modeling from the entire model by designing a separate module named UIC (User Interest Center). UIC maintains the latest interest state for each user, whose update depends on realtime user behavior trigger event, rather than on traffic request. Hence UIC is latency free for realtime CTR prediction. (ii) From machine learning algorithm view, we propose a novel memory-based architecture named MIMN (Multi-channel user Interest Memory Network) to capture user interests from long sequential behavior data, achieving superior performance over state-of-the-art models. MIMN is implemented in an incremental manner with UIC module. Theoretically, the co-design solution of UIC and MIMN enables us to handle the user interest modeling with unlimited length of sequential behavior data. Comparison between model performance and system efficiency proves the effectiveness of proposed solution. To our knowledge, this is one of the first industrial solutions that are capable of handling long sequential user behavior data with length scaling up to thousands. It now has been deployed in the display advertising system in Alibaba.

Sequential classification of customer behavior based on sequence-to-sequence learning with gated-attention neural networks

In-store Customer Shopping Behavior Analysis by Utilizing RFID-enabled Shelf and Multilayer Perceptron Model

ENCODE: Breaking the Trade-Off Between Performance and Efficiency in Long-Term User Behavior Modeling

Design and Implementation of an RFID-Based Customer Shopping Behavior Mining System.

SEQ+MD: Learning Multi-Task as a SEQuence with Multi-Distribution Data

Attention with Long-Term Interval-Based Gated Recurrent Units for Modeling Sequential User Behaviors

Enabling Fine-Grained Shopping Behavior Information Acquisition With Dual RFID Tags

Smart Shelf System for Customer Behavior Tracking in Supermarkets

Attention with Long-Term Interval-Based Deep Sequential Learning for Recommendation.

Retail store customer behavior analysis system: Design and Implementation

TagBooth: Deep shopping data acquisition powered by RFID tags

Online Cost Efficient Customer Recognition System for Retail Analytics.

A Framework for Mining Actionable Navigation Patterns from In-Store RFID Datasets Via Indoor Mapping.

Semantic Assessment of Shopping Behavior Using Trajectories, Shopping Related Actions, and Context Information

The research of the application of the binary search algorithm of RFID system in the supermarket shopping information identification

TiSSA: A Time Slice Self-Attention Approach for Modeling Sequential User Behaviors

TPGN: A Time-Preference Gate Network for e-commerce purchase intention recognition

Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction

ShopMiner

Sequential Recommendation Model for Next Purchase Prediction

Predicting Consumer In-Store Purchase Using Real-Time Retail Video Analytics