Abstract:User modeling plays a fundamental role in industrial recommender systems, either in the matching stage and the ranking stage, in terms of both the customer experience and business revenue. How to extract users' multiple interests effectively from their historical behavior sequences to improve the relevance and personalization of the recommend results remains an open problem for user modeling.Most existing deep-learning based approaches exploit item-ids and category-ids but neglect fine-grained features like color and mate-rial, which hinders modeling the fine granularity of users' interests.In the paper, we present Multiple interest and Fine granularity Net-work (MFN), which tackle users' multiple and fine-grained interests and construct the model from both the similarity relationship and the combination relationship among the users' multiple interests.Specifically, for modeling the similarity relationship, we leverage two sets of embeddings, where one is the fixed embedding from pre-trained models (e.g. Glove) to give the attention weights and the other is trainable embedding to be trained with MFN together.For modeling the combination relationship, self-attentive layers are exploited to build the higher order combinations of different interest representations. In the construction of network, we design an interest-extract module using attention mechanism to capture multiple interest representations from user historical behavior sequences and leverage an auxiliary loss to boost the distinction of the interest representations. Then a hierarchical network is applied to model the attention relation between the multiple interest vectors of different granularities and the target item. We evaluate MFNon both public and industrial datasets. The experimental results demonstrate that the proposed MFN achieves superior performance than other existed representing methods.

Pre-training General User Representation with Multi-type APP Behaviors

A Novel Macro-Micro Fusion Network for User Representation Learning on Mobile Apps.

Exploiting Behavioral Consistence for Universal User Representation.

DDHCN: Dual Decoder Hyperformer Convolutional Network for Downstream-Adaptable User Representation Learning on App Usage.

Empowering General-purpose User Representation with Full-life Cycle Behavior Modeling

User Multi-Interest Modeling for Behavioral Cognition

General-Purpose User Embeddings based on Mobile App Usage

General-Purpose User Modeling with Behavioral Logs: A Snapchat Case Study

Learning and Fusing Multiple User Interest Representations for Micro-Video and Movie Recommendations

GPTCN: Gated Parallel Transformer Convolutional Networks for Downstream-Task User Representation Learning on App Usage

Learning Interest-oriented Universal User Representation Via Self-supervision

PTUM: Pre-training User Model from Unlabeled User Behaviors Via Self-supervision.

Graph Meta Network for Multi-Behavior Recommendation

User Profiling through Deep Multimodal Fusion.

Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction

Dreaming User Multimodal Representation Guided by The Platonic Representation Hypothesis for Micro-Video Recommendation

Multi-Representation Fusion Network for Multi-Turn Response Selection in Retrieval-Based Chatbots

Appformer: A Novel Framework for Mobile App Usage Prediction Leveraging Progressive Multi-Modal Data Fusion and Feature Extraction

Mixture of Virtual-Kernel Experts for Multi-Objective User Profile Modeling

Multiple Interest and Fine Granularity Network for User Modeling

A Deep Approach For Multi-Modal User Attribute Modeling