Abstract:In various web applications like targeted advertising and recommender systems, the available categorical features (e.g., product type) are often of great importance but sparse. As a widely adopted solution, models based on Factorization Machines (FMs) are capable of modelling high-order interactions among features for effective sparse predictive analytics. As the volume of web-scale data grows exponentially over time, sparse predictive analytics inevitably involves dynamic and sequential features. However, existing FM-based models assume no temporal orders in the data, and are unable to capture the sequential dependencies or patterns within the dynamic features, impeding the performance and adaptivity of these methods. Hence, in this paper, we propose a novel Sequence-Aware Factorization Machine (SeqFM) for temporal predictive analytics, which models feature interactions by fully investigating the effect of sequential dependencies. As static features (e.g., user gender) and dynamic features (e.g., user interacted items) express different semantics, we innovatively devise a multi-view self-attention scheme that separately models the effect of static features, dynamic features and the mutual interactions between static and dynamic features in three different views. In SeqFM, we further map the learned representations of feature interactions to the desired output with a shared residual network. To showcase the versatility and generalizability of SeqFM, we test SeqFM in three popular application scenarios for FM-based models, namely ranking, classification and regression tasks. Extensive experimental results on six large-scale datasets demonstrate the superior effectiveness and efficiency of SeqFM.

Neural Hierarchical Factorization Machines for User's Event Sequence Analysis

Strongly Hierarchical Factorization Machines and ANOVA Kernel Regression

Feature-Level Attentive Neural Model for Session-Based Recommendation

Sequential Modeling of Hierarchical User Intention and Preference for Next-item Recommendation

Neural Factorization Machines for Sparse Predictive Analytics

Hierarchical Hybrid Feature Model for Top-N Context-Aware Recommendation

Factorial User Modeling with Hierarchical Graph Neural Network for Enhanced Sequential Recommendation

Field-Aware Neural Factorization Machine for Click-Through Rate Prediction

Sequence-Aware Factorization Machines for Temporal Predictive Analytics

Bayesian feature interaction selection for factorization machines

Multi-view Factorization Machines for Mobile App Recommendation Based on Hierarchical Attention.

Multi-Tasking Link Prediction On Coupled Networks Via The Factor Graph Model

Neural attention model for recommendation based on factorization machines

Interaction-aware Factorization Machines for Recommender Systems

HTDA: Hierarchical Time-Based Directional Attention Network for Sequential User Behavior Modeling.

Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks

Learning Hierarchical Representation Model for NextBasket Recommendation.

Detecting Abnormal Events Via Hierarchical Dirichlet Processes.

DeepFM: A Factorization-Machine based Neural Network for CTR Prediction

GraphFM: Graph Factorization Machines for Feature Interaction Modeling