Abstract:Combinatorial features are essential for the success of many commercial models. Manually crafting these features usually comes with high cost due to the variety, volume and velocity of raw data in web-scale systems. Factorization based models, which measure interactions in terms of vector product, can learn patterns of combinatorial features automatically and generalize to unseen features as well. With the great success of deep neural networks (DNNs) in various fields, recently researchers have proposed several DNN-based factorization model to learn both low- and high-order feature interactions. Despite the powerful ability of learning an arbitrary function from data, plain DNNs generate feature interactions implicitly and at the bit-wise level. In this paper, we propose a novel Compressed Interaction Network (CIN), which aims to generate feature interactions in an explicit fashion and at the vector-wise level. We show that the CIN share some functionalities with convolutional neural networks (CNNs) and recurrent neural networks (RNNs). We further combine a CIN and a classical DNN into one unified model, and named this new model eXtreme Deep Factorization Machine (xDeepFM). On one hand, the xDeepFM is able to learn certain bounded-degree feature interactions explicitly; on the other hand, it can learn arbitrary low- and high-order feature interactions implicitly. We conduct comprehensive experiments on three real-world datasets. Our results demonstrate that xDeepFM outperforms state-of-the-art models. We have released the source code of xDeepFM at \url{<a class="link-external link-https" href="https://github.com/Leavingseason/xDeepFM" rel="external noopener nofollow">this https URL</a>}.

The Footprint of Factorization Models and Their Applications in Collaborative Filtering

Improving Recommendations With Collaborative Factors

Improved Metric-Based Recommender by Historical Interactions.

L G ] 1 7 A pr 2 01 8 A Boosting Framework of Factorization Machine

A Boosting Framework of Factorization Machine.

A unified latent factor correction scheme for collaborative filtering

Collaborative Factorization For Recommender Systems

Multi-linear Interactive Matrix Factorization.

Multi-Task Matrix Factorization For Collaborative Filtering

CFM: Convolutional Factorization Machines for Context-Aware Recommendation.

Incremental Matrix Factorization: A Linear Feature Transformation Perspective.

Efficient Data-specific Model Search for Collaborative Filtering

Fast Convolutional Factorization Machine with Enhanced Robustness

Embedding Factorization Models for Jointly Recommending Items and User Generated Lists

Incremental Learning for Dynamic Collaborative Filtering.

xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems

Dynamic Collaborative Filtering with Compound Poisson Factorization

Comprehensive Evaluation of Matrix Factorization Models for Collaborative Filtering Recommender Systems

Using Dynamic Multi-Task Non-Negative Matrix Factorization to Detect the Evolution of User Preferences in Collaborative Filtering

Collaborative Filtering with Topic and Social Latent Factors Incorporating Implicit Feedback

Deep Collaborative Filtering Combined with High-Level Feature Generation on Latent Factor Model