SimCEN: Simple Contrast-enhanced Network for CTR Prediction

Honghao Li,Lei Sang,Yi Zhang,Yiwen Zhang
DOI: https://doi.org/10.1145/3664647.3681203
2024-01-01
Abstract:Click-through rate (CTR) prediction is an essential component of industrial multimedia recommendation, and the key to enhancing the accuracy of CTR prediction lies in the effective modeling of feature interactions using rich user profiles, item attributes, and contextual information. Most of the current deep CTR models resort to parallel or stacked structures to break through the performance bottleneck of Multi-Layer Perceptron (MLP). However, we identify two limitations in these models: (1) parallel or stacked structures often treat explicit and implicit components as isolated entities, leading to a loss of mutual information; (2) traditional CTR models, whether in terms of supervision signals or interaction methods, lack the ability to filter out noise information, thereby limiting the effectiveness of the models. In response to this gap, this paper introduces SimCEN, a novel model that integrates alternate structure and contrastive learning into a single MLP, eliminating the need for multiple MLPs for different semantic spaces. SimCEN uses a contrastive product for second-order feature interactions and an external-gated mechanism to explicitly learn feature interactions and filter noise. At the final representation layer, a contrastive loss provides self-supervised signals for higher-quality representations. Experiments on six real-world datasets demonstrate the effectiveness and compatibility of this simple framework, which can serve as a substitute for MLP to enhance various representative baselines. Our source code and detailed logs are available at https://github.com/salmon1802/SimCEN.
What problem does this paper attempt to address?