Abstract:Conversion rate (CVR) prediction is essential in recommender systems, facilitating precise matching between recommended items and users’ preferences. However, the sample selection bias (SSB) and data sparsity (DS) issues pose challenges to accurate prediction. Existing works have proposed the click-through and conversion rate (CTCVR) prediction task which models samples from exposure to ``click and conversion" in entire space and incorporates multi-task learning. This approach has shown efficacy in mitigating these challenges. Nevertheless, it intensifies the false negative sample (FNS) problem. To be more specific, the CTCVR task implicitly treats all the CVR labels of non-click samples as negative, overlooking the possibility that some samples might convert if clicked. This oversight can negatively impact CVR model performance, as empirical analysis has confirmed. To this end, we advocate for discarding the CTCVR task and proposing a Non-click samples Improved Semi-supErvised (NISE) method for conversion rate prediction, where the non-click samples are treated as unlabeled. Our approach aims to predict their probabilities of conversion if clicked, utilizing these predictions as pseudo-labels for further model training. This strategy can help alleviate the FNS problem, and direct modeling of the CVR task across the entire space also mitigates the SSB and DS challenges. Additionally, we conduct multi-task learning by introducing an auxiliary click-through rate prediction task, thereby enhancing embedding layer representations. Our approach is applicable to various multi-task architectures. Comprehensive experiments are conducted on both public and production datasets, demonstrating the superiority of our proposed method in mitigating the FNS challenge and improving the CVR estimation. The implementation code is available at https://github.com/Hjh233/NISE.

Enhanced Doubly Robust Learning for Debiasing Post-Click Conversion Rate Estimation

A Generalized Doubly Robust Learning Framework for Debiasing Post-Click Conversion Rate Prediction

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Large-scale Causal Approaches to Debiasing Post-click Conversion Rate Estimation with Multi-task Learning

Debiasing the Conversion Rate Prediction Model in the Presence of Delayed Implicit Feedback

TDR-CL: Targeted Doubly Robust Collaborative Learning for Debiased Recommendations

CDR: Conservative Doubly Robust Learning for Debiased Recommendation

Multiple Robust Learning for Recommendation.

EGEAN: An Exposure-Guided Embedding Alignment Network for Post-Click Conversion Estimation

DCMT: A Direct Entire-Space Causal Multi-Task Framework for Post-Click Conversion Estimation.

StableDR: Stabilized Doubly Robust Learning for Recommendation on Data Missing Not at Random

Capturing Delayed Feedback in Conversion Rate Prediction via Elapsed-Time Sampling

Utilizing Non-click Samples Via Semi-supervised Learning for Conversion Rate Prediction

Robust Causal Learning for the Estimation of Average Treatment Effects

Contrastive Learning for Conversion Rate Prediction

Uncertainty Calibration for Counterfactual Propensity Estimation in Recommendation

Doubly Calibrated Estimator for Recommendation on Data Missing Not At Random

Relaxing the Accurate Imputation Assumption in Doubly Robust Learning for Debiased Collaborative Filtering

Deep Learning for Click-Through Rate Estimation

Generalized Delayed Feedback Model with Post-Click Information in Recommender Systems

Iterative Boosting Deep Neural Networks for Predicting Click-Through Rate