Abstract:Visually-aware recommendation on E-commerce platforms aims to leverage visual information of items to predict a user's preference for these items in addition to the historical user-item interaction records. It is commonly observed that user's attention to visual features does not always reflect the real preference. Although a user may click and view an item in light of a visual satisfaction of their expectations, a real purchase does not always occur due to the unsatisfaction of other essential features (e.g., brand, material, price). We refer to the reason for such a visually related interaction deviating from the real preference as a visual bias. Existing visually-aware models make use of the visual features as a separate collaborative signal similarly to other features to directly predict the user's preference without considering a potential bias, which gives rise to a visually biased recommendation. In this paper, we derive a causal graph to identify and analyze the visual bias of these existing methods. In this causal graph, the visual feature of an item acts as a mediator, which could introduce a spurious relationship between the user and the item. To eliminate this spurious relationship that misleads the prediction of the user's real preference, an intervention and a counterfactual inference are developed over the mediator. Particularly, the Total Indirect Effect is applied for a debiased prediction during the testing phase of the model. This causal inference framework is model agnostic such that it can be integrated into the existing methods. Furthermore, we propose a debiased visually-aware recommender system, denoted as CausalRec to effectively retain the supportive significance of the visual information and remove the visual bias. Extensive experiments are conducted on eight benchmark datasets, which shows the state-of-the-art performance of CausalRec and the efficacy of debiasing.

A Picture is Worth a Thousand Words: Introducing Visual Similarity into Recommendation

Improved Algorithm of Incremental Singular Value Decomposition Collaborative Filtering

Incorporating Community Detection and Clustering Techniques into Collaborative Filtering Model

Product Recommendation Based on Image Content

Large-scale Real-time Personalized Similar Product Recommendations

Visually-aware Recommendation with Aesthetic Features

A New Similarity Model Based on Collaborative Filtering for New User Cold Start Recommendation

Recommendation System with Biclustering

COURIER: Contrastive User Intention Reconstruction for Large-Scale Visual Recommendation

Time-aspect-sentiment Recommendation Models Based on Novel Similarity Measure Methods

Visually Explainable Recommendation

Modeling Product's Visual and Functional Characteristics for Recommender Systems

Merging Visual Features and Temporal Dynamics in Sequential Recommendation.

Image-Based Recommendations on Styles and Substitutes

A New User Similarity Model to Improve the Accuracy of Collaborative Filtering

Modeling Product’s Visual and Functional Characteristics for Recommender Systems

Item Similarity Learning Methods for Collaborative Filtering Recommender Systems

Adaptive Social Similarities for Recommender Systems

CausalRec: Causal Inference for Visual Debiasing in Visually-Aware Recommendation

A content-based goods image recommendation system

Leveraging Image Visual Features in Content-Based Recommender System