Abstract:Session-based recommendation is devoted to characterizing preferences of anonymous users based on short sessions. Existing methods mostly focus on mining limited item co-occurrence patterns exposed by item ID within sessions, while ignoring what attracts users to engage with certain items is rich multi-modal information displayed on pages. Generally, the multi-modal information can be classified into two categories: descriptive information (eg item images and description text) and numerical information (eg price). In this paper, we aim to improve session-based recommendation by modeling the above multi-modal information holistically. There are mainly three issues to reveal user intent from multi-modal information: (1) How to extract relevant semantics from heterogeneous descriptive information with different noise? (2) How to fuse these heterogeneous descriptive information to comprehensively infer user interests? (3) How to handle probabilistic influence of numerical information on user behaviors? To solve above issues, we propose a novel multi-modal session-based recommendation (MMSBR) that models both descriptive and numerical information under a unified framework. Specifically, a pseudo-modality contrastive learning is devised to enhance the representation learning of descriptive information. Afterwards, a hierarchical pivot transformer is presented to fuse heterogeneous descriptive information. Moreover, we represent numerical information with Gaussian distribution and design a Wasserstein self-attention to handle the probabilistic influence mode. Extensive experiments on three real-world datasets demonstrate the effectiveness of the proposed MMSBR. Further analysis also proves that our MMSBR can alleviate the cold-start problem in SBR effectively.

CMBF: Cross-Modal-Based Fusion Recommendation Algorithm

Multi-modal Recommendation Based on Knowledge Graph

Multi-modal recommendation algorithm fusing visual and textual features

Modality-Guided Collaborative Filtering for Recommendation

Attention-Based Multi-view Feature Fusion for Cross-Domain Recommendation

CFCR: A Convolution and Fusion Model for Cross-platform Recommendation

Multi-modal Graph and Sequence Fusion Learning for Recommendation.

CFFNN: Cross Feature Fusion Neural Network for Collaborative Filtering

Broad Learning based Multi-Source Collaborative Recommendation.

Cross-Domain Recommendation Via User-Clustering and Multidimensional Information Fusion

A Dynamic Collaborative Recommendation Method Based on Multimodal Fusion

Adaptive Multi-Modalities Fusion in Sequential Recommendation Systems

Collaborative Cross-modal Fusion with Large Language Model for Recommendation

A Context-Aware Recommendation Method with Multi-Feature Fusion Based on Fisher Linear Discriminant Analysis

Attention-guided Multi-step Fusion: A Hierarchical Fusion Network for Multimodal Recommendation

Beyond Co-occurrence: Multi-modal Session-based Recommendation

CMC-MMR: multi-modal recommendation model with cross-modal correction

Fusion Recommendation System Based on Collaborative Filtering and Knowledge Graph.

Online Video Recommendation Based on Multimodal Fusion and Relevance Feedback

Triple Modality Fusion: Aligning Visual, Textual, and Graph Data with Large Language Models for Multi-Behavior Recommendations

A Hybrid Multigroup Coclustering Recommendation Framework Based on Information Fusion