Abstract:Learning representations for multimedia content is critical for multimedia recommendation. Current representation learning methods roughly fall into two groups: (1) using the historical interactions to create ID embeddings of users and items, and (2) treating multi-modal data as the side information of items to enrich their ID embeddings. Each user-item interaction offers the supervisory signal to optimize the representation learning by the traditional supervised learning paradigm. Due to the overlook of the multi-modal patterns ( $e.g.$ , co-occurrence of visual, acoustic, textual features in micro-videos a user saw before, and her behavioral features) hidden in the data, these methods are insufficient to create powerful representations and obtain satisfactory recommendation accuracy. To capture multi-modal patterns in the data itself, we go beyond the supervised learning paradigm, and incorporate the idea of self-supervised learning (SSL) into multimedia recommendation. Specifically, SSL consists of two components: (1) data augmentation upon multi-modal contents, where we design three operators — feature dropout (FD), feature masking (FM), feature fine and coarse spaces (FAC) — to generate multiple views of individual items; and (2) contrastive learning, which differentiates the views of an item from the others’ to distill additional supervisory signals. Clearly, SSL enables us to explore and exhibit the underlying relations among modalities, thereby resulting in powerful representations. We denote the generic framework by Self-supervised Learning-guided Multimedia Recommendation (SLMRec). Extensive experiments are performed on three real-world datasets, showing that SLMRec achieves significant improvements over several state-of-the-art baselines like LightGCN [1], MMGCN [2]. Further analysis shows how SSL affects recommendation performance.

Towards Resource-Efficient and Secure Federated Multimedia Recommendation

Cluster-driven Personalized Federated Recommendation with Interest-aware Graph Convolution Network for Multimedia

Robust Privacy-Preserving Recommendation Systems Driven by Multimodal Federated Learning

Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News Recommendation

Personalized Item Representations in Federated Multimodal Recommendation

Towards Communication Efficient and Fair Federated Personalized Sequential Recommendation

Efficient and Robust Regularized Federated Recommendation

A split-federated learning and edge-cloud based efficient and privacy-preserving large-scale item recommendation model

Communication-Efficient Federated Neural Collaborative Filtering with Multi-Armed Bandits

Personalized Federated Recommendation via Joint Representation Learning, User Clustering, and Model Adaptation

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

Self-Supervised Learning for Multimedia Recommendation

Dual Personalization on Federated Recommendation

FCMF: Federated collective matrix factorization for heterogeneous collaborative filtering

Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training

Multimodal Federated Learning

A Federated Multi-View Deep Learning Framework for Privacy-Preserving Recommendations

Discrete Federated Multi-behavior Recommendation for Privacy-Preserving Heterogeneous One-Class Collaborative Filtering

A Federated Learning Approach for Privacy Protection in Context-Aware Recommender Systems.

LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization