Abstract:Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and collaborative filtering. Following the convention of RS, existing practices exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called \textit{Diversity-Promoting Collaborative Metric Learning} (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to introduce a set of multiple representations for each user in the system where users' preference toward an item is aggregated by taking the minimum item-user distance among their embedding set. Specifically, we instantiate two effective assignment strategies to explore a proper quantity of vectors for each user. Meanwhile, a \textit{Diversity Control Regularization Scheme} (DCRS) is developed to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could induce a smaller generalization error than traditional CML. Furthermore, we notice that CML-based approaches usually require \textit{negative sampling} to reduce the heavy computational burden caused by the pairwise objective therein. In this paper, we reveal the fundamental limitation of the widely adopted hard-aware sampling from the One-Way Partial AUC (OPAUC) perspective and then develop an effective sampling alternative for the CML-based paradigm. Finally, comprehensive experiments over a range of benchmark datasets speak to the efficacy of DPCML. Code are available at \url{<a class="link-external link-https" href="https://github.com/statusrank/LibCML" rel="external noopener nofollow">this https URL</a>}.

Cross-Modal Metric Learning for AUC Optimization.

Metric Learning Via Penalized Optimization.

Adversarial-Metric Learning for Audio-Visual Cross-Modal Matching

Deep Coupled Metric Learning for Cross-Modal Matching.

Cross-modal Deep Metric Learning with Multi-Task Regularization

Universal Weighting Metric Learning for Cross-Modal Retrieval

Multi-view metric learning for visual classification

Collaborative Multi-View Metric Learning For Visual Classification

AUCμ: A Performance Metric for Multi-Class Machine Learning Models

Interclass-Relativity-Adaptive Metric Learning for Cross-Modal Matching and Beyond

Dual Coordinate Descent Method for Solving AUC Optimization Problem

A Unifying Mutual Information View of Metric Learning: Cross-Entropy vs. Pairwise Losses

AUC Optimization from Multiple Unlabeled Datasets.

Two-Level Multi-Task Metric Learning with Application to Multi-Classification

Heterogeneous Face Recognition by Margin-Based Cross-Modality Metric Learning.

Distance-Dependent Metric Learning.

On Metric Learning for Audio-Text Cross-Modal Retrieval

Unsupervised Contrastive Cross-Modal Hashing

Improved Diversity-Promoting Collaborative Metric Learning for Recommendation

Anchor-aware Deep Metric Learning for Audio-visual Retrieval

Long-tail Cross Modal Hashing.