Abstract:Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and collaborative filtering. Following the convention of RS, existing practices exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called \textit{Diversity-Promoting Collaborative Metric Learning} (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to introduce a set of multiple representations for each user in the system where users' preference toward an item is aggregated by taking the minimum item-user distance among their embedding set. Specifically, we instantiate two effective assignment strategies to explore a proper quantity of vectors for each user. Meanwhile, a \textit{Diversity Control Regularization Scheme} (DCRS) is developed to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could induce a smaller generalization error than traditional CML. Furthermore, we notice that CML-based approaches usually require \textit{negative sampling} to reduce the heavy computational burden caused by the pairwise objective therein. In this paper, we reveal the fundamental limitation of the widely adopted hard-aware sampling from the One-Way Partial AUC (OPAUC) perspective and then develop an effective sampling alternative for the CML-based paradigm. Finally, comprehensive experiments over a range of benchmark datasets speak to the efficacy of DPCML. Code are available at \url{<a class="link-external link-https" href="https://github.com/statusrank/LibCML" rel="external noopener nofollow">this https URL</a>}.

Supervised Categorical Metric Learning with Schatten p-Norms

Metric Learning Via Penalized Optimization.

Metric learning for monotonic classification: turning the space up to the limits of monotonicity

Semi-supervised Sparse Metric Learning Using Alternating Linearization Optimization

Metric Learning with Adaptive Density Discrimination

Class-specific discriminative metric learning for scene recognition

An Efficient Sparse Metric Learning in High-Dimensional Space Via L1-Penalized Log-Determinant Regularization

Regularized Large Margin Distance Metric Learning.

From Point to Set: Extend the Learning of Distance Metrics

Nearest Hit-Misses Component Analysis For Supervised Metric Learning

Probabilistic Deep Metric Learning for Hyperspectral Image Classification

Distance-Dependent Metric Learning.

Efficient Stochastic Optimization for Low-Rank Distance Metric Learning.

Exploiting Inconsistency Problem in Multi-label Classification Via Metric Learning

KPML: A Novel Probabilistic Perspective Kernel Mahalanobis Distance Metric Learning Model for Semi-supervised Clustering

Improved Diversity-Promoting Collaborative Metric Learning for Recommendation

Empirical Risk Minimization for Metric Learning Using Privileged Information

Semi-Supervised Nonlinear Distance Metric Learning via Forests of Max-Margin Cluster Hierarchies

Boundary-restricted metric learning

Intrinsic Metric Learning with Subspace Representation.

Scalable Large-Margin Mahalanobis Distance Metric Learning