Abstract:Despite their satisfactory performance, most existing listwise Learning-To-Rank (LTR) models do not consider the crucial issue of robustness. A data set can be contaminated in various ways, including human error in labeling or annotation, distributional data shift, and malicious adversaries who wish to degrade the algorithm's performance. It has been shown that Distributionally Robust Optimization (DRO) is resilient against various types of noise and perturbations. To fill this gap, we introduce a new listwise LTR model called Distributionally Robust Multi-output Regression Ranking (DRMRR). Different from existing methods, the scoring function of DRMRR was designed as a multivariate mapping from a feature vector to a vector of deviation scores, which captures local context information and cross-document interactions. In this way, we are able to incorporate the LTR metrics into our model. DRMRR uses a Wasserstein DRO framework to minimize a multi-output loss function under the most adverse distributions in the neighborhood of the empirical data distribution defined by a Wasserstein ball. We present a compact and computationally solvable reformulation of the min-max formulation of DRMRR. Our experiments were conducted on two real-world applications: medical document retrieval and drug response prediction, showing that DRMRR notably outperforms state-of-the-art LTR models. We also conducted an extensive analysis to examine the resilience of DRMRR against various types of noise: Gaussian noise, adversarial perturbations, and label poisoning. Accordingly, DRMRR is not only able to achieve significantly better performance than other baselines, but it can maintain a relatively stable performance as more noise is added to the data.

A Distributionally Robust Optimization Approach for Multivariate Linear Regression under the Wasserstein Metric

Robustified Multivariate Regression and Classification Using Distributionally Robust Optimization under the Wasserstein Metric

A Robust Learning Algorithm for Regression Models Using Distributionally Robust Optimization under the Wasserstein Metric

A Robust Learning Approach for Regression Models Based on Distributionally Robust Optimization.

Outlier detection using distributionally robust optimization under the Wasserstein metric

Distributionally Robust Logistic Regression

Distributionally and Adversarially Robust Logistic Regression via Intersecting Wasserstein Balls

Decomposition Algorithm for Distributionally Robust Optimization using Wasserstein Metric

Distributionally Robust Optimization with Correlated Data from Vector Autoregressive Processes

Outlier-Robust Wasserstein DRO

A Distributionally Robust Optimization Approach for Outlier Detection *

Distributionally Robust Learning-to-rank under the Wasserstein Metric.

Regularization for Wasserstein distributionally robust optimization

Doubly Robust Data-Driven Distributionally Robust Optimization

Wasserstein distributionally robust optimization and its tractable regularization formulations

Distributionally Robust Multiclass Classification and Applications in Deep Image Classifiers

Unifying Distributionally Robust Optimization via Optimal Transport Theory

DORO: Distributional and Outlier Robust Optimization

Robust Grouped Variable Selection Using Distributionally Robust Optimization

On Wasserstein Distributionally Robust Mean Semi-Absolute Deviation Portfolio Model: Robust Selection and Efficient Computation