Abstract:The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class cases, while leaving the multiclass cases unconsidered. In this paper, we start an early trial to consider the problem of learning multiclass scoring functions via optimizing multiclass AUC metrics. Our foundation is based on the M metric, which is a well-known multiclass extension of AUC. We first pay a revisit to this metric, showing that it could eliminate the imbalance issue from the minority class pairs. Motivated by this, we propose an empirical surrogate risk minimization framework to approximately optimize the M metric. Theoretically, we show that: (i) optimizing most of the popular differentiable surrogate losses suffices to reach the Bayes optimal scoring function asymptotically; (ii) the training framework enjoys an imbalance-aware generalization error bound, which pays more attention to the bottleneck samples of minority classes compared with the traditional O(√{1/N}) result. Practically, to deal with the low scalability of the computational operations, we propose acceleration methods for three popular surrogate loss functions, including the exponential loss, squared loss, and hinge loss, to speed up loss and gradient evaluations. Finally, experimental results on 11 real-world datasets demonstrate the effectiveness of our proposed framework. The code is now available at https://github.com/joshuaas/Learning-with-Multiclass-AUC-Theory-and-Algorithms.

A Boosting Method for Direct AUC Optimization

Dual Coordinate Descent Method for Solving AUC Optimization Problem

Does it pay to optimize AUC?

Learning with Multiclass AUC: Theory and Algorithms

Robust AUC optimization under the supervision of clean data

Boosting Through Optimization of Margin Distributions

Two-pass AUC optimization

One-Pass AUC Optimization

When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guarantee

When All We Need is a Piece of the Pie: A Generic Framework for Optimizing Two-way Partial AUC.

AUC Maximization in the Era of Big Data and AI: A Survey

Balanced Self-Paced Learning for AUC Maximization

AUC Optimization with a Reject Option

Optimizing Two-Way Partial AUC with an End-to-End Framework

Enhancing Personalized Ranking With Differentiable Group AUC Optimization

Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence

AUC Optimization from Multiple Unlabeled Datasets.

Improved Pso_adaboost Ensemble Algorithm For Imbalanced Data

Stochastic Methods for AUC Optimization subject to AUC-based Fairness Constraints

Doubly Robust AUC Optimization Against Noisy and Adversarial Samples

A new boosting algorithm based on dual averaging scheme