Abstract:The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each d dimensional sample has only k non-zero features with k ≪ d, and data arrives sequentially in a streaming form. Current online AUC optimization algorithms have high per-iteration cost O(d) and usually produce non-sparse solutions in general, and hence are not suitable for handling the data challenge mentioned above. In this paper, we aim to directly optimize the AUC score for high-dimensional sparse datasets under online learning setting and propose a new algorithm, FTRL-AUC. Our proposed algorithm can process data in an online fashion with a much cheaper per-iteration cost O(k), making it amenable for high-dimensional sparse streaming data analysis. Our new algorithmic design critically depends on a novel reformulation of the U-statistics AUC objective function as the empirical saddle point reformulation, and the innovative introduction of the “lazy update” rule so that the per-iteration complexity is dramatically reduced from O(d) to O(k). Furthermore, FTRL-AUC can inherently capture sparsity more effectively by applying a generalized Follow-The-Regularized-Leader (FTRL) framework. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced.

Two-pass AUC optimization

One-Pass AUC Optimization

Does it pay to optimize AUC?

Robust AUC optimization under the supervision of clean data

Online AUC Optimization for Sparse High-Dimensional Datasets

Dual Coordinate Descent Method for Solving AUC Optimization Problem

AUC Optimization from Multiple Unlabeled Datasets.

Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence

Enhancing Personalized Ranking With Differentiable Group AUC Optimization

DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework

Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization

When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guarantee

On the Consistency of AUC Pairwise Optimization

Evolutionary Multitasking AUC Optimization [Research Frontier]

AUC Optimisation and Collaborative Filtering

AUC Optimization with a Reject Option

Data Removal from an AUC Optimization Model

Lower-Left Partial AUC: An Effective and Efficient Optimization Metric for Recommendation

Two-Way Partial AUC and Its Properties

An efficient variance estimator of AUC and its applications to binary classification

Multiclass ROC