Abstract:The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each d dimensional sample has only k non-zero features with k ≪ d, and data arrives sequentially in a streaming form. Current online AUC optimization algorithms have high per-iteration cost O(d) and usually produce non-sparse solutions in general, and hence are not suitable for handling the data challenge mentioned above. In this paper, we aim to directly optimize the AUC score for high-dimensional sparse datasets under online learning setting and propose a new algorithm, FTRL-AUC. Our proposed algorithm can process data in an online fashion with a much cheaper per-iteration cost O(k), making it amenable for high-dimensional sparse streaming data analysis. Our new algorithmic design critically depends on a novel reformulation of the U-statistics AUC objective function as the empirical saddle point reformulation, and the innovative introduction of the “lazy update” rule so that the per-iteration complexity is dramatically reduced from O(d) to O(k). Furthermore, FTRL-AUC can inherently capture sparsity more effectively by applying a generalized Follow-The-Regularized-Leader (FTRL) framework. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced.

Logistic push: a regression framework for partial AUC optimization

Logistic regression analysis with standardized markers

Lower-Left Partial AUC: An Effective and Efficient Optimization Metric for Recommendation

Improving Prostate Cancer Risk Prediction Through Partial AUC Optimization

One-Pass AUC Optimization

Two-pass AUC optimization

Cost-Sensitive Best Subset Selection for Logistic Regression: A Mixed-Integer Conic Optimization Perspective

AUL is a Better Optimization Metric in PU Learning

AUC Optimization with a Reject Option

Does it pay to optimize AUC?

Online AUC Optimization for Sparse High-Dimensional Datasets

Robust AUC optimization under the supervision of clean data

Network-based logistic regression integration method for biomarker identification

NetAUC: A network-based multi-biomarker identification method by AUC optimization

DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework

Enhancing Personalized Ranking With Differentiable Group AUC Optimization

A novel method to guide biomarker combinations to optimize the sensitivity

AUC Optimisation and Collaborative Filtering

Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guarantee