Abstract:The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each d dimensional sample has only k non-zero features with k ≪ d, and data arrives sequentially in a streaming form. Current online AUC optimization algorithms have high per-iteration cost O(d) and usually produce non-sparse solutions in general, and hence are not suitable for handling the data challenge mentioned above. In this paper, we aim to directly optimize the AUC score for high-dimensional sparse datasets under online learning setting and propose a new algorithm, FTRL-AUC. Our proposed algorithm can process data in an online fashion with a much cheaper per-iteration cost O(k), making it amenable for high-dimensional sparse streaming data analysis. Our new algorithmic design critically depends on a novel reformulation of the U-statistics AUC objective function as the empirical saddle point reformulation, and the innovative introduction of the “lazy update” rule so that the per-iteration complexity is dramatically reduced from O(d) to O(k). Furthermore, FTRL-AUC can inherently capture sparsity more effectively by applying a generalized Follow-The-Regularized-Leader (FTRL) framework. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced. Experiments on real-world datasets demonstrate that FTRL-AUC significantly improves both run time and model sparsity while achieving competitive AUC scores compared with the state-of-the-art methods. Comparison with the online learning method for logistic loss demonstrates that FTRL-AUC achieves higher AUC scores especially when datasets are imbalanced.

Optimizing area under the ROC curve via extreme learning machines.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine with Multiple Kernels

Multi-class AdaBoost ELM

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Evolutionary Multitasking AUC Optimization [Research Frontier]

Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification

Does it pay to optimize AUC?

Robust AUC optimization under the supervision of clean data

AUC Optimization from Multiple Unlabeled Datasets.

Online AUC Optimization for Sparse High-Dimensional Datasets

AUC Optimization with a Reject Option

Two-pass AUC optimization

AUCSeg: AUC-oriented Pixel-level Long-tail Semantic Segmentation

Enhancing Personalized Ranking With Differentiable Group AUC Optimization

DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework

Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning