Abstract:We introduce a novel loss function to minimize the outage probability of an ML-based resource allocation system. A single-user multi-resource greedy allocation strategy constitutes our application scenario, for which an ML binary classification predictor assists in selecting a resource satisfying the established outage criterium. While other resource allocation policies may be suitable, they are not the focus of our study. Instead, our primary emphasis is on theoretically developing this loss function and leveraging it to train an ML model to address the outage probability challenge. With no access to future channel state information, this predictor foresees each resource's likely future outage status. When the predictor encounters a resource it believes will be satisfactory, it allocates it to the user. Our main result establishes exact and asymptotic expressions for this system's outage probability. These expressions reveal that focusing solely on the optimization of the per-resource outage probability conditioned on the ML predictor recommending resource allocation (a strategy that appears to be most appropriate) may produce inadequate predictors that reject every resource. They also reveal that focusing on standard metrics, like precision, false-positive rate, or recall, may not produce optimal predictors. With our result, we formulate a theoretically optimal, differentiable loss function to train our predictor. We then compare predictors trained using this and traditional loss functions namely, binary cross-entropy (BCE), mean squared error (MSE), and mean absolute error (MAE). In all scenarios, predictors trained using our novel loss function provide superior outage probability performance. Moreover, in some cases, our loss function outperforms predictors trained with BCE, MAE, and MSE by multiple orders of magnitude.

The fundamental nature of the log loss function

Adversarial Prediction Games for Multivariate Losses

Proper losses regret at least 1/2-order

Loss as the Inconsistency of a Probabilistic Dependency Graph: Choose Your Model, Not Your Loss Function

The Geometry and Calculus of Losses

Sequential prediction of individual sequences under general loss functions

How to Boost Any Loss Function

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

A Loss Function Approach to Model Specification Testing and Its Relative Efficiency

Leading strategies in competitive on-line prediction

An Analysis of Loss Functions for Binary Classification and Regression

Competing with Markov prediction strategies

When Does Optimizing a Proper Loss Yield Calibration?

Outage Performance and Novel Loss Function for an ML-Assisted Resource Allocation: An Exact Analytical Framework

Alternate Loss Functions for Classification and Robust Regression Can Improve the Accuracy of Artificial Neural Networks

Output-weighted and relative entropy loss functions for deep learning precursors of extreme events

Generalized robust loss functions for machine learning

The Central Role of the Loss Function in Reinforcement Learning

Logistic Regression: Tight Bounds for Stochastic and Online Optimization

Cross-Entropy Loss Functions: Theoretical Analysis and Applications