Simplified Desirability Level Metrics For Estimation Performance Evaluation

Yanhui Mao,Yongxin Gao,Yi Gao,Weibin Cheng,Yuelong Wang
DOI: https://doi.org/10.23919/ICIF.2018.8455836
2018-01-01
Abstract:Different estimators have different optimization criteria according to the concrete application considered. Most existing metrics on estimation performance are some averages of estimation error terms, which usually give "big" or "small" results to show the "bad" or "good" performance of the evaluated estimators. These kinds of metrics are only insufficient statistics of discrete set of estimation errors in some sense and reflect certain narrow aspects of estimation performance. However, an error distribution function is important information which is usually overlooked. To handle this problem, a metric, called desirability level, is provided in [1] to measure how the probability density function (pdf) of estimation error is relative to a desired pdf. This study firstly proposes extended desirability level metric which has a simpler form compared to an original one. Then a new metric based on principal component analysis is introduced. Illustration examples are given to demonstrate the effectiveness of our proposed measures.
What problem does this paper attempt to address?