Abstract:The commonly used root-mean-square error for estimation performance evaluation is easily dominated by large error terms. So many new alternative absolute metrics have been provided in X. R. Li's work. However, each of these metrics only reflects one narrow aspect of estimation performance, respectively. A comprehensive measure, error spectrum, was presented aggregating all these incomprehensive measures. However, when being applied to dynamic systems, this measure will have three dimensions over the total time span, which is not intuitive and difficult to be analysed. To overcome its drawbacks, a new metric, dynamic error spectrum (DES), is proposed in this study to extend the error spectrum measure to dynamic systems. Three forms under different application backgrounds are given, one of which is balanced taking into account both good and bad behaviour of an estimator and so can provide more impartial evaluation results. It can be applied to a variety of dynamic systems directly. Then the challenge in performance evaluation of the interacting multiple model (IMM) algorithm is considered, and the IMM algorithm is chosen as the testing case to illustrate the superiority of the DES metric. The simulation results validate its utility and effectiveness.

Algorithm for Performance Sensitivity Estimation of Markov Discrete Event Dynamic System

A Quantitative Credibility Evaluation Method of Dynamic Equivalent Model Based on Power Sensitivity

A PRACTICAL OBSERVABILITY ANALYSIS ALGORITHM FOR STATE ESTIMATION IN EMS OF GUANGDONG POWER SYSTEM

Simulation Estimates of Performance Sensitivity and Their Applications in Queuing Systems with Erlang Distributions

Estimation Method of Software Reliability for Safety-critical System

Sensitivity Estimates and Optimization Algorithms Based on Parallel Simulation for a Class of Closed Queuing Networks

A new efficient simulation method based on Bayes' theorem and importance sampling Markov chain simulation to estimate the failure-probability-based global sensitivity measure

Fast Emergency Control Strategy Calculation Based on Dynamic Equivalence and Integral Sensitivity

Conditional expectation method for estimating parameter sensitivity of unreliability

A New Method for the Fast Simulation of Models of Highly Dependable Markov System

Estimation of Dependability Measures and Parameter Sensitivities of a Consecutive- -out-of- :F Repairable System with -Step

Dynamic Model-based Saddle-point Approximation for Reliability and Reliability-based Sensitivity Analysis

Reliable Dissipative Control for Markov Jump Systems Using an Event-Triggered Sampling Information Scheme

Estimation of Dependability Measures and Parameter Sensitivities of a Consecutive- $k$ -out-of- $n$ : F Repairable System with $(K-1)$ -Step Markov Dependence by Simulation

Real-Time Performance Reliability Assessment Method Based On Dynamic Probability Model

Efficient Functional Reliability Estimation for a Passive Residual Heat Removal System with Subset Simulation Based on Importance Sampling

The Estimation of the Semi-Markov Processes Performance Potentials Based on Parallel Simulation

Aggregation of simulation and infinitesimal perturbation analysis in discrete event dynamic system

Pathwise Estimation of Probability Sensitivities Through Terminating or Steady-State Simulations

Dynamic Error Spectrum for Estimation Performance Evaluation: a Case Study on Interacting Multiple Model Algorithm

Discrete State Event Driven Method and Self-Adapted Predictor-Corrector Algorithm