Abstract:This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model accuracy assessment consider asymptotic behavior e.g., Hankel singular values and Kullback-Leibler(KL) rate metric. These metrics could further be used for model order reduction. Hence, in this paper, we propose a generalization of KL divergence-based metric called n-step KL rate metric, which could be used to compare models over a finite time horizon. We then demonstrate that the asymptotic metrics for comparing dynamical systems may not accurately assess the model prediction uncertainties over a finite time horizon. Motivated by this finite time analysis, we propose a new pragmatic approach to compute the influence of a subset of states on a combination of states called information transfer (IT). Model reduction typically involves the removal or truncation of states. IT combines the concepts from the n-step KL rate metric and model reduction. Finally, we demonstrate the application of information transfer for model reduction. Although the analysis and definitions presented in this paper assume linear systems, they can be extended for nonlinear systems.

Stochastic Model Reduction by Maximizing Independence

Minimum Conditional Information Loss Approach to Discrete Stochastic Model Reduction

Information theoretic methods for stochastic model reduction based on state projection

A Minimum Output Information Loss Method for Stochastic Model Reduction

Stochastic Model Reduction Via Minimum Information Loss Approach In Frequency-Domain

Model Reduction of Markovian Jump Systems with Uncertain Probabilities

Information-Theoretic Approach for Model Reduction Over Finite Time Horizon

Model Reduction by Minimizing Information Loss Based on Cross-Gramian Matrix

A Revised Minimum Information Loss Method for Discrete-time Model Reduction

Nonsynchronous Model Reduction for Uncertain 2-D Markov Jump Systems.

H∞ Model Reduction for Discrete Singular Markovian Jump Systems

H-infinity Model Reduction for Stochastic Systems with Markovian Jump Parameters and Time Delay

Remarks on Stochastic Model Reduction

Model reduction for uncertain stochastic systems

Identification of dominant subspaces for model reduction of structured parametric systems

ℋ∞ Model Reduction for Discrete-Time Markovian Jump Systems with Deficient Mode Information

Model Reduction And H-Infinity Norm Computation For State-Space Symmetric Systems

A Trust-Region Method for Optimal H-2 Model Reduction of Discrete-Time Dynamical Systems

Model Reduction Based on Balanced Realization for Discrete-Time Singular Systems

Complexity reduction of large-scale stochastic systems using linear quadratic Gaussian balancing

Stochastic Mode-Reduction in Models with Conservative Fast Sub-Systems