Abstract:This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model accuracy assessment consider asymptotic behavior e.g., Hankel singular values and Kullback-Leibler(KL) rate metric. These metrics could further be used for model order reduction. Hence, in this paper, we propose a generalization of KL divergence-based metric called n-step KL rate metric, which could be used to compare models over a finite time horizon. We then demonstrate that the asymptotic metrics for comparing dynamical systems may not accurately assess the model prediction uncertainties over a finite time horizon. Motivated by this finite time analysis, we propose a new pragmatic approach to compute the influence of a subset of states on a combination of states called information transfer (IT). Model reduction typically involves the removal or truncation of states. IT combines the concepts from the n-step KL rate metric and model reduction. Finally, we demonstrate the application of information transfer for model reduction. Although the analysis and definitions presented in this paper assume linear systems, they can be extended for nonlinear systems.

A Minimum Output Information Loss Method for Stochastic Model Reduction

Information theoretic methods for stochastic model reduction based on state projection

Minimum Conditional Information Loss Approach to Discrete Stochastic Model Reduction

Stochastic Model Reduction Via Minimum Information Loss Approach In Frequency-Domain

A Revised Minimum Information Loss Method for Discrete-time Model Reduction

Stochastic Model Reduction by Maximizing Independence

Model Reduction by Minimizing Information Loss Based on Cross-Gramian Matrix

Reduced-order LQG controller design based on principle of minimum information loss

Minimum information loss method based on cross-gramian matrix for model reduction (CGMIL)

H∞ Model Reduction for Linear Differential Repetitive Processes

ℋ∞ Model Reduction for Discrete-Time Markovian Jump Systems with Deficient Mode Information

Model Reduction of Markovian Jump Systems with Uncertain Probabilities

Nonsynchronous Model Reduction for Uncertain 2-D Markov Jump Systems.

H-Infinity Model Reduction For Continuous-Time Markovian Jump Systems With Incomplete Statistics Of Mode Information

Remarks on Stochastic Model Reduction

Information-Theoretic Approach for Model Reduction Over Finite Time Horizon

ℋ∞model Reduction for Continuous-Time Switched Stochastic Hybrid Systems

Improved Results on H∞ Model Reduction for Markovian Jump Systems with Partly Known Transition Probabilities

Model reduction on Markovian jump systems with partially unknown transition probabilities: balanced truncation approach

H∞ Model Reduction for Discrete Singular Markovian Jump Systems

A Trust-Region Method for Optimal H-2 Model Reduction of Discrete-Time Dynamical Systems