Abstract:This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model accuracy assessment consider asymptotic behavior e.g., Hankel singular values and Kullback-Leibler(KL) rate metric. These metrics could further be used for model order reduction. Hence, in this paper, we propose a generalization of KL divergence-based metric called n-step KL rate metric, which could be used to compare models over a finite time horizon. We then demonstrate that the asymptotic metrics for comparing dynamical systems may not accurately assess the model prediction uncertainties over a finite time horizon. Motivated by this finite time analysis, we propose a new pragmatic approach to compute the influence of a subset of states on a combination of states called information transfer (IT). Model reduction typically involves the removal or truncation of states. IT combines the concepts from the n-step KL rate metric and model reduction. Finally, we demonstrate the application of information transfer for model reduction. Although the analysis and definitions presented in this paper assume linear systems, they can be extended for nonlinear systems.

Information theoretic methods for stochastic model reduction based on state projection

A Minimum Output Information Loss Method for Stochastic Model Reduction

Minimum Conditional Information Loss Approach to Discrete Stochastic Model Reduction

Stochastic Model Reduction Via Minimum Information Loss Approach In Frequency-Domain

Stochastic Model Reduction by Maximizing Independence

State-dimension Reduction and Filtering for Linear Systems under Communication Constraints

Model Reduction by Minimizing Information Loss Based on Cross-Gramian Matrix

A Revised Minimum Information Loss Method for Discrete-time Model Reduction

Information-Theoretic Approach for Model Reduction Over Finite Time Horizon

Model Reduction of Markovian Jump Systems with Uncertain Probabilities

Minimum information loss method based on cross-gramian matrix for model reduction (CGMIL)

Nonsynchronous Model Reduction for Uncertain 2-D Markov Jump Systems.

Balanced Truncation Model Reduction of Nonstationary Systems Interconnected over Arbitrary Graphs

ℋ∞ Model Reduction for Discrete-Time Markovian Jump Systems with Deficient Mode Information

Model reduction for uncertain stochastic systems

Model reduction on Markovian jump systems with partially unknown transition probabilities: balanced truncation approach

Model Reduction of A Class of Markov Jump Nonlinear Systems with Time-Varying Delays Via Projection Approach.

On Projection-Based Model Reduction of Biochemical Networks-- Part II: The Stochastic Case

H-infinity Model Reduction for Stochastic Systems with Markovian Jump Parameters and Time Delay

H-Infinity Model Reduction For Continuous-Time Markovian Jump Systems With Incomplete Statistics Of Mode Information

Robust L1 model reduction for stochastic time-delay systems