Abstract:In this paper, we study the stability problem of a stochastic, nonlinear, discrete-time system. We introduce a linear transfer operator-based Lyapunov measure as a new tool for stability verification of stochastic systems. Weaker set-theoretic notion of almost everywhere stochastic stability is introduced and verified, using Lyapunov measure-based stochastic stability theorems. Furthermore, connection between Lyapunov functions, a popular tool for stochastic stability verification, and Lyapunov measures is established. Using the duality property between the linear transfer Perron-Frobenius and Koopman operators, we show the Lyapunov measure and Lyapunov function used for the verification of stochastic stability are dual to each other. Set-oriented numerical methods are proposed for the finite dimensional approximation of the Perron-Frobenius operator; hence, Lyapunov measure is proposed. Stability results in finite dimensional approximation space are also presented. Finite dimensional approximation is shown to introduce further weaker notion of stability referred to as coarse stochastic stability. The results in this paper extend our earlier work on the use of Lyapunov measures for almost everywhere stability verification of deterministic dynamical systems ("Lyapunov Measure for Almost Everywhere Stability", {\it IEEE Trans. on Automatic Control}, Vol. 53, No. 1, Feb. 2008).

Stochastic Stability Analysis of Discrete Time System Using Lyapunov Measure

Lyapunov function construction for nonlinear stochastic dynamical systems

Lyapunov Exponents and Stochastic Stability of Quasi-Integrable-Hamiltonian Systems

Lyapunov Exponent and Stochastic Stability of Quasi-Non-integrable Hamiltonian Systems

Asymptotic Lyapunov Stability with Probability One of Quasi Linear Systems Subject to Multi-Time-delayed Feedback Control and Wide-Band Parametric Random Excitation

On The Local Stochastic Stability Of Nonlinear Complex Networks

Study on Stability in Probability of General Discrete-Time Stochastic Systems

Robust Stability of Linear Stochastic Systems with Distributed Parameter

Asymptotic Stability of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

Dynamics of nonlinear stochastic operators and associated Markov measures

Robust Stability Analysis and Disturbance Rejection for Discrete-Time Systems with Constraints

Stability Analysis of Nonlinear Time-Varying Systems by Lyapunov Functions with Indefinite Derivatives

Partial Stability in Probability of Nonlinear Stochastic Discrete-Time Systems with Delay

Detectability, Observability and Lyapunov-Type Theorems of Linear Discrete Time-Varying Stochastic Systems with Multiplicative Noise

Lyapunov stability of the equilibrium of the non-local continuity equation

A Survey on Lyapunov-based Methods for Stability of Linear Time-Delay Systems

Almost Sure Stability of Hybrid Stochastic Systems under Asynchronous Markovian Switching.

Almost sure stability criteria for linear Markovian switching systems

Lyapunov Conditions for Finite-time Stability of Stochastic Functional Systems

Finite-time Stability and Stabilization of Linear Discrete Time-Varying Stochastic Systems

Improved finite-time stability and instability theorems for stochastic nonlinear systems