Abstract:Background: As an important mathematical model, the finite state machine (FSM) has been used in many fields, such as manufacturing system, health care, and so on. This paper analyzes the current development status of FSMs. It is pointed out that the traditional methods are often inconvenient for analysis and design, or encounter high computational complexity problems when studying FSMs. Method: The deep Q-network (DQN) technique, which is a model-free optimization method, is introduced to solve the stabilization problem of probabilistic finite state machines (PFSMs). In order to better understand the technique, some preliminaries, including Markov decision process, ε-greedy strategy, DQN, and so on, are recalled. Results: First, a necessary and sufficient stabilizability condition for PFSMs is derived. Next, the feedback stabilization problem of PFSMs is transformed into an optimization problem. Finally, by using the stabilizability condition and deep Q-network, an algorithm for solving the optimization problem (equivalently, computing a state feedback stabilizer) is provided. Discussion: Compared with the traditional Q learning, DQN avoids the limited capacity problem. So our method can deal with high-dimensional complex systems efficiently. The effectiveness of our method is further demonstrated through an illustrative example.

On the Static Output Feedback Stabilization of Deterministic Finite Automata Based Upon the Approach of Semi-Tensor Product of Matrix.

Guaranteed cost D-stabilization and H∞ D-stabilization for linear discrete time-delay systems

Guaranteed Cost D-Stabilization And H-Infinity D-Stabilization For Linear Discrete Time-Delay Systems

A New Method for the Static Output Feedback Stabilization

Finite-time Stability and Stabilisation of Distributed Parameter Systems

Admissible finite-time stability and stabilization of uncertain discrete singular systems

Robust Stabilization For Singular Systems With Time-Delays And Saturating Controls

Dynamic Output Feedback Stabilizing Control For Linear Time-Varying Uncertain Systems With Delayed State And Control

Static Output Feedback Stabilization Based on Structured Lyapunov Matrix

ROBUST STABILITY CONDITIONS FOR SISO DYNAMIC MATRIX CONTROL

An Ilmi Approach To Robust Static Output Feedback Sliding Mode Control

Simultaneous stabilization via static output feedback and state feedback

Some New Results On Simultaneous Stabilization Controller Using State-Space Approach

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

A Hybrid Optimization Approach for Discrete-Time H<inf>&#x221E;</inf> Static-Output-feedback Control Problem

Pseudo Feedforward Dynamic Matrix Control Algorithm for Desired Closed-Loop Performance in MPC Systems

Delayed Feedback Control for Stabilization of Boolean Control Networks With State Delay.

New results on delay‐dependent stability analysis and stabilization for stochastic time‐delay systems

Exponential stabilization for 1-D linear Itô-type state-dependent stochastic parabolic PDE systems via static output feedback

Feedback stabilization of probabilistic finite state machines based on deep Q-network