Abstract:In this paper, we consider cyber-physical system (CPS) with multiple remote state estimation under denial-of-service (DoS) attack in infinite time-horizon. The sensors monitor the system and send their local state estimate to remote estimators by choosing the local channels in "State 0" or "State 1". The aim of sensors is to find policies for choosing local channel in a specific state to transmit message to minimize the total estimation error covariance on account of energy-saving in an infinite time-horizon. The DoS attacker aims to achieve the opposite goal by choosing channels to attack or not. The games between sensors and DoS attacker under two different structures of public information are investigated, that is the open-loop case (where sensors and attacker cannot observe others' behaviors) and the closed-loop case (where sensors and attacker can observe the others' behaviors causally). For the open-loop case with assumption that the DoS attacker can get the information from the remote estimators to the sensors, the distributed reinforcement learning algorithms for sensors and attacker based on local information are proposed to find their Nash equilibrium policies, respectively. Further, we consider in closed loop case that the DoS attacker cannot get the information from the remote estimators to the sensors which leads to asymmetric information between the sensors and attacker. To derive Nash equilibrium policies for sensors and attacker, we convert the original game into a belief-based continuous-state stochastic game. The convergence of distributed reinforcement learning method is proved. Some simulations are presented to demonstrate its effectiveness.

Distributed Dimensionality Reduction Fusion Estimation for Cyber-Physical Systems under DoS Attacks

Distributed Robust Dimensionality Reduction Fusion Estimation Under DoS Attacks and Uncertain Covariances

Distributed Dimensionality Reduction Filtering for CPSs under DoS Attacks.

Protocol-Based Distributed Security Fusion Estimation for Time-Varying Uncertain Systems Over Sensor Networks: Tackling DoS Attacks

Delay-Dependent Distributed Kalman Fusion Estimation With Dimensionality Reduction in Cyber-Physical Systems

Distributed Dimensionality Reduction Fusion Estimation for Stochastic Uncertain Systems with Fading Measurements Subject to Mixed Attacks

Optimal DoS Attack Strategy for Cyber-Physical Systems via Energy Allocation

Distributed Fusion Estimation for Linear Time-varying Systems under DoS Attacks and Bounded Noises

Networked Nonlinear Fusion Estimation Under DoS Attacks

Risk Assessment and Defense Resource Allocation of Cyber-Physical Distribution Systems under Denial-of-Service Attacks

Resilient State Estimation of Cyber-Physical System with Multichannel Transmission under DoS Attack

Information Fusion Estimation for Spatially Distributed Cyber-Physical Systems with Communication Delay and Bandwidth Constraints.

Optimal DoS Attack Policy Against Remote State Estimation

Distributed Reinforcement Learning for Cyber-Physical System with Multiple Remote State Estimation under DoS Attacker

Optimal FDI and DoS Attacks on CPSs with Energy Constraint

Distributed Fusion Estimation for Nonlinear Cyber-Physical Systems With Attacked Control Signals

Optimal Denial-of-Service Attack Scheduling in Cyber-Physical Systems ∗

Secure Fusion Estimation for Bandwidth Constrained Cyber-Physical Systems under Replay Attacks

Distributed Covariance Intersection Fusion Estimation for Cyber-Physical Systems with Communication Constraints

Probabilistic Denial of Service Attack Against Remote State Estimation over a Markov Channel in Cyber-Physical Systems

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks