Abstract:In this paper, we consider cyber-physical system (CPS) with multiple remote state estimation under denial-of-service (DoS) attack in infinite time-horizon. The sensors monitor the system and send their local state estimate to remote estimators by choosing the local channels in "State 0" or "State 1". The aim of sensors is to find policies for choosing local channel in a specific state to transmit message to minimize the total estimation error covariance on account of energy-saving in an infinite time-horizon. The DoS attacker aims to achieve the opposite goal by choosing channels to attack or not. The games between sensors and DoS attacker under two different structures of public information are investigated, that is the open-loop case (where sensors and attacker cannot observe others' behaviors) and the closed-loop case (where sensors and attacker can observe the others' behaviors causally). For the open-loop case with assumption that the DoS attacker can get the information from the remote estimators to the sensors, the distributed reinforcement learning algorithms for sensors and attacker based on local information are proposed to find their Nash equilibrium policies, respectively. Further, we consider in closed loop case that the DoS attacker cannot get the information from the remote estimators to the sensors which leads to asymmetric information between the sensors and attacker. To derive Nash equilibrium policies for sensors and attacker, we convert the original game into a belief-based continuous-state stochastic game. The convergence of distributed reinforcement learning method is proved. Some simulations are presented to demonstrate its effectiveness.

Denial-of-Service Attacks on Cyber-Physical-Systems with Two-Hop Networks under Round-Robin Protocol

Probabilistic Denial of Service Attack Against Remote State Estimation over a Markov Channel in Cyber-Physical Systems

Optimal DoS Attack Schedules on Remote State Estimation under Multi-Sensor Round-Robin Protocol

Resilient State Estimation of Cyber-Physical System with Multichannel Transmission under DoS Attack

Optimal DoS Attack Policy Against Remote State Estimation

A multi-channel transmission schedule for remote state estimation under DoS attacks

Transmission Scheduling for Remote State Estimation in CPSs with Two-Hop Networks Subject to DoS Attacks

Optimal Denial-of-Service Attack Scheduling with Energy Constraint over Packet-Dropping Networks

Optimal Denial-of-Service Attack Scheduling in Cyber-Physical Systems ∗

Optimal DoS Attack Strategy Against Remote State Estimation over Lossy Networks

Optimal Denial-of-Service Attack Scheduling with Energy Constraint

Risk Assessment and Defense Resource Allocation of Cyber-Physical Distribution Systems under Denial-of-Service Attacks

Stochastic DoS Attack Allocation Against Collaborative Estimation in Sensor Networks.

Optimal DoS Attack Strategy for Cyber-Physical Systems via Energy Allocation

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks

Distributed Reinforcement Learning for Cyber-Physical System with Multiple Remote State Estimation under DoS Attacker

Optimal Jamming Attack Schedule for Remote State Estimation with Two Sensors.

DoS Attack in Centralised Sensor Network Against State Estimation

Optimal Denial-of-Service Attack Strategy on State Estimation Over Infinite-Time Horizon

An Analysis on Optimal Attack Schedule Based on Channel Hopping Scheme in Cyber-Physical Systems

Distributed Consensus Tracking of Networked Agent Systems under Denial-of-Service Attacks