Abstract:We design scheduling policies that minimize a risk-sensitive cost criterion for a remote estimation setup. Since risk-sensitive cost objective takes into account not just the mean value of the cost, but also higher order moments of its probability distribution, the resulting policy is robust to changes in the underlying system's parameters. The setup consists of a sensor that observes a discrete-time autoregressive Markov process, and at each time $t$ decides whether or not to transmit its observations to a remote estimator using an unreliable wireless communication channel after encoding these observations into data packets. We model the communication channel as a Gilbert-Elliott channel \cite{10384144}. Sensor probes the channel \cite{laourine2010betting} and hence knows the channel state at each time $t$ before making scheduling decision. The scheduler has to minimize the expected value of the exponential of the finite horizon cumulative cost that is sum of the following two quantities (i) the cumulative transmission power consumed, (ii) the cumulative squared estimator error. We pose this dynamic optimization problem as a Markov decision process (MDP), in which the system state at time $t$ is composed of (i) the instantaneous error $\Delta(t):= x(t)-a\hat{x}(t-1)$, where $x(t),\hat{x}(t-1)$ are the system state and the estimate at time $t,t-1$ respectively, and (ii) the channel state $c(t)$. We show that there exists an optimal policy that has a threshold structure, i.e., at each time $t$, for each possible channel state $c$, there is a threshold $\D\ust(c)$ such that if the current channel state is $c$, then it transmits only when the error $\D(t)$ exceeds $\D\ust(c)$.

Optimal redundant transmission scheduling for remote state estimation via reinforcement learning approach

Optimal Estimation Algorithm Design under Event-based Sensor Data Scheduling*

Dynamic Sensor Transmission Power Scheduling for Remote State Estimation.

Remote State Estimation with Stochastic Event-triggered Sensor Schedule in the Presence of Packet Drops

An Opportunistic Sensor Scheduling Solution to Remote State Estimation Over Multiple Channels.

To Transmit or Not to Transmit: Optimal Sensor Schedule for Remote State Estimation of Discrete-Event Systems

Optimal Risk-Sensitive Scheduling Policies for Remote Estimation of Autoregressive Markov Processes

Learning Optimal Scheduling Policy for Remote State Estimation Under Uncertain Channel Condition

Stochastic Sensor Scheduling for Multiple Dynamical Processes over a Shared Channel

Optimal Sensor Scheduling for State Estimation over Lossy Channel

On Stochastic Sensor Network Scheduling for Multiple Processes

Optimal Periodic Sensor Schedule for Steady-State Estimation Under Average Transmission Energy Constraint

Remote State Estimation With Stochastic Event-Triggered Sensor Schedule and Packet Drops

Optimal Sensor Data Scheduling for Remote Estimation Over a Time-Varying Channel.

DRL-based Resource Allocation in Remote State Estimation

On the Effects and Optimal Design of Redundant Sensors in Collaborative State Estimation

Data Gathering Optimization by Dynamic Sensing and Routing in Rechargeable Sensor Networks

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

Infinite Horizon Optimal Transmission Power Control for Remote State Estimation over Fading Channels

Efficient Measurement Scheduling for Remote State Estimation With Limited Bandwidth

Communication Scheduling by Deep Reinforcement Learning for Remote Traffic State Estimation with Bayesian Inference