Abstract:We study a sampling and transmission scheduling problem for multi-source remote estimation, where a scheduler determines when to take samples from multiple continuous-time Gauss-Markov processes and send the samples over multiple channels to remote estimators. The sample transmission times are i.i.d. across samples and channels. The objective of the scheduler is to minimize the weighted sum of the time-average expected estimation errors of these Gauss-Markov sources. This problem is a continuous-time Restless Multi-armed Bandit (RMAB) problem with a continuous state space. We prove that the bandits are indexable and derive an exact expression of the Whittle index. To the extent of our knowledge, this is the first Whittle index policy for multi-source signal-aware remote estimation of Gauss-Markov processes. Our results unite two theoretical frameworks that were used for remote estimation and AoI minimization: threshold-based sampling and Whittle index-based scheduling. In the single-source, single-channel scenario, we demonstrate that the optimal solution to the sampling and scheduling problem can be equivalently expressed as both a threshold-based sampling strategy and a Whittle index-based scheduling policy. Notably, the Whittle index is equal to zero if and only if two conditions are satisfied: (i) the channel is idle, and (ii) the estimation error is precisely equal to the threshold in the threshold-based sampling strategy. Moreover, the methodology employed to derive threshold-based sampling strategies in the single-source, single-channel scenario plays a crucial role in establishing indexability and evaluating the Whittle index in the more intricate multi-source, multi-channel scenario. Our numerical results show that the proposed policy achieves high-performance gain over the existing policies when some of the Gauss-Markov processes are highly unstable.

Whittle Index Policy for Dynamic Multichannel Allocation in Remote State Estimation

Remote Estimation of Gauss-Markov Processes over Multiple Channels: A Whittle Index Policy

Optimal Estimation Algorithm Design under Event-based Sensor Data Scheduling*

Performance Bounds and Asymptotic Optimality of Modified (r, Q) Policies for Stochastic Distribution Inventory Systems

Optimizing AoI at Query in Multiuser Wireless Uplink Networks: A Whittle Index Approach

Whittle's index-based age-of-information minimization in multi-energy harvesting source networks

Whittle's Index Based Sensor Scheduling for Multiprocess Systems Under DoS Attacks

A Whittle Index Approach to Minimizing Functions of Age of Information

Task Offloading for Large-Scale Asynchronous Mobile Edge Computing: An Index Policy Approach

Index policies for optimal mean-variance trade-off of inter-delivery times in real-time sensor networks

Efficient Measurement Scheduling for Remote State Estimation With Limited Bandwidth

Learning Optimal Scheduling Policy for Remote State Estimation Under Uncertain Channel Condition

Whittle Index with Multiple Actions and State Constraint for Inventory Management

Attack Allocation on Remote State Estimation in Multi-Systems: Structural Results and Asymptotic Solution

On Remote Estimation with Multiple Communication Channels

Learning Augmented Index Policy for Optimal Service Placement at the Network Edge

Optimal Energy-Efficient Regular Delivery of Packets in Cyber-Physical Systems

Dynamic Channel Assignment for Wireless Sensor Networks: A Regret Matching Based Approach

Allocation of Eavesdropping Attacks for Multi-System Remote State Estimation

Remote Estimation of Markov Processes over Costly Channels: On the Benefits of Implicit Information

Towards Efficient Dynamic Uplink Scheduling over Multiple Unknown Channels