Abstract:Advances in technology have enabled the use of sensors with varied modalities to monitor different parts of systems, each providing diverse levels of information about the underlying system. However, resource limitations and computational power restrict the number of sensors/data that can be processed in real-time in most complex systems. These challenges necessitate the need for selecting/scheduling a subset of sensors to obtain measurements that guarantee the best monitoring objectives. This paper focuses on sensor scheduling for systems modeled by hidden Markov models. Despite the development of several sensor selection and scheduling methods, existing methods tend to be greedy and do not take into account the long-term impact of selected sensors on monitoring objectives. This paper formulates optimal sensor scheduling as a reinforcement learning problem defined over the posterior distribution of system states. Further, the paper derives a deep reinforcement learning policy for offline learning of the sensor scheduling policy, which can then be executed in real-time as new information unfolds. The proposed method applies to any monitoring objective that can be expressed in terms of the posterior distribution of the states (e.g., state estimation, information gain, etc.). The performance of the proposed method in terms of accuracy and robustness is investigated for monitoring the security of networked systems and the health monitoring of gene regulatory networks.

Real-time sensor selection for time-varying networks with guaranteed performance

Dynamic Sensor Selection for Reliable Spectrum Sensing via E-Optimal Criterion

A Fast Distributed Variational Bayesian Filtering for Multisensor LTV System With Non-Gaussian Noise

Robust detection of intermittent sensor faults in stochastic LTV systems

Spatially Regularized Streaming Sensor Selection

Optimal Sensor Scheduling for State Estimation over Lossy Channel

Adaptive Sensing Schedule for Dynamic Spectrum Sharing in Time-Varying Channel

Optimal Sensor Data Scheduling for Remote Estimation Over a Time-Varying Channel.

Distributed State Estimation for Linear Time-Varying Systems with Sensor Network Delays

An Opportunistic Sensor Scheduling Solution to Remote State Estimation Over Multiple Channels.

On Stochastic Sensor Network Scheduling for Multiple Processes

Stochastic Sensor Scheduling for Energy Constrained Estimation in Multi-Hop Wireless Sensor Networks

Stochastic Sensor Scheduling for Multiple Dynamical Processes over a Shared Channel

A Separation Theorem for Joint Sensor and Actuator Scheduling with Guaranteed Performance Bounds

Stochastic Sensor Scheduling for Networked Control Systems

Stochastic online sensor scheduler for remote state estimation

Intermittent Sensor Fault Detection for Stochastic LTV Systems with Parameter Uncertainty and Limited Resolution

Optimal sensor scheduling for state estimation under limited channel resources

Deep Reinforcement Learning Sensor Scheduling for Effective Monitoring of Dynamical Systems

Randomized Greedy Sensor Selection: Leveraging Weak Submodularity

Stochastic Event-Triggered Sensor Schedule for Remote State Estimation