Abstract:In cyber-physical systems such as automobiles, measurement data from sensor nodes should be delivered to other consumer nodes such as actuators in a regular fashion. But, in practical systems over unreliable media such as wireless, it is a significant challenge to guarantee small enough inter-delivery times for different clients with heterogeneous channel conditions and inter-delivery requirements. In this paper, we design scheduling policies aiming at satisfying the inter-delivery requirements of such clients. We formulate the problem as a risk-sensitive Markov Decision Process (MDP). Although the resulting problem involves an infinite state space, we first prove that there is an equivalent MDP involving only a finite number of states. Then we prove the existence of a stationary optimal policy and establish an algorithm to compute it in a finite number of steps. However, the bane of this and many similar problems is the resulting complexity, and, in an attempt to make fundamental progress, we further propose a new high reliability asymptotic approach. In essence, this approach considers the scenario when the channel failure probabilities for different clients are of the same order, and asymptotically approach zero. We thus proceed to determine the asymptotically optimal policy: in a two-client scenario, we show that the asymptotically optimal policy is a "modified least time-to-go" policy, which is intuitively appealing and easily implementable; in the general multi-client scenario, we are led to an SN policy, and we develop an algorithm of low computational complexity to obtain it. Simulation results show that the resulting policies perform well even in the pre-asymptotic regime with moderate failure probabilities.

Scheduling Stochastic Real-Time D2D Communications

Simulink-Based Dynamic Priority Scheduling for Optimization in Network-on-Chip Communication

Transmission scheduling of P2P real-time communication based on restless multi-armed bandit

Wireless Link Scheduling for D2D Communications with Graph Embedding Technique

On the Power of Randomization for Scheduling Real-Time Traffic in Wireless Networks

Communication-Efficient Task Scheduling for Real-Time Distributed Computing.

Delay-aware resource allocation and power control for device-to-device communications

Randomized Scheduling of Real-Time Traffic in Wireless Networks Over Fading Channels

Structural Solutions to Dynamic Scheduling for Multimedia Transmission in Unknown Wireless Environments

Age of Information-Oriented Probabilistic Link Scheduling for Device-to-Device Networks

A High Reliability Asymptotic Approach for Packet Inter-Delivery Time Optimization in Cyber-Physical Systems.

Delay-Aware Two-Time-Scale Scheduling for mmWave Systems with Mobility and Environment Knowledge

Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals

On Fast Optimal STDMA Scheduling over Fading Wireless Channels

Delay-optimal Probabilistic Scheduling in Green Communications with Arbitrary Arrival and Adaptive Transmission

A Risk-Sensitive Approach for Packet Inter-Delivery Time Optimization in Networked Cyber-Physical Systems

Dynamic Optimization of Random Access in Deadline-Constrained Broadcasting

Delay Efficient D2D Communications over 5G Edge-Computing Mobile Networks

Delay-Optimal Buffer-Aware Scheduling with Adaptive Transmission

Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals: The No-Buffer Case

Scheduling for Mobile Edge Computing with Random User Arrivals: An Approximate MDP and Reinforcement Learning Approach