Status Update Control and Analysis under Two-Way Delay

Mohammad Moltafet,Markus Leinonen,Marian Codreanu,Roy D. Yates
2024-05-25
Abstract:We study status updating under two-way delay in a system consisting of a sampler, a sink, and a controller residing at the sink. The controller controls the sampling process by sending request packets to the sampler. Upon receiving a request, the sampler generates a sample and transmits the status update packet to the sink. Transmissions of both request and status update packets encounter random delays. We develop optimal control policies to minimize the average age of information (AoI) using the tools of Markov decision processes in two scenarios. We begin with the system having at most one active request, i.e., a generated request for which the sink has not yet received a status update packet. Then, as the main distinctive feature of this paper, we initiate pipelining-type status updating by studying a system having at most two active requests. Furthermore, we conduct AoI analysis by deriving the average AoI expressions for the Zero-Wait-1, Zero-Wait-2, and Wait-1 policies. According to the Zero-Wait-1 policy, whenever a status update packet is delivered to the sink, a new request packet is inserted into the system. The Zero-Wait-2 policy operates similarly, except that the system holds two active requests. According to the Wait-1 policy, whenever a status update packet is delivered to the sink, a new request is sent after a waiting time which is a function of the current AoI. Numerical results illustrate the performance of each status updating policy under different system parameter values.
Information Theory
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper primarily investigates how to optimize the Age of Information (AoI) in a status update system under bidirectional delay conditions. Specifically, it explores how to minimize the average AoI through optimal control strategies in a system comprising a sampler, a sink, and a controller. #### Main Contributions 1. **Introduction of Bidirectional Delay**: The paper considers a system with bidirectional random delays, meaning there are delays in both the reverse link from the controller to the sampler and the forward link from the sampler to the sink. 2. **Handling Multiple Requests**: The paper proposes a new method to handle multiple concurrent requests, allowing the system to process two active requests simultaneously. This introduces a pipelined processing approach, differing from the traditional stop-and-wait mechanism. 3. **Optimal Control Strategy**: The paper designs optimal control strategies using the Markov Decision Process (MDP) approach and solves these strategies using the Relative Value Iteration (RVI) algorithm. 4. **AoI Performance Analysis under Different Strategies**: The paper analyzes the average AoI under three different control strategies (Zero-Wait-1, Zero-Wait-2, and Wait-1) and derives closed-form expressions. #### System Model - **Sampler**: Monitors a random process and generates samples based on requests from the controller. - **Sink**: Receives status update packets. - **Controller**: Located at the sink, sends request packets to the sampler via the reverse link. - **Delay**: Both the reverse and forward links have random delays. #### Research Background - **Age of Information (AoI)**: Measures the gap between the timestamp of the latest received status update packet and the current time. - **Optimization Goal**: Minimize the system's average AoI by optimizing control strategies. #### Methodology - **State Definition**: Includes AoI, controller server occupancy status, sampler server occupancy status, etc. - **Action Definition**: Whether the controller generates a request packet in the current time slot. - **Policy Definition**: Actions taken based on the current state. - **MDP Modeling**: The problem is formulated as an MDP problem, and the RVI algorithm is used to solve for the optimal strategy. #### Numerical Results - The paper presents the performance of each status update strategy under different system parameters and explains the threshold structure of the optimal status update strategy. Through this research, the paper aims to improve the efficiency and information freshness of the status update system.