Abstract:The freshness of status information is of great importance for time-critical Internet-of-Things (IoT) applications. A metric measuring status freshness is the Age of Information (AoI), which captures the time elapsed from the status being generated at the source node (e.g., a sensor) to the latest status update. However, in intelligent IoT applications such as video surveillance, the status information is revealed after some computation-intensive and time-consuming data processing operations, which would affect the status freshness. In this article, we propose a novel metric, Age of Processing (AoP), to quantify such status freshness, which captures the time elapsed of the newest received processed status data since it is generated. Compared with AoI, AoP further takes the data processing time into account. Since an IoT device has limited computation and energy resources, the IoT device can choose to offload the data processing to the nearby edge server under constrained status sampling frequency. We aim to minimize the average AoP in a long-term process by jointly optimizing the status sampling frequency and processing offloading policy. We first formulate this online problem as an infinite-horizon constrained Markov decision process (CMDP) with an average reward criterion. We then transform the CMDP problem into an unconstrained Markov decision process (MDP) by leveraging a Lagrangian method, and accordingly propose a Lagrangian transformation framework for the original CMDP problem. Furthermore, we integrate the framework with a perturbation-based refinement mechanism for achieving the optimal policy of the CMDP problem. Our investigation shows that to minimize the average AoP: 1) for processing offloading: the policy exploits good channel state to offload processing to the edge server and 2) for status sampling: the waiting time presents a threshold structure. Extensive numerical evaluations show that the proposed algorithm outperforms the benc-marks, with an average AoP reduction up to 30%.

Age-Based Scheduling for Monitoring and Control Applications in Mobile Edge Computing Systems

Age-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Reinforcement-Learning-Based Scheduling for Age of Information Optimization in MEC Multi-User Network

Schedule or Wait: Age-Minimization for IoT Big Data Processing in MEC Via Online Learning

Reinforcement Learning for Optimizing Age of Information and Energy Consumption in Misson-critical IoT

Minimizing the Age-of-Critical-Information: An Imitation Learning-based Scheduling Approach Under Partial Observations

Fractional Deep Reinforcement Learning for Age-Minimal Mobile Edge Computing

Asynchronous Fractional Multi-Agent Deep Reinforcement Learning for Age-Minimal Mobile Edge Computing

Age-driven Joint Sampling and Non-slot Based Scheduling for Industrial Internet of Things

Age Based Task Scheduling and Computation Offloading in Mobile-Edge Computing Systems

Distributed Reinforcement Learning for Optimizing Age of Information and Energy Consumption in Wireless Powered IoT Systems.

Age of Processing: Age-Driven Status Sampling and Processing Offloading for Edge-Computing-Enabled Real-Time IoT Applications

A Scheduling Scheme for Minimizing Age Under Delay Tolerance in IoT Systems With Heterogeneous Traffic

Decentralized Updates Scheduling for Data Freshness in Mobile Edge Computing.

A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT

Minimizing Age-of-Information with Joint Transmission and Computing Scheduling in Mobile Edge Computing

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Age-Optimal Computation Offloading for Mobile Edge Computing System

Minimizing Age of Information for Real-Time Monitoring in Resource-Constrained Industrial IoT Networks

Reliability-Constrained Task Scheduling for DAG Applications in Mobile Edge Computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning