Abstract:The freshness of status information is of great importance for time-critical Internet-of-Things (IoT) applications. A metric measuring status freshness is the Age of Information (AoI), which captures the time elapsed from the status being generated at the source node (e.g., a sensor) to the latest status update. However, in intelligent IoT applications such as video surveillance, the status information is revealed after some computation-intensive and time-consuming data processing operations, which would affect the status freshness. In this article, we propose a novel metric, Age of Processing (AoP), to quantify such status freshness, which captures the time elapsed of the newest received processed status data since it is generated. Compared with AoI, AoP further takes the data processing time into account. Since an IoT device has limited computation and energy resources, the IoT device can choose to offload the data processing to the nearby edge server under constrained status sampling frequency. We aim to minimize the average AoP in a long-term process by jointly optimizing the status sampling frequency and processing offloading policy. We first formulate this online problem as an infinite-horizon constrained Markov decision process (CMDP) with an average reward criterion. We then transform the CMDP problem into an unconstrained Markov decision process (MDP) by leveraging a Lagrangian method, and accordingly propose a Lagrangian transformation framework for the original CMDP problem. Furthermore, we integrate the framework with a perturbation-based refinement mechanism for achieving the optimal policy of the CMDP problem. Our investigation shows that to minimize the average AoP: 1) for processing offloading: the policy exploits good channel state to offload processing to the edge server and 2) for status sampling: the waiting time presents a threshold structure. Extensive numerical evaluations show that the proposed algorithm outperforms the benc-marks, with an average AoP reduction up to 30%.

Cost-AoI Aware Task Scheduling in Industrial IOT Based on Serverless Edge Computing

AoI-aware Energy Control and Computation Offloading for Industrial IoT.

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Cloud-Edge Collaboration for Integration of Sensing, Computing, and Communication in Industrial Internet

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

Cooperative Partial Task Offloading and Resource Allocation for IIoT Based on Decentralized Multi-Agent Deep Reinforcement Learning

Age-of-Information Aware Scheduling for Edge-Assisted Industrial Wireless Networks

Age-of-Information-Based Computation Offloading and Transmission Scheduling in Mobile-Edge-Computing-Enabled IoT Networks

An effective resource scheduling model for edge cloud oriented AIoT

Deep Reinforcement Learning Based Cooperative Partial Task Offloading and Resource Allocation for IIoT Applications

Cost-Effective Task Scheduling for Collaborative Cross-Edge Analytics

Graph-Based Proximal Policy Optimization Empowered Adaptive Task Scheduling Leveraging Cloud-Edge Collaboration for Consumer Electronics

Age of Processing: Age-Driven Status Sampling and Processing Offloading for Edge-Computing-Enabled Real-Time IoT Applications

Task Offloading Based on Edge Computing Considering Overhead and Load Balancing in Industrial Internet of Things.

A Scheduling Scheme in a Container-Based Edge Computing Environment Using Deep Reinforcement Learning Approach.

AoI-Aware Partial Computation Offloading in IIoT with Edge Computing: A Deep Reinforcement Learning Based Approach

Learning-Based Autonomous Scheduling for AoI-Aware Industrial Wireless Networks

An Offloading Strategy Based on Cloud and Edge Computing for Industrial Internet

Cross-domain Task Offloading and Computing Resource Allocation for Edge Computation in Industrial Internet of Things

AoI-Aware Joint Resource Allocation in Multi-UAV Aided Multi-Access Edge Computing Systems

Multi-Agent Deep Reinforcement Learning Offloading Algorithm Based on Resource Reservation and Task Adjustment