Abstract:In industrial edge caching networks, to ensure long-term accurate decision-making of industrial applications, it is critical to obtain fresh sensing contents with low sensor energy consumption. The acquisition of sensing contents consists of cache update and content delivery, jointly determining the Age of Information (AoI) of applications. However, cache update suffers from the large sensor energy consumption and the mismatch between content offerings and demands. Content delivery suffers from the limited fronthaul capacity. Furthermore, contents from multiple sensors typically need to be aggregated, allowing the AoI of applications to be determined by the co-AoI of all correlated sensors. It is challenging to make the trade-off between the energy efficiency of each sensor and the co-AoI performance of all correlated sensors. In our work, the weighted sum of application AoI and sensor energy consumption is minimized by jointly optimizing cache update and content delivery, which is formulated as a long-term stochastic optimization problem. Next, two caching schemes, Access Point Centric Scheme (APCS) and Request Adaptive Caching Scheme (RACS), are presented. In APCS, we fully decouple cache update and content delivery by applying statistical probability of application requests to control update. In RACS, cached contents are updated along with content delivery according to real-time requests. Thus, we introduce the concept of decision reward to transform the stochastic problem into the per-time slot reward maximization problem and propose online algorithms to solve it. Simulation results show that proposed schemes can reduce the sensor energy consumption by 40% while guaranteeing the application AoI.

AoI and Energy-Driven Dynamic Cache Updates for Wireless Edge Networks

Deep Reinforcement Learning for IoT Networks: Age of Information and Energy Cost Tradeoff

Joint Content Update and Transmission Resource Allocation for Energy-Efficient Edge Caching of High Definition Map

Deep reinforcement learning for IoT cache updating based on age of incorrect information

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

AoI and Energy Consumption Oriented Dynamic Status Updating in Caching Enabled IoT Networks

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Energy Efficient Cache Update and Content Delivery for Optimizing Information Freshness of Industrial Applications

Content Update Via Deep Reinforcement Learning in Recommendation-Aware Edge Caching Network

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

A DQN-Based Cache Strategy for Mobile Edge Networks

Optimal Status Update for Caching Enabled IoT Networks: A Dueling Deep R-Network Approach

Dynamic Content Caching Based on Actor-Critic Reinforcement Learning for IoT Systems.

A Deep Reinforcement Learning Approach for Dynamic Contents Caching in HetNets

Edge Caching for IoT Transient Data Using Deep Reinforcement Learning

Intelligent Edge Content Caching: A Deep Recurrent Reinforcement Learning Method

Deep Reinforcement Learning for Energy-Efficient Edge Caching in Mobile Edge Networks

Deep Reinforcement Learning-Based Edge Caching in Single-Cell Wireless Networks

Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning

Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach

A Deep Reinforcement Learning-Based Content Updating Algorithm for High Definition Map Edge Caching