Abstract:In industrial edge caching networks, to ensure long-term accurate decision-making of industrial applications, it is critical to obtain fresh sensing contents with low sensor energy consumption. The acquisition of sensing contents consists of cache update and content delivery, jointly determining the Age of Information (AoI) of applications. However, cache update suffers from the large sensor energy consumption and the mismatch between content offerings and demands. Content delivery suffers from the limited fronthaul capacity. Furthermore, contents from multiple sensors typically need to be aggregated, allowing the AoI of applications to be determined by the co-AoI of all correlated sensors. It is challenging to make the trade-off between the energy efficiency of each sensor and the co-AoI performance of all correlated sensors. In our work, the weighted sum of application AoI and sensor energy consumption is minimized by jointly optimizing cache update and content delivery, which is formulated as a long-term stochastic optimization problem. Next, two caching schemes, Access Point Centric Scheme (APCS) and Request Adaptive Caching Scheme (RACS), are presented. In APCS, we fully decouple cache update and content delivery by applying statistical probability of application requests to control update. In RACS, cached contents are updated along with content delivery according to real-time requests. Thus, we introduce the concept of decision reward to transform the stochastic problem into the per-time slot reward maximization problem and propose online algorithms to solve it. Simulation results show that proposed schemes can reduce the sensor energy consumption by 40% while guaranteeing the application AoI.

Optimal Status Update for Caching Enabled IoT Networks: A Dueling Deep R-Network Approach

AoI and Energy Consumption Oriented Dynamic Status Updating in Caching Enabled IoT Networks

Optimal Status Updates for Minimizing Age of Correlated Information in IoT Networks with Energy Harvesting Sensors

Status Update for Correlated Energy Harvesting Sensors: A Deep Reinforcement Learning Approach.

Deep Reinforcement Learning for IoT Networks: Age of Information and Energy Cost Tradeoff

AoI and Energy-Driven Dynamic Cache Updates for Wireless Edge Networks

Deep reinforcement learning for IoT cache updating based on age of incorrect information

AoI Minimization in Status Update Control with Energy Harvesting Sensors

Energy Efficient Cache Update and Content Delivery for Optimizing Information Freshness of Industrial Applications

Reinforcement Learning for Optimizing Age of Information and Energy Consumption in Misson-critical IoT

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach

Cost Efficient Intelligent Sensing Big Data Caching in ICN-IoT Networks.

Distributed Reinforcement Learning for Optimizing Age of Information and Energy Consumption in Wireless Powered IoT Systems.

Average AoI Minimization for Energy Harvesting Relay-aided Status Update Network Using Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Dynamic Contents Caching in HetNets

Dynamic Content Caching Based on Actor-Critic Reinforcement Learning for IoT Systems.

DQN Inspired Joint Computing and Caching Resource Allocation Approach for Software Defined Information-Centric Internet of Things Network

Request Oriented Cache Update for Age of Information Minimization in Industrial Control Systems.

Deep Reinforcement Learning-Based Joint Caching and Routing in AI-Driven Networks