Abstract:In the edge computing environment, Internet of Things (IoT) application service providers can rent resources from edge servers to cache their service items such as datasets and code libraries, and thus significantly reducing the service request latency and the core network traffic. Since IoT service providers need to pay for the rented edge computing resources, it is essential to find a dynamical service caching strategy to minimize the service cost while optimizing the performance objective such as service latency reduction. However, most of the existing studies either overlooked the problem of collaborative service caching or failed to consider the system's long-term service cost and latency. In this paper, to address such a problem, we coordinate multiple edge servers to cache service items and formulate the collaborative service caching problem using a multi-agent multi-armed bandit model. Furthermore, we propose a utility-aware collaborative service caching (UACSC) scheme based on a multi-agent reinforcement learning. The UACSC scheme can coordinate multiple edge servers to make a dynamic joint caching decision, aiming at maximizing the system's long-term utility. To evaluate the performance of our proposed scheme, we implement four representative baseline algorithms and compare them with six different performance metrics. In addition, a real-world case study is also presented to demonstrate the effectiveness of the UACSC scheme. Comprehensive experimental results show that the UACSC scheme can effectively coordinate multiple edge servers to cache service items, and achieve higher service latency reduction and lower service cost compared with other baseline algorithms. (C) 2022 Elsevier Inc. All rights reserved.

Federated Multi-Agent Reinforcement Learning for Collaborative Edge Caching in Content Delivery Networks

Personalized Federated Deep Reinforcement Learning for Heterogeneous Edge Content Caching Networks

Federated Reinforcement Learning with Adaptive Training Times for Edge Caching

Partially Collaborative Edge Caching Based on Federated Deep Reinforcement Learning

Cooperative Edge Caching Via Federated Deep Reinforcement Learning in Fog-RANs.

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

Personalized Collaborative Edge Caching with Federated Transfer Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning based Cooperative Edge Data Caching Approach

A Federated Deep Reinforcement Learning-based Low-power Caching Strategy for Cloud-edge Collaboration

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Federated Deep Reinforcement Learning for Recommendation-Enabled Edge Caching in Mobile Edge-Cloud Computing Networks

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching

Multi-Agent Reinforcement Learning for Cooperative Edge Caching in Heterogeneous Networks.

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

Reinforcement learning for cost-effective IoT service caching at the edge

Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

Cooperative Edge Caching Via Multi Agent Reinforcement Learning in Fog Radio Access Networks

Jointly Optimal Caching and Routing Using Multi-Agent Reinforcement Learning

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.