Abstract:In the edge computing environment, Internet of Things (IoT) application service providers can rent resources from edge servers to cache their service items such as datasets and code libraries, and thus significantly reducing the service request latency and the core network traffic. Since IoT service providers need to pay for the rented edge computing resources, it is essential to find a dynamical service caching strategy to minimize the service cost while optimizing the performance objective such as service latency reduction. However, most of the existing studies either overlooked the problem of collaborative service caching or failed to consider the system's long-term service cost and latency. In this paper, to address such a problem, we coordinate multiple edge servers to cache service items and formulate the collaborative service caching problem using a multi-agent multi-armed bandit model. Furthermore, we propose a utility-aware collaborative service caching (UACSC) scheme based on a multi-agent reinforcement learning. The UACSC scheme can coordinate multiple edge servers to make a dynamic joint caching decision, aiming at maximizing the system's long-term utility. To evaluate the performance of our proposed scheme, we implement four representative baseline algorithms and compare them with six different performance metrics. In addition, a real-world case study is also presented to demonstrate the effectiveness of the UACSC scheme. Comprehensive experimental results show that the UACSC scheme can effectively coordinate multiple edge servers to cache service items, and achieve higher service latency reduction and lower service cost compared with other baseline algorithms. (C) 2022 Elsevier Inc. All rights reserved.

Cooperative Edge-Cloud Caching for Real-time Sensing Big Data Search in Vehicular Networks.

Real-Time Search-Driven Caching for Sensing Data in Vehicular Networks

Cooperative Service Caching in Vehicular Edge Computing Networks Based on Transportation Correlation Analysis

Joint Edge Offloading and Caching for Cooperation Scheme Reasearch

Edge collaborative caching solution based on improved NSGA II algorithm in Internet of Vehicles

Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks.

Cooperative Edge Caching with Location-Based and Popular Contents for Vehicular Networks.

A joint optimization scheme of content caching and resource allocation for internet of vehicles in mobile edge computing

Online Pricing-based Content Cache Trading for Multi-Provider Vehicular Networks

Digital Twin Empowered Content Caching in Social-Aware Vehicular Edge Networks.

An Adaptive Cooperative Caching Strategy for Vehicular Networks

Efficient Caching in Vehicular Edge Computing Based on Edge-Cloud Collaboration

Reinforcement learning for cost-effective IoT service caching at the edge

Collaborative Edge Computing and Caching in Vehicular Networks

An Edge Caching Scheme to Distribute Content in Vehicular Networks

Proactive Content Caching Scheme in Urban Vehicular Networks

Cooperative Edge Caching Based on Temporal Convolutional Networks

A Mobility-Aware Vehicular Caching Scheme in Content Centric Networks: Model and Optimization

Edge Caching to Deliver Mobile Content in Vehicular Ad Hoc Networks

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Cooperative Content Caching in 5G Networks with Mobile Edge Computing.