Abstract:More and more artificial intelligence (AI) applications, such as virtual reality (VR) and video analytics, are rapidly progressing towards enterprise and end-users with the promise of bringing immersive experience. Driven by the desire to improve users’ experience and promote business scenarios, such AI applications have unprecedented requirements for ultra-low latency as well as abundant computing resource in networks. Data centers in the core network can meet these demands by deploying various AI services and providing abundant resources. However, data transmission delay from data centers to end-users is too time-consuming because of traffic congestion in the core network, which compromises the performance of the AI applications. 5G and edge computing are emerging technologies to guarantee the timeliness for the delay-sensitive applications. The delay experienced by AI users can be significantly reduced, by ‘caching’ various services that are initially deployed at data centers to cloudlets in edge networks. Although ubiquitous edge service caching is always preferable for improving user experiences, it is impractical to cache all services from data centers to edge cloudlets, due to often limited caching budget of service providers and resource capacity constraints of cloudlets. Therefore, a service provider has to cautiously decide how many instances of a service can be cached, and where to cache the service instances. In this article, we investigate a fundamental problem of service caching from remote data centers to edge cloudlets in a multi-tiered edge cloud network. We first develop two approximation algorithms with approximation ratios to solve the problem for users demanding a single type of service. We then devise an efficient heuristic to solve the problem that users require different types of services. We finally conduct extensive experiments on a real test-bed to evaluate the performance of the proposed algorithms, and experimental results demonstrate that our algorithms can outperform some existing algorithms significantly.

When Edge Caching Meets a Budget: Near Optimal Service Delivery in Multi-Tiered Edge Clouds.

AI-oriented Workload Allocation for Cloud-Edge Computing.

Data Caching Optimization in the Edge Computing Environment

Near-Optimal and Collaborative Service Caching in Mobile Edge Clouds

QoE-aware Data Caching Optimization with Budget in Edge Computing

A multi-stage heuristic method for service caching and task offloading to improve the cooperation between edge and cloud computing

Collaborate or Separate? Distributed Service Caching in Mobile Edge Clouds

To Cache or Not to Cache: Stable Service Caching in Mobile Edge-Clouds of a Service Market

Proactive Data Caching and Replacement in the Edge Computing Environment

Data-driven Approaches to Edge Caching

Stable Service Caching in MECs of Hierarchical Service Markets with Uncertain Request Rates

Efficient Virtual Resource Allocation in Mobile Edge Networks Based on Machine Learning

A Hybrid Task Offloading and Service Cache Scheme for Vehicular Edge Computing

Joint Optimization of Service Caching Task Offloading and Resource Allocation in Cloud-Edge Cooperative Network

Edge-CoCaCo: Toward Joint Optimization of Computation, Caching, and Communication on Edge Cloud

Virtual Service Placement for Edge Computing under Finite Memory and Bandwidth

ECC: Edge Collaborative Caching Strategy for Differentiated Services Load-Balancing

Storage-Efficient Edge Caching With Asynchronous User Requests

Multi-Request Data Cache Optimization Strategy in Edge Computing.

A3C-based Computation Offloading and Service Caching in Cloud-Edge Computing Networks

Efficient Cooperative Cache Management for Latency-Aware Data Intelligent Processing in Edge Environment.