Abstract:More and more artificial intelligence (AI) applications, such as virtual reality (VR) and video analytics, are rapidly progressing towards enterprise and end-users with the promise of bringing immersive experience. Driven by the desire to improve users’ experience and promote business scenarios, such AI applications have unprecedented requirements for ultra-low latency as well as abundant computing resource in networks. Data centers in the core network can meet these demands by deploying various AI services and providing abundant resources. However, data transmission delay from data centers to end-users is too time-consuming because of traffic congestion in the core network, which compromises the performance of the AI applications. 5G and edge computing are emerging technologies to guarantee the timeliness for the delay-sensitive applications. The delay experienced by AI users can be significantly reduced, by ‘caching’ various services that are initially deployed at data centers to cloudlets in edge networks. Although ubiquitous edge service caching is always preferable for improving user experiences, it is impractical to cache all services from data centers to edge cloudlets, due to often limited caching budget of service providers and resource capacity constraints of cloudlets. Therefore, a service provider has to cautiously decide how many instances of a service can be cached, and where to cache the service instances. In this article, we investigate a fundamental problem of service caching from remote data centers to edge cloudlets in a multi-tiered edge cloud network. We first develop two approximation algorithms with approximation ratios to solve the problem for users demanding a single type of service. We then devise an efficient heuristic to solve the problem that users require different types of services. We finally conduct extensive experiments on a real test-bed to evaluate the performance of the proposed algorithms, and experimental results demonstrate that our algorithms can outperform some existing algorithms significantly.

The Hidden cost of the Edge: A Performance Comparison of Edge and Cloud Latencies

How Far Have Edge Clouds Gone? A Spatial-Temporal Analysis of Edge Network Latency in the Wild.

Large-scale Measurements and Optimizations on Latency in Edge Clouds

Collaborative Cloud and Edge Computing for Latency Minimization

AI-oriented Workload Allocation for Cloud-Edge Computing.

To Edge or Not to Edge?

Edge Cloud System Evaluation

Measuring Latency Reduction and the Digital Divide of Cloud Edge Datacenters

EdgeBench: Benchmarking Edge Computing Platforms

Edge computing vs centralized cloud: Impact of communication latency on the energy consumption of LTE terminal nodes

Application Driven Network Latency Measurement Analysis and Optimization Techniques Edge Computing Environment: A Survey

An empirical study of latency in an emerging class of edge computing applications for wearable cognitive assistance

AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architectures

When Edge Caching Meets a Budget: Near Optimal Service Delivery in Multi-Tiered Edge Clouds.

Towards Power Consumption-Delay Tradeoff by Workload Allocation in Cloud-Fog Computing.

From Cloud to Edge: A First Look at Public Edge Platforms

Resource Provisioning in Edge Computing for Latency Sensitive Applications

Edge-CoCaCo: Toward Joint Optimization of Computation, Caching, and Communication on Edge Cloud

Edge Computing Performance Amplification

At the Edge of a Seamless Cloud Experience

A hybrid edge-cloud architecture for reducing on-demand gaming latency