Abstract:Mobile edge computing becomes a promising technology to mitigate the latency of various cloud services. In addition, network function virtualization (NFV) has been shown a great potential in reducing the operational cost of cloud services while enhancing the flexibility of virtual network function deployments, by implementing dedicated hardware network functions as pieces of software in generic servers. Recently, the GPU acceleration has been investigated to speed up flow processing in virtual network functions (VNFs), by leveraging the parallelism of GPUs. VNFs that need accelerations prefer to stay at cloudlets (locations) equipped with GPUs. However, little attention has been paid for the VNF placement that takes into account GPU-affinity in cloudlets of mobile edge clouds. In this paper, we consider the affinity-aware throughput maximization problem in a mobile edge cloud via leveraging the parallelism on GPUs for user requests with VNF requirements. We consider two types of affinities in the VNF placement: The soft-affinity that allows VNFs to be executed by either CPUs or GPUs in cloudlets; and the hard-affinity that only allows VNFs to be placed to the GPUs of a specified set of cloudlets. We formulate two corresponding VNF placement problems in a mobile edge cloud. Specifically, we first propose an exact solution to the soft-affinity throughput maximization problem by formulating an Integer Linear Program (ILP). We then propose an efficient algorithm for the problem, by proposing a randomized algorithm with a provable approximation ratio for the hard-affinity-aware throughput maximization problem and extending the proposed approximation algorithm to the soft-affinity throughput maximization problem. Furthermore, assuming that user requests arrive into the mobile edge cloud one by one without the knowledge of future arrivals, we devise an online algorithm with a good competitive ratio for this dynamic hard-affinity-aware throughput maximization problem. Finally, we evaluate the performance of the proposed algorithms, through simulations and implementations in a real test-bed. Experimental results show that the performance of the proposed algorithms outperform their existing counterparts and achieve higher throughput.

Enabling Efficient Spatio-Temporal GPU Sharing for Network Function Virtualization

G-NET: Effective GPU Sharing in NFV Systems.

On Efficient Packet Batching and Resource Allocation for GPU Based NFV Acceleration.

A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines.

Gaviss : Boosting the Performance of GPU-Accelerated NFV Systems Via Data Sharing.

Efficient Resource Sharing Through GPU Virtualization on Accelerated High Performance Computing Systems

Grus: Enabling Latency SLOs for GPU-Accelerated NFV Systems

Effective GPU Sharing Under Compiler Guidance

Affinity-Aware VNF Placement in Mobile Edge Clouds Via Leveraging GPUs

FaST-GShare: Enabling Efficient Spatio-Temporal GPU Sharing in Serverless Computing for Deep Learning Inference

Gqos: A QoS-Oriented GPU Virtualization with Adaptive Capacity Sharing

Efficient Sharing and Fine-Grained Scheduling of Virtualized GPU Resources

RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks With Fine-Grain Utilization

Scalable GPU Virtualization with Dynamic Sharing of Graphics Memory Space

Vgasa: Adaptive Scheduling Algorithm of Virtualized GPU Resource in Cloud Gaming

GEN: A GPU-Accelerated Elastic Framework for NFV.

SPGPU: Spatially Programmed GPU

Intra-Cluster Coalescing and Distributed-Block Scheduling to Reduce GPU NoC Pressure.

Efficient GPU Spatial-Temporal Multitasking

ParvaGPU: Efficient Spatial GPU Sharing for Large-Scale DNN Inference in Cloud Environments

Dynamic Space-Time Scheduling for GPU Inference