Abstract:The shift from Cloud Computing to a Cloud-Edge continuum presents new opportunities and challenges for data-intensive and interactive applications. Edge computing has garnered a lot of attention from both industry and academia in recent years, emerging as a key enabler for meeting the increasingly strict demands of Next Generation applications. In Edge computing the computations are placed closer to the end-users, to facilitate low-latency and high-bandwidth applications and services. However, the distributed, dynamic, and heterogeneous nature of Edge computing, presents a significant challenge for service placement. A critical aspect of Edge computing involves managing the placement of applications within the network system to minimize each application's runtime, considering the resources available on system devices and the capabilities of the system's network. The placement of application images must be proactively planned to minimize image tranfer time, and meet the strict demands of the applications. In this regard, this paper proposes an approach for proactive image placement that combines Graph Neural Networks and actor-critic Reinforcement Learning, which is evaluated empirically and compared against various solutions. The findings indicate that although the proposed approach may result in longer execution times in certain scenarios, it consistently achieves superior outcomes in terms of application placement.

What problem does this paper attempt to address?

The paper primarily addresses the proactive placement of application images (i.e., deployment packages or images) in edge computing environments. As data-intensive and interactive applications demand lower latency and higher bandwidth, edge computing has become a key technology to meet the needs of these next-generation applications. However, the distributed, dynamic, and heterogeneous nature of edge computing environments poses challenges for service placement. The main issue discussed in the paper focuses on how to effectively manage the placement of application images in the network system to minimize the runtime of each application. Specifically, it is necessary to consider the available resources on system devices and the network capabilities of the system, and proactively plan the placement of application images to reduce image transmission time, thereby meeting the stringent requirements of applications. To address this issue, the paper proposes a method that combines Graph Neural Networks (GNNs) and reinforcement learning based on an actor-critic architecture to achieve proactive application image placement. The goal of this method is to obtain results superior to other solutions in different scenarios, although it may lead to longer execution times in some cases. The paper evaluates the proposed GNOSIS method through experiments and compares it with several existing algorithms, including approximation algorithms, greedy algorithms, and genetic algorithms. Experimental results show that GNOSIS achieves better performance under different network topologies and excels in balancing storage usage and image access latency. Additionally, the study explores the impact of various algorithmic approaches on proactive image placement and comprehensively evaluates algorithm efficiency through multiple metrics, which helps validate its effectiveness in actual edge infrastructure.

Graph Neural Networks and Reinforcement Learning for Proactive Application Image Placement

Multi-objective application placement in fog computing using graph neural network-based reinforcement learning

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments

Efficient Microservice Deployment in the Edge-Cloud Networks With Policy-Gradient Reinforcement Learning

Graph Attention Network Reinforcement Learning Based Computation Offloading in Multi-Access Edge Computing.

GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing

Offloading Strategy Based on Graph Neural Reinforcement Learning in Mobile Edge Computing

Dynamic and intelligent edge server placement based on deep reinforcement learning in mobile edge computing

A novel device placement approach based on position-aware subgraph neural networks

A Dynamic Deep-learning-based Virtual Edge Node Placement Scheme for Edge Cloud Systems in Mobile Environment

Online Placement of Multi-Component Applications in Edge Computing Environments

Graph neural network for in-network placement of real-time metaverse tasks in next-generation network

EdgeVision: Towards Collaborative Video Analytics on Distributed Edges for Performance Maximization

POSEIDON : Efficient Function Placement at the Edge using Deep Reinforcement Learning

Neural-Guided RuntimePrediction of Planners for Improved Motion and Task Planning with Graph Neural Networks

Device Placement for Autonomous Vehicles using Reinforcement Learning

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks

Service Placement for Collaborative Edge Applications