Abstract:As an emerging service architecture, microservice enables decomposition of a monolithic web service into a set of independent lightweight services which can be executed independently. With mobile edge computing, microservices can be further deployed in edge clouds dynamically, launched quickly, and migrated across edge clouds easily, providing better services for users in proximity. However, the user mobility can result in frequent switch of nearby edge clouds, which increases the service delay when users move away from their serving edge clouds. To address this issue, this article investigates microservice coordination among edge clouds to enable seamless and real-time responses to service requests from mobile users. The objective of this work is to devise the optimal microservice coordination scheme which can reduce the overall service delay with low costs. To this end, we first propose a dynamic programming-based offline microservice coordination algorithm, that can achieve the globally optimal performance. However, the offline algorithm heavily relies on the availability of the prior information such as computation request arrivals, time-varying channel conditions and edge cloud's computation capabilities required, which is hard to be obtained. Therefore, we reformulate the microservice coordination problem using Markov decision process framework and then propose a reinforcement learning-based online microservice coordination algorithm to learn the optimal strategy. Theoretical analysis proves that the offline algorithm can find the optimal solution while the online algorithm can achieve near-optimal performance. Furthermore, based on two real-world datasets, i.e., the Telecom's base station dataset and Taxi Track dataset from Shanghai, experiments are conducted. The experimental results demonstrate that the proposed online algorithm outperforms existing algorithms in terms of service delay and migration costs, and the achieved performance is close to the optimal performance obtained by the offline algorithm.

Graph Neural Network Aided Deep Reinforcement Learning for Microservice Deployment in Cooperative Edge Computing

On Adaptive Edge Microservice Placement: A Reinforcement Learning Approach Endowed with Graph Comprehension

Dependency-Aware Microservice Deployment for Edge Computing: A Deep Reinforcement Learning Approach with Network Representation

Deep Reinforcement Learning for Dependency-aware Microservice Deployment in Edge Computing.

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

Joint Optimization of Microservice Deployment and Routing in Edge Via Multi-Objective Deep Reinforcement Learning

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

IoT Microservice Deployment in Edge-Cloud Hybrid Environment Using Reinforcement Learning

Microservice Selection in Edge-Cloud Collaborative Environment: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Joint Service Placement and Request Scheduling in Mobile Edge Computing Networks.

Offloading Strategy Based on Graph Neural Reinforcement Learning in Mobile Edge Computing

Delay-Aware Optimization of Fine-Grained Microservice Deployment and Routing in Edge via Reinforcement Learning

Transfer Learning Based Algorithm for Service Deployment Under Microservice Architecture

Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Cooperative Task Offloading for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning

Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions

Delay-Aware Microservice Coordination in Mobile Edge Computing: A Reinforcement Learning Approach

Componentized Task Scheduling in Cloud-Edge Cooperative Scenarios Based on GNN-enhanced DRL.

Collaborative on-demand dynamic deployment via deep reinforcement learning for IoV service in multi edge clouds

Drag-JDEC: A Deep Reinforcement Learning and Graph Neural Network-based Job Dispatching Model in Edge Computing