Abstract:Microservices are an architectural and organizational paradigm for Internet application development. In cloud data centers, delay-sensitive applications receive massive user requests, which are fed into multiple queues and subsequently served by multiple microservice instances. Accordingly, effective deployment of multiple queues and containers can significantly reduce queuing delay, processing delay, and communication delay. Due to the increased complexity of call dependencies and probabilistic routing paths, the deployment of service instances fully interacts with request routing, bringing great difficulties to service orchestration. In this case, it is valuable to simultaneously consider service deployment and request routing in a fine-grained manner. However, most existing studies considered them as two independent components with local optimization, while data dependencies and the instance-level deployment are ignored. Therefore, this paper proposes to jointly optimize the deployment and request routing of microservice call graphs based on fine-grained queuing network analysis and container orchestration. We first formulate the problem as a mixed-integer nonlinear program and exploit open Jackson queuing networks to model intrinsic data dependencies and analyze response latency. To optimize the overall cost and latency, this paper presents an efficient two-stage heuristic algorithm, which consists of a resource-splitting-based deployment approach and a partition-mapping-based routing method. Further, this paper also provides mathematical analysis on the performance and complexity of the proposed algorithm. Finally, comprehensive trace-driven experiments demonstrate that the overall performance of our approach is better than existing microservice benchmarks. The average deployment cost is reduced by 27.4% and end-to-end response latency is reduced by 15.1% on average.

Joint Optimization of Microservice Deployment and Routing in Edge Via Multi-Objective Deep Reinforcement Learning

Delay-Aware Optimization of Fine-Grained Microservice Deployment and Routing in Edge via Reinforcement Learning

Joint Optimization of Service Deployment and Request Routing for Microservices in Mobile Edge Computing

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems Via Multi-Agent Deep Reinforcement Learning

A Multi-update Deep Reinforcement Learning Algorithm for Edge Computing Service Offloading

IoT Microservice Deployment in Edge-Cloud Hybrid Environment Using Reinforcement Learning

A Joint Service Migration and Mobility Optimization Approach for Vehicular Edge Computing

Service Routing in Multi-Tier Edge Computing: A Matching Game Approach

Joint Optimization of Service Migration and Resource Allocation in Mobile Edge–Cloud Computing

On the Joint Design of Microservice Deployment and Routing in Cloud Data Centers

Deep Reinforcement Learning for Joint Service Placement and Request Scheduling in Mobile Edge Computing Networks.

Joint Application Placement and Request Routing Optimization for Dynamic Edge Computing Service Management

A Dynamic Service Placement Based on Deep Reinforcement Learning in Mobile Edge Computing

Joint Deployment and Request Routing for Microservice Call Graphs in Data Centers

Edge Dynamic Service Offloading Based on Multi-agent Deep Q Learning.

Graph Neural Network Aided Deep Reinforcement Learning for Microservice Deployment in Cooperative Edge Computing

Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing

Joint Optimization for MEC Computation Offloading and Resource Allocation in IoV Based on Deep Reinforcement Learning