Abstract:The rise of user-centric design demands ubiquitous access to infrastructure and applications, facilitated by the Edge-Cloud network and microservices. However, efficiently managing resource allocation while orchestrating microservice placement in such dynamic environments presents a significant challenge. These challenges stem from the limited resources of edge devices, the need for low latency responses, and the potential for performance degradation due to service failures or inefficient deployments. This paper addresses the challenge of microservice placement in Edge-Cloud environments by proposing a novel Reinforcement Learning algorithm called Bi-Generic Advantage Actor-Critic for Microservice Placement Policy. This algorithm's ability to learn and adapt to the dynamic environment makes it well-suited for optimizing resource allocation and service placement decisions within the Edge-Cloud. We compare this algorithm against three baseline algorithms through simulations on a real-world dataset, evaluating performance metrics such as execution time, network usage, average migration delay, and energy consumption. The results demonstrate the superiority of the proposed method, with an 8% reduction in execution time, translating to faster response times for users. Additionally, it achieves a 4% decrease in network usage and a 2% decrease in energy consumption compared to the best-performing baseline. This research contributes by reproducing the Edge-Cloud environment, applying the novel Bi-Generic Advantage Actor-Critic technique, and demonstrating significant improvements over the state-of-the-art baseline algorithms in microservice placement and resource management within Edge-Cloud environments.

Microservice Deployment in Cloud-Edge Environment Using Enhanced Global Search Grey Wolf Optimizer-Greedy Algorithm

Cost-Optimized Microservice Deployment for IoT Application in Cloud-Edge Collaborative Environment.

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Cost‐optimized Internet of Things Application Deployment in Edge Computing Environment

TP-MDU: A Two-Phase Microservice Deployment Based on Minimal Deployment Unit in Edge Computing Environment

Dynamic Microservice Deployment and Offloading for Things-Edge-Cloud Computing

IoT Microservice Deployment in Edge-Cloud Hybrid Environment Using Reinforcement Learning

Dynamical Service Deployment and Replacement in Resource-Constrained Edges

Efficient Microservice Deployment in the Edge-Cloud Networks With Policy-Gradient Reinforcement Learning

Deep reinforcement learning-based microservice selection in mobile edge computing

Research on Offloading Strategy for Mobile Edge Computing Based on Improved Grey Wolf Optimization Algorithm

Service Capacity Enhanced Task Offloading and Resource Allocation in Multi-Server Edge Computing Environment

Microservice Selection in Edge-Cloud Collaborative Environment: A Deep Reinforcement Learning Approach

Offloading Algorithm for Edge Computing Tasks Based on Energy Optimization

Deploying Data-intensive Applications with Multiple Services Components on Edge.

Online Deployment Algorithms for Microservice Systems with Complex Dependencies

Cost-Minimized Computation Offloading and User Association in Hybrid Cloud and Edge Computing

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

Request Dispatching for Minimizing Service Response Time in Edge Cloud Systems

An Optimized Greedy-Based Task Offloading Method for Mobile Edge Computing

Service Configuration Optimization in Edge–Cloud Networks Leveraging Log Analysis