Low-Latency Layer-Aware Proactive and Passive Container Migration in Meta Computing

Mengjie Liu,Yihua Li,Fangyi Mou,Zhiqing Tang,Jiong Lou,Jianxiong Guo,Weijia Jia
2024-06-19
Abstract:Meta computing is a new computing paradigm that aims to efficiently utilize all network computing resources to provide fault-tolerant, personalized services with strong security and privacy guarantees. It also seeks to virtualize the Internet as many meta computers. In meta computing, tasks can be assigned to containers at edge nodes for processing, based on container images with multiple layers. The dynamic and resource-constrained nature of meta computing environments requires an optimal container migration strategy for mobile users to minimize latency. However, the problem of container migration in meta computing has not been thoroughly explored. To address this gap, we present low-latency, layer-aware container migration strategies that consider both proactive and passive migration. Specifically: 1) We formulate the container migration problem in meta computing, taking into account layer dependencies to reduce migration costs and overall task duration by considering four delays. 2) We introduce a reinforcement learning algorithm based on policy gradients to minimize total latency by identifying layer dependencies for action selection, making decisions for both proactive and passive migration. Expert demonstrations are introduced to enhance exploitation. 3) Experiments using real data trajectories show that the algorithm outperforms baseline algorithms, achieving lower total latency.
Distributed, Parallel, and Cluster Computing
What problem does this paper attempt to address?
The paper aims to address the issue of container migration in a Meta computing environment. Specifically, the research focuses on how to achieve low-latency, layer-aware proactive and reactive container migration strategies in resource-constrained and dynamically changing environments. ### Main Issues: 1. **Optimization of Container Migration Cost**: In Meta computing, due to the heterogeneity of edge nodes and user mobility, container migration needs to fully consider the layer-sharing characteristics of container images to reduce migration costs and overall task processing time. 2. **Joint Proactive and Reactive Migration Decisions**: How to make both proactive migration (migrating containers based on the resource state of nodes) and reactive migration (service migration based on user movement beyond the communication range) decisions in a Meta computing environment. ### Specific Goals: - Propose a new Proactive and Reactive Container Migration (PPCM) algorithm based on layer awareness, utilizing Proximal Policy Optimization (PPO) to minimize total latency. - Use Deep Cross Networks (DCN) to extract layer features to more effectively capture sparse layer-sharing information. - Combine expert experience to accelerate the algorithm training process and improve migration decision efficiency. Through these methods, the paper aims to address the shortcomings of existing container migration strategies, thereby achieving better performance in practical applications. Experimental results show that the proposed algorithm outperforms baseline algorithms in various scenarios.