Optimizing Microservices Placement in the Cloud-to-Edge Continuum: A Comparative Analysis of App and Service Based Approaches

Miguel Mota-Cruz,João H Santos,José F Macedo,Karima Velasquez,David Perez Abreu

DOI: https://doi.org/10.1109/MELECON56669.2024.10608552

2024-12-02

Abstract:In the ever-evolving landscape of computing, the advent of edge and fog computing has revolutionized data processing by bringing it closer to end-users. While cloud computing offers numerous advantages, including mobility, flexibility and scalability, it introduces challenges such as latency. Fog and edge computing emerge as complementary solutions, bridging the gap and enhancing services' proximity to users. The pivotal challenge addressed in this paper revolves around optimizing the placement of application microservices to minimize latency in the cloud-to-edge continuum, where a proper node selection may influence the app's performance. Therefore, this task gains complexity due to the paradigm shift from monolithic to microservices-based architectures. Two distinct placement approaches, app-based and service-based, are compared through four different placement algorithms based on criteria such as link latency, node resources, and gateway proximity. App-based allocates all the services of one app sequentially, while service-based allocates one service of each app at a time. The study, conducted using YAFS (Yet Another Fog Simulator), evaluates the impact of these approaches on latency and load balance. The findings consistently confirm the hypothesis that strategies utilizing a service-based approach outperformed or performed equally well compared to app-based approaches, offering valuable insights into trade-offs and performance differences among the algorithms and each approach in the context of efficient microservices placement in cloud-to-edge environments.

Networking and Internet Architecture

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is **optimizing the deployment location of microservices in the cloud - edge continuum (the continuum from cloud to edge) to minimize latency**. Specifically, with the development of edge computing and fog computing, how to reasonably select nodes in these distributed environments to deploy microservices, thereby improving application performance and reducing latency, has become a key challenge.

### Problem Background

1. **Advantages and Challenges of Cloud Computing**:
- Cloud computing provides flexibility, scalability, and mobility.
- But it introduces the problem of high latency, especially in application scenarios that require real - time data processing.

2. **The Role of Edge Computing and Fog Computing**:
- Edge computing and fog computing make up for the high - latency problem of cloud computing by bringing computing resources closer to the user end.
- These technologies bring lower latency and a better user experience.

3. **The Rise of the Microservice Architecture**:
- The transition from a monolithic architecture to a microservice architecture allows applications to be decomposed into multiple independent services.
- This architecture improves scalability and flexibility, but also increases the complexity of deployment and management.

### Core Problems of the Paper

- **Optimizing Microservice Deployment Locations**: How to select the optimal nodes in the continuum from cloud to edge to deploy microservices in order to minimize latency.
- **Comparison of Two Deployment Methods**: The paper compares two deployment methods, app - based and service - based, and evaluates their impact on latency and load balancing.

### Research Hypotheses

- **Service - Based Deployment is Superior to App - Based Deployment**: The paper assumes that in high - load scenarios, the service - based deployment method can better reduce overall latency, ensure more consistent application performance, and reduce user response time.

### Methodology

- **Simulation Tools**: Use Yet Another Fog Simulator (YAFS) for simulation.
- **Evaluation Metrics**: Mainly focus on latency and load balancing.
- **Four Algorithms**: Evaluate the effects of the two deployment methods through different placement algorithms (such as Greedy Latency, Greedy Free RAM, Close to Gateway, and Round - Robin IPT).

### Conclusions

- **Service - Based Deployment Performs Better**: The research results show that in most cases, the service - based deployment method performs better in reducing latency and can maintain a more uniform performance distribution in high - load scenarios.
- **Suggestions for Future Research**: Future research can further optimize placement algorithms and explore more optimization criteria and goals, while considering issues such as privacy and network resilience.

Through the above analysis, the paper aims to provide valuable insights for microservice deployment in cloud - to - edge environments, especially for optimizing system performance in real - time data processing scenarios.