Abstract:In modern cloud environments, container orchestration tools are essential for effectively managing diverse workloads and services, and Kubernetes has become the de facto standard tool for automating the deployment, scaling, and operation of containerized applications. While Kubernetes plays an important role in optimizing and managing the deployment of diverse services and applications, its default scheduling approach, which is not optimized for all types of workloads, can often result in poor performance and wasted resources. This is particularly true in environments with complex interactions between services, such as microservice architectures. The traditional Kubernetes scheduler makes scheduling decisions based on CPU and memory usage, but the limitation of this arrangement is that it does not fully account for the performance and resource efficiency of the application. As a result, the communication latency between services increases, and the overall system performance suffers. Therefore, a more sophisticated and adaptive scheduling method is required. In this work, we propose an adaptive pod placement optimization technique using multi-tier inspection to address these issues. The proposed technique collects and analyzes multi-tier data to improve application performance and resource efficiency, which are overlooked by the default Kubernetes scheduler. It derives optimal placements based on the coupling and dependencies between pods, resulting in more efficient resource usage and better performance. To validate the performance of the proposed method, we configured a Kubernetes cluster in a virtualized environment and conducted experiments using a benchmark application with a microservice architecture. The experimental results show that the proposed method outperforms the existing Kubernetes scheduler, reducing the average response time by up to 11.5% and increasing the number of requests processed per second by up to 10.04%. This indicates that the proposed method minimizes the inter-pod communication delay and improves the system-wide resource utilization. This research aims to optimize application performance and increase resource efficiency in cloud-native environments, and the proposed technique can be applied to different cloud environments and workloads in the future to provide more generalized optimizations. This is expected to contribute to increasing the operational efficiency of cloud infrastructure and improving the quality of service.

Kubernetes-Oriented Microservice Placement with Dynamic Resource Allocation

Cost-Optimized Microservice Deployment for IoT Application in Cloud-Edge Collaborative Environment.

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Dynamically Adjusting Scale of a Kubernetes Cluster under QoS Guarantee

ChainsFormer: A Chain Latency-aware Resource Provisioning Approach for Microservices Cluster

OOSP: Opportunistic Optimization Scheme for Pod Deployment Enhanced with Multilayered Sensing

Cost Minimization in Multi-cloud Systems with Runtime Microservice Re-orchestration

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

Efficient Resource Allocation in Kubernetes Using Machine Learning

An Efficient Algorithm for Microservice Placement in Cloud-Edge Collaborative Computing Environment

Optimizing Cloud Performance: A Microservice Scheduling Strategy for Enhanced Fault-Tolerance, Reduced Network Traffic, and Lower Latency

Dynamic Fine-Grained Resource Provisioning for Heterogeneous Applications in Virtualized Cloud Data Center

Practice of Alibaba Cloud on Elastic Resource Provisioning for Large-scale Microservices Cluster

Network-Aware Reliability Modeling and Optimization for Microservice Placement

A NSGA-II-based Approach for Multi-objective Micro-service Allocation in Container-based Clouds

On the Joint Design of Microservice Deployment and Routing in Cloud Data Centers

Optimal Resource Allocation Using Genetic Algorithm in Container-Based Heterogeneous Cloud

Runtime Resource Management for Microservices-Based Applications: A Congestion Game Approach (Short Paper)

Cdascaler: a cost-effective dynamic autoscaling approach for containerized microservices

TraDE: Network and Traffic-aware Adaptive Scheduling for Microservices Under Dynamics

Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center