Abstract:In modern cloud environments, container orchestration tools are essential for effectively managing diverse workloads and services, and Kubernetes has become the de facto standard tool for automating the deployment, scaling, and operation of containerized applications. While Kubernetes plays an important role in optimizing and managing the deployment of diverse services and applications, its default scheduling approach, which is not optimized for all types of workloads, can often result in poor performance and wasted resources. This is particularly true in environments with complex interactions between services, such as microservice architectures. The traditional Kubernetes scheduler makes scheduling decisions based on CPU and memory usage, but the limitation of this arrangement is that it does not fully account for the performance and resource efficiency of the application. As a result, the communication latency between services increases, and the overall system performance suffers. Therefore, a more sophisticated and adaptive scheduling method is required. In this work, we propose an adaptive pod placement optimization technique using multi-tier inspection to address these issues. The proposed technique collects and analyzes multi-tier data to improve application performance and resource efficiency, which are overlooked by the default Kubernetes scheduler. It derives optimal placements based on the coupling and dependencies between pods, resulting in more efficient resource usage and better performance. To validate the performance of the proposed method, we configured a Kubernetes cluster in a virtualized environment and conducted experiments using a benchmark application with a microservice architecture. The experimental results show that the proposed method outperforms the existing Kubernetes scheduler, reducing the average response time by up to 11.5% and increasing the number of requests processed per second by up to 10.04%. This indicates that the proposed method minimizes the inter-pod communication delay and improves the system-wide resource utilization. This research aims to optimize application performance and increase resource efficiency in cloud-native environments, and the proposed technique can be applied to different cloud environments and workloads in the future to provide more generalized optimizations. This is expected to contribute to increasing the operational efficiency of cloud infrastructure and improving the quality of service.

Cost-efficient scheduling algorithms based on beetle antennae search for containerized applications in Kubernetes clouds

Cost-Optimized Microservice Deployment for IoT Application in Cloud-Edge Collaborative Environment.

A Real Time Vehicle Scheduling Strategy in Container Terminals

Task Scheduling in Cloud Computing Based on The Cuckoo Search Algorithm

Dynamically Adjusting Scale of a Kubernetes Cluster under QoS Guarantee

Zeus: Improving Resource Efficiency Via Workload Colocation for Massive Kubernetes Clusters

A Cost-Efficient Container Orchestration Strategy in Kubernetes-Based Cloud Computing Infrastructures with Heterogeneous Resources

A survey of Kubernetes scheduling algorithms

Containers Orchestration with Cost-Efficient Autoscaling in Cloud Computing Environments

A priority-aware scheduling framework for heterogeneous workloads in container-based cloud

Scheduling Applications on Containers Based on Dependency of The Applications

A Global Cost-Aware Container Scheduling Strategy in Cloud Data Centers

Container Scheduling Algorithms for Distributed Cloud Environments

OOSP: Opportunistic Optimization Scheme for Pod Deployment Enhanced with Multilayered Sensing

Container-Based Task Scheduling for Edge Computing Using A Multi-strategy Hybrid of Genetic Beetles

Energy-aware application scheduling based on genetic algorithm.

Collaborative Scheduling Optimization of Container Port Berths and Cranes under Low-Carbon Environment

An Improved Kubernetes Scheduling Algorithm for Deep Learning Platform

Adaptive Scheduling Framework of Streaming Applications based on Resource Demand Prediction with Hybrid Algorithms

A heuristic multi-objective task scheduling framework for container-based clouds via actor-critic reinforcement learning