Abstract:In modern cloud environments, container orchestration tools are essential for effectively managing diverse workloads and services, and Kubernetes has become the de facto standard tool for automating the deployment, scaling, and operation of containerized applications. While Kubernetes plays an important role in optimizing and managing the deployment of diverse services and applications, its default scheduling approach, which is not optimized for all types of workloads, can often result in poor performance and wasted resources. This is particularly true in environments with complex interactions between services, such as microservice architectures. The traditional Kubernetes scheduler makes scheduling decisions based on CPU and memory usage, but the limitation of this arrangement is that it does not fully account for the performance and resource efficiency of the application. As a result, the communication latency between services increases, and the overall system performance suffers. Therefore, a more sophisticated and adaptive scheduling method is required. In this work, we propose an adaptive pod placement optimization technique using multi-tier inspection to address these issues. The proposed technique collects and analyzes multi-tier data to improve application performance and resource efficiency, which are overlooked by the default Kubernetes scheduler. It derives optimal placements based on the coupling and dependencies between pods, resulting in more efficient resource usage and better performance. To validate the performance of the proposed method, we configured a Kubernetes cluster in a virtualized environment and conducted experiments using a benchmark application with a microservice architecture. The experimental results show that the proposed method outperforms the existing Kubernetes scheduler, reducing the average response time by up to 11.5% and increasing the number of requests processed per second by up to 10.04%. This indicates that the proposed method minimizes the inter-pod communication delay and improves the system-wide resource utilization. This research aims to optimize application performance and increase resource efficiency in cloud-native environments, and the proposed technique can be applied to different cloud environments and workloads in the future to provide more generalized optimizations. This is expected to contribute to increasing the operational efficiency of cloud infrastructure and improving the quality of service.

K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives

Dynamically Adjusting Scale of a Kubernetes Cluster under QoS Guarantee

Zeus: Improving Resource Efficiency Via Workload Colocation for Massive Kubernetes Clusters

QoSC: A QoS-Aware Storage Cloud Based on HDFS

Qos-Aware Indiscriminate Volume Storage Cloud

L-QoCo: learning to optimize cache capacity overloading in storage systems

OOSP: Opportunistic Optimization Scheme for Pod Deployment Enhanced with Multilayered Sensing

EdgeOptimizer : A programmable containerized scheduler of time-critical tasks in Kubernetes -based edge-cloud clusters

On the Optimization of Kubernetes toward the Enhancement of Cloud Computing

Towards Optimizing Storage Costs on the Cloud

Flex: Flexible and Energy Efficient Scheduling for Big Data Storage

Teleport: Load Balancing with Dynamic Adjustment Strategy Based on OSD Storage System

Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System

KCES: A Workflow Containerization Scheduling Scheme Under Cloud-Edge Collaboration Framework

Enhancing Edge Environment Scalability: Leveraging Kubernetes for Container Orchestration and Optimization

OctoFAS: A Two-Level Fair Scheduler that Increases Fairness in Network-Based Key-Value Storage

An End-to-end and Adaptive I/O Optimization Tool for Modern HPC Storage Systems

Multi-dimensional storage qos guarantees for an object-based storage system

CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure

Latency Reduction and Load Balancing in Coded Storage Systems