Abstract:Containers are standalone, self-contained units that package software and its dependencies together. They offer lightweight performance isolation, fast and flexible deployment, and fine-grained resource sharing. They have gained popularity in better application management and deployment in recent years and are being widely used by organizations to deploy their increasingly diverse workloads such as web services, big data, and IoT in either proprietary clusters or cloud data centres. This has led to the emergence of container orchestration platforms, which are designed to manage the deployment of containerized applications in large-scale clusters. The majority of these platforms are tailored to optimize the scheduling of containers on a fixed-sized private cluster but are not enabled to autoscale the size of the cluster nor to consider features specific to public cloud environments. In this work, we propose a comprehensive container resource management approach that has three different objectives. The first one is to optimize the initial placement of containers by efficiently scheduling them on existing resources. The second one is to autoscale the number of resources at runtime based on the current cluster's workload. The third one is a rescheduling mechanism to further support the efficient use of resources by consolidating applications into fewer VMs when possible. Our algorithms are implemented as a plugin-scheduler for Kubernetes platform. We evaluated our framework and the effectiveness of the proposed algorithms on an Australian national cloud infrastructure. Our experiments demonstrate that considerable cost savings can be achieved by dynamically managing the cluster size and placement of applications. We find that our proposed approaches are capable of reducing the cost by 58% when compared to the default Kubernetes scheduler.

Research on Resource Prediction Model Based on Kubernetes Container Auto-scaling Technology

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Dynamically Adjusting Scale of a Kubernetes Cluster under QoS Guarantee

A Trend Detection-Based Auto-Scaling Method for Containers in High-Concurrency Scenarios

Toward Optimal Load Prediction and Customizable Autoscaling Scheme for Kubernetes

CRUPA: A container resource utilization prediction algorithm for auto-scaling based on time series analysis

Real-time Prediction of Docker Container Resource Load Based on A Hybrid Model of ARIMA and Triple Exponential Smoothing

An Efficient Load Prediction-Driven Scheduling Strategy Model in Container Cloud.

Predicting Resource Consumption of Kubernetes Container Systems using Resource Models

LP-HPA: Load Predict-Horizontal Pod Autoscaler for Container Elastic Scaling.

Self-adaptive Approach for Container-based Cloud Resources Management

An Auto-Scaling Framework for Containerized Elastic Applications

Containers Orchestration with Cost-Efficient Autoscaling in Cloud Computing Environments

Hybrid Autoscaling Strategy on Container-Based Cloud Platform

A Novel Hybrid Model for Docker Container Workload Prediction

Load Prediction-Based Automatic Scaling Cloud Computing

Auto-Scaling Provision Basing on Workload Prediction in the Virtualized Data Center

AHPA: Adaptive Horizontal Pod Autoscaling Systems on Alibaba Cloud Container Service for Kubernetes

Resource Management Schemes for Cloud-Native Platforms with Computing Containers of Docker and Kubernetes

Research on optimization strategy of container orchestration technology for cloud computing environment