Abstract:Containers are standalone, self-contained units that package software and its dependencies together. They offer lightweight performance isolation, fast and flexible deployment, and fine-grained resource sharing. They have gained popularity in better application management and deployment in recent years and are being widely used by organizations to deploy their increasingly diverse workloads such as web services, big data, and IoT in either proprietary clusters or cloud data centres. This has led to the emergence of container orchestration platforms, which are designed to manage the deployment of containerized applications in large-scale clusters. The majority of these platforms are tailored to optimize the scheduling of containers on a fixed-sized private cluster but are not enabled to autoscale the size of the cluster nor to consider features specific to public cloud environments. In this work, we propose a comprehensive container resource management approach that has three different objectives. The first one is to optimize the initial placement of containers by efficiently scheduling them on existing resources. The second one is to autoscale the number of resources at runtime based on the current cluster's workload. The third one is a rescheduling mechanism to further support the efficient use of resources by consolidating applications into fewer VMs when possible. Our algorithms are implemented as a plugin-scheduler for Kubernetes platform. We evaluated our framework and the effectiveness of the proposed algorithms on an Australian national cloud infrastructure. Our experiments demonstrate that considerable cost savings can be achieved by dynamically managing the cluster size and placement of applications. We find that our proposed approaches are capable of reducing the cost by 58% when compared to the default Kubernetes scheduler.

Quantifying Cloud Elasticity with Container-Based Autoscaling

Quantifying Cloud Elasticity on Smart Devices with Container-based Autoscaling

Elastic Application Container: A Lightweight Approach for Cloud Resource Provisioning

An Auto-Scaling Framework for Containerized Elastic Applications

On Elasticity Measurement in Cloud Computing

Containers Orchestration with Cost-Efficient Autoscaling in Cloud Computing Environments

Containerized Workflow Framework Supporting Elastic Scaling in Cloud Environment

Enabling cost-aware and adaptive elasticity of multi-tier cloud applications

HCA Operator: A Hybrid Cloud Auto-scaling Tooling for Microservice Workloads.

On the Performance and Power Consumption Analysis of Elastic Clouds.

Characterizing and Balancing the Workloads of Semi-Containerized Clouds

Elastic deployment of container clusters across geographically distributed cloud data centers for web applications

A Framework To Measure Storage Utilization In Cloud Storage Systems

Quantitative Evaluation of Cloud Elasticity Based on Fuzzy Analytic Hierarchy Process

Cost-efficient Auto-scaling of Container-based Elastic Processes

Bridging Ecology and Cloud: Transposing Ecological Prespective to Enable Better Cloud Autoscaling

Investigations into Elasticity in Cloud Computing

Autoscaling Solutions for Cloud Applications under Dynamic Workloads

A Resource Elastic Scaling Method of Cloud Platform Based on Benefit Analysis

Cost-Efficient Orchestration of Containers in Clouds: A Vision, Architectural Elements, and Future Directions

Elastic Resource Provisioning for Cloud Based on Docker