Abstract:Container-based cloud technology has changed the delivery mode of traditional applications and brought a breakthrough development to the field of cloud computing. However, the uncertainty of cloud environment and variability of application requirements increase the scheduling cost of tasks in container cloud. In particular, how to balance the business performance and utilization efficiency of cloud resources in the peak stage of application access is the focus of future for container cluster technology. In this paper, we propose a heuristics multi-objective task scheduling framework based on reinforcement learning (AC-CCTS). The proposed framework not only solves the problems of single objective and local convergence in traditional task scheduling methods, but also reduces the cost of experiential learning with reinforcement learning methods. Firstly, we define container cloud environment, scheduling agent, scheduling actions and scheduling evaluation methods to establish a deep reinforcement learning-based dynamic scheduling model. Then, based on Actor-Critic algorithm, we design heuristic rules and prioritized experience replay method to speed up convergence of task scheduling and decrease learning costs. At the same time, we provide compensation mechanism for dynamic task scheduling to improve the robustness of the approach. Finally, we implement comparative experiments to simulate various scheduling scenarios and verify the effectiveness of AC-CCTS from different perspectives such as resource balance, resource utilization and QoS. Compared with traditional meta-heuristic scheduling methods such as FIMPSO, HWOA-MBA and other reinforcement learning algorithms such as DeepRM-Plus and RLSched, AC-CCTS shows better resource utilization efficiency and convergence stability in container-based cloud task scheduling.

Concurrent container scheduling on heterogeneous clusters with multi-resource constraints

ECSched: Efficient Container Scheduling on Heterogeneous Clusters.

A priority-aware scheduling framework for heterogeneous workloads in container-based cloud

A Global Cost-Aware Container Scheduling Strategy in Cloud Data Centers

Preemptive and Low Latency Datacenter Scheduling via Lightweight Containers

Cost-Efficient Scheduling of Workflow Applications with Deadline Constraint on IaaS Clouds

Scheduling Frameworks for Cloud Container Services.

Fine-Grained Scheduling for Containerized HPC Workloads in Kubernetes Clusters

Improving Utilization and Parallelism of Hadoop Cluster by Elastic Containers.

Improved Container Cloud Resource Scheduling Policy

Fine-grained Scheduling in Multi-Resource Clusters

Heterogeneous Task Co-location in Containerized Cloud Computing Environments

A heuristic multi-objective task scheduling framework for container-based clouds via actor-critic reinforcement learning

A Novel Resource Scheduling Approach in Container Based Clouds

Cluster Scheduler on Heterogeneous Cloud

Coflow Scheduling in the Multi-Resource Environment

Scheduling mixed-parallel application onto multicluster grid with background workloads

KCES: A Workflow Containerization Scheduling Scheme Under Cloud-Edge Collaboration Framework

An effective algorithm of jobs scheduling in clusters

Scheduling Applications on Containers Based on Dependency of The Applications

Speculative Container Scheduling for Deep Learning Applications in a Kubernetes Cluster