Abstract:Container-based cloud technology has changed the delivery mode of traditional applications and brought a breakthrough development to the field of cloud computing. However, the uncertainty of cloud environment and variability of application requirements increase the scheduling cost of tasks in container cloud. In particular, how to balance the business performance and utilization efficiency of cloud resources in the peak stage of application access is the focus of future for container cluster technology. In this paper, we propose a heuristics multi-objective task scheduling framework based on reinforcement learning (AC-CCTS). The proposed framework not only solves the problems of single objective and local convergence in traditional task scheduling methods, but also reduces the cost of experiential learning with reinforcement learning methods. Firstly, we define container cloud environment, scheduling agent, scheduling actions and scheduling evaluation methods to establish a deep reinforcement learning-based dynamic scheduling model. Then, based on Actor-Critic algorithm, we design heuristic rules and prioritized experience replay method to speed up convergence of task scheduling and decrease learning costs. At the same time, we provide compensation mechanism for dynamic task scheduling to improve the robustness of the approach. Finally, we implement comparative experiments to simulate various scheduling scenarios and verify the effectiveness of AC-CCTS from different perspectives such as resource balance, resource utilization and QoS. Compared with traditional meta-heuristic scheduling methods such as FIMPSO, HWOA-MBA and other reinforcement learning algorithms such as DeepRM-Plus and RLSched, AC-CCTS shows better resource utilization efficiency and convergence stability in container-based cloud task scheduling.

ECSched: Efficient Container Scheduling on Heterogeneous Clusters.

Concurrent container scheduling on heterogeneous clusters with multi-resource constraints

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

A Global Cost-Aware Container Scheduling Strategy in Cloud Data Centers

A priority-aware scheduling framework for heterogeneous workloads in container-based cloud

Preemptive and Low Latency Datacenter Scheduling via Lightweight Containers

Cluster Scheduler on Heterogeneous Cloud

Fine-Grained Scheduling for Containerized HPC Workloads in Kubernetes Clusters

Task Containerization and Container Placement Optimization for MEC: A Joint Communication and Computing Perspective

Scheduling Frameworks for Cloud Container Services.

An Efficient Online Placement Scheme for Cloud Container Clusters

KCES: A Workflow Containerization Scheduling Scheme Under Cloud-Edge Collaboration Framework

Scheduling Applications on Containers Based on Dependency of The Applications

Container Scheduling Algorithms for Distributed Cloud Environments

A heuristic multi-objective task scheduling framework for container-based clouds via actor-critic reinforcement learning

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

A scheduling algorithm for heterogeneous computing systems by edge cover queue

A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications

CloudCoaster: Transient-aware Bursty Datacenter Workload Scheduling

A container optimal matching deployment algorithm based on CN-Graph for mobile edge computing

Container Placement and Migration in Edge Computing: Concept and Scheduling Models