Abstract:Deep learning is a growing technique used to solve complex artificial intelligence (AI) problems. Large-scale deep learning has become a significant issue as a result of the expansion of datasets and the complexity of deep learning models. For training large-scale models, the cloud can be used as a distributed HPC (high-performance computing) tool with benefits in cost and flexibility. However, one of the major performance barriers in distributed deep learning in a distributed HPC environment is the network. The performance is often limited by heavy traffic like many stochastic gradient descent transfers for distributed communication. There are many network studies in distributed deep learning to solve these problems, but most research only focuses on improving communication performance and applying new methods or algorithms like overlapping parameter synchronization to minimize communication delay rather than considering the actual network. In this paper, we are focusing on the actual network, especially in a distributed HPC environment. In such an environment, if cluster nodes are assigned to different zones/regions which means a set of an appropriate number of distributed HPC nodes when performing distributed deep learning tasks, performance degradation due to network delay may occur. The proposed network optimization algorithm ensures that distributed work is placed in the same zone as much as possible to reduce network delay. Furthermore, scoring using network monitoring tools like loss, delay, and throughput is applied to select the optimal node within the zone. Our proposal has been validated on the Kubernetes platform, an open source orchestrator for the automatic management and deployment of micro-services. The performance of distributed deep learning is improved through the proposed scheduler.

Poster: Flexible Scheduling of Network and Computing Resources for Distributed AI Tasks

AI-oriented Workload Allocation for Cloud-Edge Computing.

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

An effective resource scheduling model for edge cloud oriented AIoT

Automatic Scheduling Technology of Computing Power Network Driven by Knowledge Graph

Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks

Heterogeneous Resource Scheduling in Computing Power Networks: A Method Based on Improved D3QN

Online Scheduling Algorithm for Heterogeneous Distributed Machine Learning Jobs

Online Scheduling of Machine Learning Jobs in Edge-Cloud Networks

A Survey on Scheduling Techniques in Computing and Network Convergence

A Novel Distributed Task Scheduling Framework for Supporting Vehicular Edge Intelligence

Resource Scheduling in Edge Computing: A Survey

Scheduling Generative-AI Job DAGs with Model Serving in Data Centers

Distributed Scheduling Strategies for Processing Multiple Divisible Loads with Unknown Network Resources

AI Agent in Software-Defined Network: Agent-Based Network Service Prediction and Wireless Resource Scheduling Optimization

Intelligent Resource Scheduling Based on Locality Principle in Data Center Networks

QoS-aware edge AI placement and scheduling with multiple implementations in FaaS-based edge computing

Large-scale Machine Learning Cluster Scheduling via Multi-agent Graph Reinforcement Learning

A Dynamic Distributed Scheduler for Computing on the Edge

An Optimal Network-Aware Scheduling Technique for Distributed Deep Learning in Distributed HPC Platforms

Task Offloading in Real-Time Distributed Energy Power Systems