A model for intelligent task scheduling in a large distributed system

Chen Jun,Xie Li,Sun Zhong-xiu

DOI: https://doi.org/10.1145/94574.94576

1990-01-01

Abstract:Most existing task scheduling algorithms will lose efficiency in a large distributed system because of the uncertainty, incompleteness, and instability problems. This paper proposes a concept of in telligent distributed task scheduling IDTS to solve these problems.

What problem does this paper attempt to address?

A Decomposition-Based Approach for Multitask Scheduling with Execution Uncertainty in Industrial Internet of Things

Yong Wang,Bingtao Hu,Yixiong Feng,Zhiwu Li,Yiping Feng,Jianrong Tan

DOI: https://doi.org/10.1109/jiot.2023.3237727

IF: 10.6

2023-01-01

IEEE Internet of Things Journal

Abstract:Industrial Internet of Things (IIoT) is changing the way in which factories operate with the help of various industrial applications. However, the execution uncertainty of computing tasks has always been ignored in IIoT applications. In this article, we define a novel conditional task graph to describe the execution uncertainty and present a generation algorithm to obtain all task scenario graphs and corresponding occurrence probabilities. Then, a new IIoT-oriented multitask scheduling model under execution uncertainty is built. This model is simplified by reformulating the nonlinear constraints and subsequently decomposed into several small-scale models using the Lagrange multipliers, from which a decomposition-based algorithm is derived to solve the decomposed small-scale models and progressively acquire a well-optimized solution of the initial model. Furthermore, a patching algorithm is constructed to improve the obtained solution. Finally, many test cases are generated, and four selected algorithms are taken for comparison to evaluate the performance of our algorithms. The results demonstrate that our algorithms remarkably outperform the others. Besides, the solutions of the proposed algorithms can completely satisfy the execution deadline constraints of different task scenarios.
An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

Weiwei Qiu,Zibin Zheng,Xinyu Wang,Xiaohu Yang

DOI: https://doi.org/10.1109/isorc.2013.6913213

2013-01-01

Abstract:Fault-tolerant real-time scheduling algorithm is one of the most important means to ensure the timeliness and high availability characteristics of fault-tolerant real-time systems. Existing scheduling models for periodic real-time task in heterogeneous platforms typically require the number of processors in the systems to be determined in advance; hence prohibit the scalability and the performance of distributed systems. The algorithms based on these models also require a large number of schedubility tests which lead to long execution time. To address these problems, we propose a primary and backup replica partition based fault-tolerant scheduling algorithm (PBPFT) based on a scalable scheduling model using heterogeneity that does not have to determine the scale of the distributed system in advance. The PBPFT approach also takes advantage of backup copy overlapping and phasing delay techniques to minimize system redundancy, and adopts the processor grouping technique to simplify algorithm complexity. Comprehensive experiments are conducted, and the results validate high resource utilization and commendable performance of our proposed approach.
Intelligent Agent-Based Scheduling Mechanism for Grid Service

CQ Huang,DR Chen,HL Hu

DOI: https://doi.org/10.1109/icmlc.2004.1380592

2004-01-01

Abstract:Load balancing and fault tolerance are two key concerns when developing distributed computing applications. The emergence of grid computing environments extends this problem. Based on distributed scheduling architecture, a grid service oriented scheduling model is proposed to enable load balancing in this paper. In this model, the functionalities are characterized by fault tolerance, and implemented by applying intelligent agent technology. Degree of credit is introduced to make that a decision of grid service selection, service instance selection/migration and service instance redundancy, context agents are responsible for sensing the context of grid, and balance agents are enforced to automatically serve the scheduler for dynamic load adjustment and service-level fault tolerance. Between agents, information exchange is conducted via an agent communication language.
A Distributed Resource Scheduling Based on Fuzzy Cognitive Map for Dynamic Grid Computation Systems

Hu Min,Li Yanjun,Wu Tiejun

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.22.033

2006-01-01

Abstract:Based on the theory of multi-agent,the resource scheduling is implemented optimally by grid nodes choosing subtask independently in grid systems.Being autonomous,each grid node will give different support degree of task assignment.The fuzzy cognitive map is used to construct the support degree negotiation model,and based on it,an intelligent grid resource scheduling strategy is proposed in this paper.Considered that each grid node has different type of resource,the definition of standard support degree is proposed to insure the feasibility and validity of the support degree negotiation model.No upper level recourse scheduling unit is needed in the proposed scheduling strategy.Grid resource is allocated by grid nodes through negotiation on the basis of the interaction among the nodes due to the standard support degree of task assignment.This strategy is applicable for distributed computation,and supports dynamic change of grid nodes,which makes the grid computation system possess better real-time performance and robustness.
TSTSS: A Time-Sensitive Task Scheduling System for Multi-modal Industrial Internet of Things.

Xikai Sun,Xu Wang,Fan Dang

DOI: https://doi.org/10.1145/3603165.3607381

2023-01-01

Abstract:We propose a task scheduling system for Multi-modal Industrial Internet of Things (IIoT). The system is based on the improvement of Kubernetes and the parsing of task. Furthermore, it can dynamically select the appropriate nodes to parallelly process sub-tasks according to theirs latency requirement and real-time communication and computing conditions. It can effectively solve the impact of latency sensitivity differences on task scheduling in IIoT.
Distributed Active Sensor Scheduling for Target Tracking in Ultrasonic Sensor Networks

Fan Zhang,Jiming Chen,Hongbin Li,Youxian Sun,Xuemin (Sherman) Shen

DOI: https://doi.org/10.1007/s11036-011-0311-9

2012-01-01

Abstract:Active ultrasonic sensors for target tracking application may suffer from inter-sensor-interference if these highly dense deployed sensors are not scheduled, which can degrade the tracking performance. In this paper, we propose a dynamic distributed sensor scheduling (DSS) scheme, where the tasking sensor is elected spontaneously from the sensors with pending sensing tasks via random competition based on Carrier Sense Multiple Access (CSMA). The channel will be released immediately when sensing task is completed. Both simulation results and testbed experiment demonstrate the effectiveness of DSS scheme for large scale sensor networks in terms of system scalability and high tracking performance.
A Bilevel Decomposition Approach for Many Homogeneous Computing Tasks Scheduling in Software-Defined Industrial Networks

Yong Wang,Yixiong Feng,Xuanzhi Jin,Yiping Feng,Zhiwu Li,Jianrong Tan

DOI: https://doi.org/10.1109/tii.2022.3188347

IF: 12.3

2023-01-01

IEEE Transactions on Industrial Informatics

Abstract:To confront the great challenge of industrial big data, the software-defined industrial networks (SDINs) are introduced to dynamically coordinate these data flows among the heterogeneous and distributed computing resources. Deciding how to more efficiently schedule many homogeneous computing tasks, which extensively appear in SDIN, becomes of critical importance. To this end, this article first illustrates some related notations and assumptions of the homogeneous computing tasks and computing networks, from which a new targeted optimization model is formulated. Then, the model is significantly enhanced by reformulating all the nonlinear constraints and inventively establishing the symmetry-breaking constraints and computation time cuts. Furthermore, considering the computational complexity, the scheduling process with many homogeneous computing tasks is further viewed as two associated phases: computing nodes assignment and tasks sequencing. As a result, a novel bilevel decomposition algorithm is proposed using Lagrangian decomposition and a new form of Lagrangian relaxation. Finally, a real industrial scenario is chosen, and three comparison algorithms are used to demonstrate the preponderant performance of the proposed algorithm.
Distributed Intelligent Scheduling Of Fms

Zuobao Wu,Yaodong Cheng,Xiaohong Pan

DOI: https://doi.org/10.1117/12.217469

1995-01-01

Abstract:In this paper, a distributed scheduling approach of a flexible manufacturing system (FMS) is presented. A new class of Petri nets called networked time Petri nets (NTPN) for system modeling of networking environment is proposed. The distributed intelligent scheduling is implemented by three schedulers which combine NTPN models with expert system techniques. The simulation results are shown.
Distributed Interfering Sensor Scheduling Scheme for Target Tracking

Fan Zhang,Jiming Chen,Hongbin Li,Youxian Sun,Xuemin (Sherman) Shen

DOI: https://doi.org/10.4108/chinacom.2010.49

2010-01-01

Abstract:For target tracking applications, active ultrasonic sensors may suffer from inter-sensor-interference when these highly dense deployed sensors are not scheduled. In this paper, we propose a dynamic distributed sensor scheduling (DSS) scheme, where the tasking sensor is elected spontaneously from the sensors with pending sensing tasks in a distributed way via random competition by using Carrier Sense Multiple Access (CSMA)-like fashion, and releases the channel immediately when ranging task is done. Both simulation results and testbed experiment demonstrate the efficiency of DSS scheme in terms of system scalability and tracking performance.
Distributed Scheduling Problems in Intelligent Manufacturing Systems

Yaping Fu,Yushuang Hou,Zifan Wang,Xinwei Wu,Kaizhou Gao,Ling Wang

DOI: https://doi.org/10.26599/tst.2021.9010009

2021-01-01

Abstract:Currently, manufacturing enterprises face increasingly fierce market competition due to the various demands of customers and the rapid development of economic globalization. Hence, they have to extend their production mode into distributed environments and establish multiple factories in various geographical locations. Nowadays, distributed manufacturing systems have been widely adopted in industrial production processes. In recent years, many studies have been done on the modeling and optimization of distributed scheduling problems. This work provides a literature review on distributed scheduling problems in intelligent manufacturing systems. By summarizing and evaluating existing studies on distributed scheduling problems, we analyze the achievements and current research status in this field and discuss ongoing studies. Insights regarding prior works are discussed to uncover future research directions, particularly swarm intelligence and evolutionary algorithms, which are used for managing distributed scheduling problems in manufacturing systems. This work focuses on journal papers discovered using Google Scholar. After reviewing the papers, in this work, we discuss the research trends of distributed scheduling problems and point out some directions for future studies.
An Adaptive Swarm Intelligence-Based Task Scheduling Framework for Heterogeneous IoT Systems.

Zhiyu Wang,Caijun Sun,Shunbin Li,Congqi Shen,Geyang Xiao

DOI: https://doi.org/10.1145/3510513.3510532

2021-01-01

Abstract:Task scheduling is one of the most fundamental technologies in a cloud computing environment. The essence of resource scheduling is to determine the appropriate executor and provide the on-demand resources to meet the task overhead. Due to the heterogeneity of the Internet of things (IoT), it has been a challenging task to efficiently schedule various IoT application tasks. An efficient scheduling system not only has to comply with task dependency constraints of IoT applications, but also should ensure the load balance of heterogeneous processors and minimize the total task execution time (i.e. makespan). In this paper, a collaborative management and scheduling framework is proposed based on an Adaptive Priority-based Particle Swarm Optimization (AP-PSO) for processing and communication resource allocation in heterogeneous IoT systems. The proposed approach is well adapted to the characteristics of IoT, including the processor heterogeneity, non-negligible communication costs, the diverse demand for service resources, and time-varying states of resources. Makespans and costs are adopted as metrics to evaluate the proposed scheduling model. Experimental results demonstrate that our approach outperforms other counterpart methods at the aspects of makespans and costs.
Task Offloading in Real-Time Distributed Energy Power Systems

Ningchao Wu,Xingchuan Bao,Dayang Wang,Song Jiang,Manjun Zhang,Jing Zou

DOI: https://doi.org/10.3390/electronics13142747

IF: 2.9

2024-07-13

Electronics

Abstract:The distributed energy power system needs to provide sufficient and flexible computing power on demand to meet the increasing digitization and intelligence requirements of the smart grid. However, the current distribution of the computing power and loads in the energy system is unbalanced, with data center loads continuously increasing, while there is a large amount of idle computing power at the edge. Meanwhile, there are a large number of real-time computing tasks in the distributed energy power system, which have strict requirements on execution deadlines and require reasonable scheduling of multi-level heterogeneous computing power to meet real-time computing demands. Based on the aforementioned background and issues, this paper studies the real-time service scheduling problem in a multi-level heterogeneous computing network of distributed energy power systems. Specifically, we consider the divisibility of tasks in the model. This paper presents a hierarchical real-time task-scheduling framework specifically designed for distributed energy power systems. The framework utilizes an orchestrating agent (OA) as the execution environment for the scheduling module. Building on this, we propose a hierarchical selection algorithm for choosing the appropriate network layer for real-time tasks. Further, we develop two scheduling algorithms based on greedy strategy and genetic algorithm, respectively, to effectively schedule tasks. Experiments show that the proposed algorithms have a superior success rate in scheduling compared to other current algorithms.

engineering, electrical & electronic,physics, applied,computer science, information systems
A Novel Distributed Task Scheduling Framework for Supporting Vehicular Edge Intelligence

Kun Yang,Peng Sun,Jieyu Lin,Azzedine Boukerche,Liang Song

DOI: https://doi.org/10.1109/icdcs54860.2022.00098

2022-01-01

Abstract:In recent years, data-driven intelligent transportation systems (ITS) have developed rapidly and brought various AI-assisted applications to improve traffic efficiency. However, these applications are constrained by their inherent high computing demand and the limitation of vehicular computing power. Vehicular edge computing (VEC) has shown great potential to support these applications by providing computing and storage capacity in close proximity. For facing the heterogeneous nature of in-vehicle applications and the highly dynamic network topology in the Internet-of-Vehicle (IoV) environment, how to achieve efficient scheduling of computational tasks is a critical problem. Accordingly, we design a two-layer distributed online task scheduling framework to maximize the task acceptance ratio (TAR) under various QoS requirements when facing unbalanced task distribution. Briefly, we implement the computation offloading and transmission scheduling policies for the vehicles to optimize the onboard computational task scheduling. Meanwhile, in the edge computing layer, a new distributed task dispatching policy is developed to maximize the utilization of system computing power and minimize the data transmission delay caused by vehicle motion. Through single-vehicle and multi-vehicle simulations, we evaluate the performance of our framework, and the experimental results show that our method outperforms the state-of-the-art algorithms. Moreover, we conduct ablation experiments to validate the effectiveness of our core algorithms.
Energy Efficient Speed Scaling and Task Scheduling for Distributed Computing Systems

jiwei huang,chuang lin,bo cheng

DOI: https://doi.org/10.1049/cje.2015.07.005

IF: 1.019

2015-01-01

Chinese Journal of Electronics

Abstract:With the rapid development of the performance of computer systems, energy consumption has been increasing dramatically as well. Energy efficiency has been paid much attention, especially in large-scale distributed computing systems. We propose an effective approach for energy reduction, by dynamic speed scaling and task scheduling simultaneously. Markov models for distributed computing systems are...
Data-Intensive Task Scheduling for Heterogeneous Big Data Analytics in IoT System

Xin Li,Liangyuan Wang,Jemal H. Abawajy,Xiaolin Qin,Giovanni Pau,Ilsun You

DOI: https://doi.org/10.3390/en13174508

IF: 3.2

2020-09-01

Energies

Abstract:Efficient big data analysis is critical to support applications or services in Internet of Things (IoT) system, especially for the time-intensive services. Hence, the data center may host heterogeneous big data analysis tasks for multiple IoT systems. It is a challenging problem since the data centers usually need to schedule a large number of periodic or online tasks in a short time. In this paper, we investigate the heterogeneous task scheduling problem to reduce the global task execution time, which is also an efficient method to reduce energy consumption for data centers. We establish the task execution for heterogeneous tasks respectively based on the data locality feature, which also indicate the relationship among the tasks, data blocks and servers. We propose a heterogeneous task scheduling algorithm with data migration. The core idea of the algorithm is to maximize the efficiency by comparing the cost between remote task execution and data migration, which could improve the data locality and reduce task execution time. We conduct extensive simulations and the experimental results show that our algorithm has better performance than the traditional methods, and data migration actually works to reduce th overall task execution time. The algorithm also shows acceptable fairness for the heterogeneous tasks.

energy & fuels
Task scheduling based on swarm intelligence algorithms in high performance computing environment

Xuqing Chai

DOI: https://doi.org/10.1007/s12652-020-01994-0

IF: 3.662

2020-05-02

Journal of Ambient Intelligence and Humanized Computing

Abstract:The high-performance computing environment is a computing platform, which aggregates multiple distributed high-performance computers from indifferent organizations, providing users with unified access and usage patterns. Since the task scheduling strategy is lack of flexibility, an optimized task scheduling model in the high-performance computing environment is proposed in this paper, which introduces an improved swarm intelligence algorithm in task queues, refines the Core Scheduler for each task, and increases the configuration of task scheduling strategy. In core task scheduling, swarm intelligence algorithm is adopted to minimize the average scheduling time for completion tasks through optimal task allocation on each node. Simulation results show that the proposed scheduling algorithm is better than the traditional task scheduling algorithm. Therefore, according to the task scheduling strategy based on swarm intelligence algorithm, it can effectively reduce the task waiting, improve the system's throughput, the task response and system resource utilization has a better effect.

computer science, information systems,telecommunications, artificial intelligence
A Distributed TDMA Scheduling Algorithm for Target Tracking in Ultrasonic Sensor Networks.

Peng Cheng,Fan Zhang,Jiming Chen,Youxian Sun,Xuemin Shen

DOI: https://doi.org/10.1109/TIE.2012.2208439

IF: 7.7

2013-01-01

IEEE Transactions on Industrial Electronics

Abstract:Ultrasonic sensors are able to provide highly accurate measurements if they are properly scheduled, otherwise, the intersensor interference (ISI) could greatly deteriorate the performance. In addition, the scheduling scheme should be performed in a distributed and energy-efficient way so that it can be conveniently implemented for a large-scale network. In this paper, for target tracking with mult...
A Study on Task Scheduling in Computational Grid.

X Fang,XG Wang,SL Li,C He

2002-01-01

Abstract:ACI (Advanced Computational Infrastructure) is a computational grid developed in Tsinghua University. It is designed and implemented for sharing the high-performance computational resources geographically distributed across the campuses, of several universities in solving large-scale application problems., The resources in ACI. are dynamic, distributed and heterogeneous. This article-introduces the architecture of ACI and emphasizes on the task scheduling in ACI. Several strategies are used in task scheduling. The execution time prediction used in the scheduling, strategy is, discussed in this article.
Intelligent Blockchain-enabled Adaptive Collaborative Resource Scheduling in Large-scale Industrial Internet of Things

Kai Lin,Jian Gao,Guangjie Han,Haohua Wang,Chao Li

DOI: https://doi.org/10.1109/tii.2022.3169457

IF: 12.3

2022-01-01

IEEE Transactions on Industrial Informatics

Abstract:With the explosive growth of devices and tasks deployed in the industrial Internet of Things (IIoT), the lack of interconnection and collaboration between devices leads to poor timeliness and security in IIoT resource scheduling. This article focuses on the issue of adaptive scheduling of resources in large-scale IIoT. First, a collaborative terminal-edge IIoT architecture is designed, which introduces blockchain and AI technology to support dynamic resource scheduling in untrustworthy environments. Then, a smart contract-based multidimensional resource transaction model is developed to improve the efficiency and security of resource scheduling by establishing a credit-based consensus mechanism. Distributed transaction learning resource scheduling algorithm is further proposed to implement resource-adaptive scheduling between devices in IIoT. Extensive simulation experiments are conducted to evaluate the proposed method with respect to several performance aspects covering the scheduling decision delay, transaction generation ratio, and security. The obtained results demonstrate that the comprehensive scheduling performance of the proposed method outperforms other existing algorithms.

automation & control systems,computer science, interdisciplinary applications,engineering, industrial
SmartDis: Near-Optimal Task Scheduling in Multi-edge Networks

Weiwei Miao,Zeng,Chuanjun Wang,Zhuzhong Qian

DOI: https://doi.org/10.1007/978-3-030-73429-9_2

2021-01-01

Abstract:In multi-edge networks, as the bandwidth and computing resources of edge servers are limited, transmission and processing of large amounts of data could bring significant pressure, leading to violations of service agreements. Thus, it is very important to schedule tasks in edge network efficiently for better performance. In this paper, we formulate the problem as minimizing the overall completion time of tasks in edge networks. Since the problem can be proved to be NP-hard, we propose a novelty algorithm, SmartDis, for scheduling tasks accross multiple edges. The main idea of SmartDis is to select offload slots of tasks based on the principle of choosing the smallest sum of added value of the overall completion time. We show theoretically that the system transmission time of SmartDis is within a constant times of the optimal result, as long as the data upload is scheduled according to the transmission order. The evaluation results illustrate that SmartDis is superior to other cross-domain job scheduling algorithms at this stage, achieving a performance improvement of at least 25%.

A model for intelligent task scheduling in a large distributed system

A Decomposition-Based Approach for Multitask Scheduling with Execution Uncertainty in Industrial Internet of Things

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

Intelligent Agent-Based Scheduling Mechanism for Grid Service

A Distributed Resource Scheduling Based on Fuzzy Cognitive Map for Dynamic Grid Computation Systems

TSTSS: A Time-Sensitive Task Scheduling System for Multi-modal Industrial Internet of Things.

Distributed Active Sensor Scheduling for Target Tracking in Ultrasonic Sensor Networks

A Bilevel Decomposition Approach for Many Homogeneous Computing Tasks Scheduling in Software-Defined Industrial Networks

Distributed Intelligent Scheduling Of Fms

Distributed Interfering Sensor Scheduling Scheme for Target Tracking

Distributed Scheduling Problems in Intelligent Manufacturing Systems

An Adaptive Swarm Intelligence-Based Task Scheduling Framework for Heterogeneous IoT Systems.

Task Offloading in Real-Time Distributed Energy Power Systems

A Novel Distributed Task Scheduling Framework for Supporting Vehicular Edge Intelligence

Energy Efficient Speed Scaling and Task Scheduling for Distributed Computing Systems

Data-Intensive Task Scheduling for Heterogeneous Big Data Analytics in IoT System

Task scheduling based on swarm intelligence algorithms in high performance computing environment

A Distributed TDMA Scheduling Algorithm for Target Tracking in Ultrasonic Sensor Networks.

A Study on Task Scheduling in Computational Grid.

Intelligent Blockchain-enabled Adaptive Collaborative Resource Scheduling in Large-scale Industrial Internet of Things

SmartDis: Near-Optimal Task Scheduling in Multi-edge Networks