Improving IGP Convergence through Distributed OSPF in Scalable Router

Jiang Xuezhi,Xu Mingwei,Li Qi,Pan Lingtao

DOI: https://doi.org/10.1109/HPCC.2009.21

2009-01-01

Abstract:Grid computing has emerged as a way to share geographically and organizationally distributed resources that may belong to different institutions or administrative domains. In this context, the scheduling and resource management is usually performed by ...

What problem does this paper attempt to address?

A Grid Service-Based Engineering Computation Architecture.

CQ Huang,DR Chen,HL Hu

DOI: https://doi.org/10.1109/cmpsac.2004.1342652

2004-01-01

Abstract:Grid computing is becoming a new computing infrastructure for large-scale scientific computation and cooperative work. The Globus toolkit is the most popular grid environment and de facto grid standard, and it has adopted OGSA architecture to provide applications with grid service level. This study focuses on the requirement for scientists in engineering computation field and narrows the gap between grid service and the engineering community. The engineering computation architecture supplies the users with a visual application development and deployment environment for engineering computation. The whole is characterized by grid service. At the same time, QoS driven user-centric scheduling, community-based efficient authorization and flexible task management are designed and implemented.
A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Haolin Feng,Guanghua Song,Yao Zheng,Jun Xia

DOI: https://doi.org/10.1007/978-3-540-24680-0_15

2004-01-01

Abstract:Computational grid has a promising future in large-scale computing, because it enables the sharing of widely distributed computing resources. Good managements with excellent scheduling algorithms are in great demand to take full advantage of it. Many scheduling algorithms in grid computing are for independent tasks. However, communications are very common in scientific computing programs. In this paper, we will propose an easy-implemented algorithm to schedule the tasks with some communications. Our algorithm is suitable for a large proportion of scientific computing programs, and is based on Binary Integer Programming. It is able to meet the users' quality of service (QoS) requirements, and to minimize the combination of costs and time consumed by the users' programs. We will give an example of scheduling a typical scientific computing task to show the power of our algorithm. In our experiment, the grid resource consists of an SGI Onyx 3900 supercomputer, four SGI Octane workstations, four Intel P4-2.OGHz PCs and four Intel P4-1.8GHz PCs.
Multi-discipline computations and collaborative visualization on the campus grid

Yingjie Xia,Guanghua Song,Yao Zheng

DOI: https://doi.org/10.3321/j.issn:1671-4512.2007.z2.029

2007-01-01

Abstract:A campus grid is developed and deployed to integrate high performance computing resources in Zhejiang University.The architecture is based on a hierarchical combination of two grid middleware products,Globus Toolkit and Sun Grid Engine,in order to make use of their advantages.The campus grid is applied for scientific computation,bioinformatics,computational fluid dynamics,etc.Some test cases using Message Passing Interface(MPI) show that the campus grid can provide powerful and stable computing cycles.The campus grid also provides two collaborative visualization services,the local rendering and the server rendering,which can be customized by the user.Finally,the collaborative visualization service facilitates users to research and analyze cooperatively.
The Study on Simulation Grid Technology for Equipment Resource Sharing System

Yuexuan Wang,Lianchen Liu,Xixiang Hu,Cheng Wu

DOI: https://doi.org/10.1109/wcica.2004.1343128

2004-01-01

Abstract:It is difficult to realize equipment resources sharing on network. Based on grid and simulation modeling technique, simulation-grid architecture is presented. Simulation models of sharing equipments are established in grid. Manipulating and optimally scheduling remote equipments are realized by operating the simulation models in simulation-grid system. The proposed architecture provides a method to equipment resources sharing and management on network and would be widely used.
A Public Grid Computing Framework Based on a Hierarchical Combination of Middleware

Yingjie Xia,Yao Zheng,Yudang Li

DOI: https://doi.org/10.1007/11610496_92

2006-01-01

Abstract:Grids, as one implementation of public computing, can be deployed by some middleware to integrate all kinds of resources across institutional boundaries, to tackle complex problems in scientific and engineering computation, data storage, scientific visualization, etc. In this paper, we propose a public computing grid framework built upon the hierarchical combination of two popular middleware products, Globus Toolkit (GT) and Sun Grid Engine (SGE). The communication between them can be conducted by Transfer-queue Over Globus (TOG). We discuss issues related to the deployment and the usage of this kind of hybrid grids. We examine it using serial programs and parallel program codes, and compare it with the grids deployed by only GT or SGE, respectively. The case studies imply that this hybrid grid is suitable for loosely coupled applications with high computational complexity.
DHOSPF: Adaptive Parallel Routing Table Computation for Next Generation Routers

Xuezhi Jiang -,Mingwei Xu -,Qi Li -

DOI: https://doi.org/10.4156/jdcta.vol5.issue7.21

2011-01-01

International Journal of Digital Content Technology and its Applications

Abstract:Fast convergence in interior gateway protocol (IGP) is certainly critical to the widespread deployment of real time applications (such as, VOIP, IPTV, etc.). Many improvements for OSPF (Open Shortest Path First) protocol, such as fast hello and fast flooding, have been proposed to reduce the convergence time of IGP. However, these schemes need to consume a large amount of CPU and memory resources of route processor. In this paper, we systemically analyze the limitations of scheduling routing table computation in OSPF by investigating the characterization of link failures collected from real ISP networks. With the evolution of router control plane from the centralized architecture with a single control element (CE) to the distributed architecture with multiple CEs, we propose a distributed homogenous OSPF (DHOSPF) scheme to adaptively calculate routing table. We model DHOSPF using Petri Nets and analyze the convergence time. The simulation results demonstrate that the proposed algorithm can effectively shorten the convergence time compared with standard OSPF and some improved schemes.
Research of the Grid Computing System Applied in Optical Simulation

Jin Wei-wei,Wang Yu-dong,Liu Qiangsheng,Cen Zhao-feng,Li Xiao-tong,Lin Yi-qun

DOI: https://doi.org/10.1117/12.756433

2008-01-01

Abstract:A grid computing in the field of optics is presented in this paper. Firstly, the basic principles and research background of grid computing are outlined in this paper, along with the overview of its applications and the development status quo. The paper also discusses several typical tasks scheduling algorithms. Secondly, it focuses on describing a task scheduling of grid computing applied in optical computation. The paper gives details about the task scheduling system, including the task partition, granularity selection and tasks allocation, especially the structure of the system. In addition, some details of communication on grid computing are also illustrated. In this system, the "makespan" and "load balancing" are comprehensively considered. Finally, we build a grid model to test the task scheduling strategy, and the results are analyzed in detail. Compared to one isolated computer, a grid comprised of one server and four processors can shorten the "makespan" to 1/4. At the same time, the experimental results of the simulation also illustrate that the proposed scheduling system is able to balance loads of all processors. In short, the system performs scheduling well in the grid environment.
Cluster Router: Homogeneous Ospf for Distributedcontrol Plane

Xuezhi Jiang,Mingwei Xu,Lingtao Pan,Wenlong Chen

DOI: https://doi.org/10.1049/cp:20080867

2008-01-01

Abstract:The exponential growth of Internet traffic requires that routers should be scalable. Cluster is an easy and flexible scalable way to improve the performance of the router. A critical issue in the design of cluster router is to provide a global and consistent routing table in such distributed architectures. In order to shorten the time of OSPF routing table computation, accelerate the network convergence, improve the reliability of the router and avoid the overload of the single control element CPU, distributed homogeneous OSPF is proposed in this paper. Each routing node of cluster router runs the OSPF protocol process on its own control element respectively, and keeps up the identical link-state database (LSDB). The shortest expected delay (SED) task scheduling algorithm is designed for the cluster router to compute the routing table on demanding. Compared with some improved OSPF schemes, our distributed homogenous OSPF can calculate routing table in real time and speed up LSAs processing in parallel. It decreases the internal communication overhead and provides a redundant backup scheme among these routing nodes to improve the reliability of cluster routers.
Self-organizing communication-aware resource management for scheduling in Grid environment

Zheng Qinghua,Yang Haijun,Sun Yuzhong

DOI: https://doi.org/10.1109/HPCASIA.2005.90

2005-01-01

Abstract:Rapid advances In network and computer technologies are making networked computers, organized in the form of Grid, an appealing vehicle for cost-effective parallel computing. But how to handle efficiently the communications in scheduling is still a main obstacle to using these resources. In this paper, we tackle this problem by partitioning resources into groups in a parallel and distributed fashion. Resources with good communication performance to each other will be clustered into a same group. Based on our observation that communication latencies between adjacent resources are much less than those between non-adjacent ones with high possibility, flooding with a small TTL (Time-To-Live) can inherently exploit the proximity property between resources, which improves greatly the efficiency of our partitioning work. Our distributed resource management method can fit well for environments with large-scale resources such as Grid. © 2005 IEEE.
Grid Computing Applied in Large-Scale Optical Computation

金伟伟,刘强生,李晓彤,岑兆丰

DOI: https://doi.org/10.3969/j.issn.1007-2276.2007.z2.031

2007-01-01

Infrared and Laser Engineering

Abstract:To gain a shortcut of complex optical computation,a grid computing system is established in this paper.The task scheduling,task partitioning,granularity controlling and takes allocating of the system are illustrated.Besides,a grid computing model is built to test the system,and the results are analyzed in detail.In this model,the makespan and load balancing of the system are comprehensively considered.The experimental results show that the proposed system is able to perform well in reducing makespan and balancing load,attain the purpose of expectation.
Joint Scheduling of Computation and Network Resource in Optical Grid

Yaohui Jin,Yan Wang,Wei Guo,Weiqiang Sun,Weisheng Hu

DOI: https://doi.org/10.1109/mcom.2010.5458366

2007-01-01

Abstract:Although there are some researches have been done on the testbeds or architectures for optical grid applications, few efforts have been made on the scheduling problem for the optical grid application in theoretical details. When optical networks are considered as resources and jointly scheduled with other grid resources, communication contention must be taken into consideration for efficient task scheduling. This paper analyzes two schemes for reducing the communication contention in joint scheduling of computation and network resources for optical grid, one is the adaptive routing scheme and the other is grid resource selection scheme. The adaptive routing scheme, that was proposed in another paper [16] can detour the heavy traffic and find an earliest start route for each edge scheduling. A multilevel method for grid resource selection scheme is proposed in this paper, which help to schedule tasks onto the nearby resources, leading to a reduction in the average data transferred across individual links. Simulation results show that when we employ the two schemes together in the joint scheduling model, most of the communication contention can be removed, producing the smallest schedule length with relatively lower link utilization.
A Fast-Convergence Routing of the Hot-Potato

Jean-Romain Luttringer,Quentin Bramas,Cristel Pelsser,Pascal Mérindol

DOI: https://doi.org/10.48550/arXiv.2101.09002

2021-01-22

Abstract:Interactions between the intra- and inter-domain routing protocols received little attention despite playing an important role in forwarding transit traffic. More precisely, by default, IGP distances are taken into account by BGP to select the closest exit gateway for the transit traffic (hot-potato routing). Upon an IGP update, the new best gateway may change and should be updated through the (full) re-convergence of BGP, causing superfluous BGP processing and updates in many cases. We propose OPTIC (Optimal Protection Technique for Inter-intra domain Convergence), an efficient way to assemble both protocols without losing the hot-potato property. OPTIC pre-computes sets of gateways (BGP next-hops) shared by groups of prefixes. Such sets are guaranteed to contain the post-convergence gateway after any single IGP event for the grouped prefixes. The new optimal exits can be found through a single walk-through of each set, allowing the transit traffic to benefit from optimal BGP routes almost as soon as the IGP converges. Compared to vanilla BGP, OPTIC's structures allow it to consider a reduced number of entries: this number can be reduced by 99\% for stub networks. The update of OPTIC's structures, which is not required as long as border routers remain at least bi-connected, scales linearly in time with its number of groups.

Networking and Internet Architecture
Bgp-Grid: A Distributed Bgp Policy Simulation and Evaluation System

Zhonghui Li,Jilong Wang,Bin Tian

DOI: https://doi.org/10.1109/bmei.2010.5639308

2010-01-01

Abstract:As a result of the independence, opacity and complication of inter-domain routing policy deployment among different ASes, negative impact on global Internet might be introduced. By presenting one case occurred in TEIN2 backbone, we point out the potential performance and stability problems caused by inappropriate policy design and amendment, which might cause side effect on particular application, e.g. telemedicine. After studying the related works on inter-domain routing policy, we propose a distributed system, BGP-Grid, for BGP policy simulation and evaluation. Through the collaboration among participant ASes over BGP-Grid, the bi-directional performance outcome of routing policy design and amendment can be simulated and evaluated before deploying to actual routers, which allow us to find and solve any potential problem inside the policy in advance. According to the results of evaluation experiments, the effectiveness of optimization for overall performance based on BGP-Grid is confirmed.
Communication Contention Reduction in Joint Scheduling for Optical Grid Computing

Yaohui Jin,Yan Wang,Wei Guo,Weiqiang Sun,Weisheng Hu

DOI: https://doi.org/10.1007/978-3-642-02080-3_21

2007-01-01

Abstract:Optical network, which can provide guaranteed quality of service (QoS) connections, is considered as a promising infrastructure for grid computing to solve more and more complex scientific problems. When optical links are regarded as resources and jointly scheduled with other grid resources, communication contention must be taken into consideration for efficient task scheduling. This paper models the optical grid computing as a communication-aware Directed Acyclic Graph (DAG) scheduling problem. To reduce the communication contention, we propose to use hop-bytes metric (HBM) heuristic to select computing resource. Simulation results show that the HBM approach combined with the adaptive routing scheme can achieve better performance in terms of normalized schedule length and link utilization.
Empowering Computing and Networks Convergence System with Distributed Cooperative Routing

Yujiao Hu,Qingmin Jia,Meng Shen,Renchao Xie,Tao Huang,F.Richard Yu

2024-02-04

Abstract:The emergence of intelligent applications and recent advances in the fields of computing and networks are driving the development of computing and networks convergence (CNC) system. However, existing researches failed to achieve comprehensive scheduling optimization of computing and network resources. This shortfall results in some requirements of computing requests unable to be guaranteed in an end-to-end service pattern, negatively impacting the development of CNC systems. In this article, we propose a distributed cooperative routing framework for the CNC system to ensure the deadline requirements and minimize the computation cost of requests. The framework includes trading plane, management plane, control plane and forwarding plane. The cross-plane cooperative end-to-end routing schemes consider both computation efficiency of heterogeneous servers and the network congestion degrees while making routing plan, thereby determining where to execute requests and corresponding routing paths. Simulations results substantiates the performance of our routing schemes in scheduling computing requests in the CNC system.

Networking and Internet Architecture,Artificial Intelligence
Adaptive Task Scheduling on Optical Grid

Xuebin Liang,Xinhua Lin,Minglu Li

DOI: https://doi.org/10.1109/APSCC.2006.20

2006-01-01

Abstract:Optical Grid will be an attractive proposition, as the bandwidth of electrical network becomes the bottleneck of grid application. However, few scheduling methods consider the communication contention on optical Grid. This paper raises an optical grid model based on the characters of optical network. In this model, the network resource was granted the same level to be considered as the computation and storage resource. In order to reflect the reality in job scheduling, allocation of network resource for data transfer was taken into consideration. Then, this paper presents a communication contention-aware solution based on the list scheduling to minimize the total execution time for given tasks towards an optical grid, where the router algorithm was modified from Dijkstra route algorithm. Results proved the feasibility and efficiency of the solution proposed.
GRID: Gradient Routing with In-Network Aggregation for Distributed Training

Jin Fang,Gongming Zhao,Hongli Xu,Changbo Wu,Zhuolong Yu

DOI: https://doi.org/10.1109/tnet.2023.3244794

2023-01-01

Abstract:As the scale of distributed training increases, it brings huge communication overhead in clusters. Some works try to reduce the communication cost through gradient compression or communication scheduling. However, these methods either downgrade the training accuracy or do not reduce the total transmission amount. One promising approach, called in-network aggregation, is proposed to mitigate the bandwidth bottleneck in clusters by aggregating gradients in programmable hardware (e.g., Intel Tofino switches). However, existing solutions mainly implement in-network aggregation through fixed (or default) routing paths, resulting in load imbalancing and long communication time. To deal with this issue, we propose GRID, the first-of-its-kind work on Gradient Routing with In-network Aggregation for Distributed Training. In the control plane, we present an efficient gradient routing algorithm based on randomized rounding and formally analyze the approximation performance. In the data plane, we realize in-network aggregation by carefully designing the logic of workers and programmable switches. We implement GRID and evaluate its performance on a small-scale testbed consisting of 3 Intel Tofino switches and 9 commodity servers. With a combination of testbed experiments and large-scale simulations, we show that GRID can reduce the communication time by 38.4%–60.1% and speed up distributed training by 17.4%–52.7% compared with state-of-the-art solutions.
Research on Routing Strategy for InterGrid

Lin Chuan,Zhao Hai,Liu Xiao,Li He-qun,Xu Jiu-qiang

DOI: https://doi.org/10.3969/j.issn.1000-6753.2015.11.006

2015-01-01

Abstract:The InterGrid aims at facilitating large-scale utilization and sharing of renewable energy by integrating renewable energy and Internet technologies.For the large-scale and frequent transmission of the energy flow and the information flow in InterGrid based on energy routers and micro grid, there is a routing problem.Based on the complex network theory, three routing strategies simulated in an ideal routing model of InterGrid are given, which focus on different routing problems of the energy and information flow under three practical considerations.Firstly, a routing strategy based on assigning weight for the edge is proposed to solve the problem of energy transmission congestion.And then, a routing strategy based on the load of adjacent node is presented aiming at the problem of energy load balancing.Besides, a united routing strategy for the InterGrid is proposed which considers both energy transmission congestion and energy load balancing.The simulating experiments illustrate the effectiveness of our proposed routing strategies.
A Novel Routing and Wavelength Assignment Algorithm for Multicast in Optical Grid Networks

Jian Qiao,Bin Liu,Yuefeng Ji

DOI: https://doi.org/10.1117/12.744981

2007-01-01

Abstract:Grid computing enables the sharing of a wide range of geographically distributed resources including computers, storage systems, specialized devices, and network infrastructures that are owned and managed by different organizations for solving large scale computational and data intensive applications. Optical transports allow a more efficient design by providing the means to transmit large amounts of data with low cost and reliability. Group multicasting is considerable communication requirement in grid networks. Routing and wavelength assignment algorithm can greatly influence the performance of optical network, such as network blocking, resource utilization. This paper investigates the problem of routing and wavelength assignment for group multicast in optical grid networks based on network resource reservation. A minimum resource fragmentation summation (MRFS) algorithm is proposed, presented and evaluated. Simulation results show that the proposed algorithm represents higher performance on reducing blocking probability and increasing resource utilization.
Research and Implementation of Distributed Simulation and Parallel Rendering System Based on Grid

Yaping Zhang,Haoyu Peng,Zonghui Wang,Jiaoying Shi

DOI: https://doi.org/10.1109/ICNDC.2010.9

2010-01-01

Abstract:With the development of Grid technology and the extension of Grid application areas, it needs to provide core infrastructure platform and the necessary functional components for large-scale resources sharing and collaboration. Based on the previous implementation of interactive Grid visualization system, this paper extends its runtime environment layer to provide Grid supports for the existing distributed simulation support platform and parallel graphics rendering system based on PC cluster, consequently realizes dynamic resource allocation and scheduling. Additionally, we present and implement a Grid-based distributed simulation and parallel rendering system which provides large-scale distributed simulation service and parallel rendering as well as high-resolution multi-screen tiled display service of massive complex scene to end users through an extended Grid portal.

Improving IGP Convergence through Distributed OSPF in Scalable Router

A Grid Service-Based Engineering Computation Architecture.

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Multi-discipline computations and collaborative visualization on the campus grid

The Study on Simulation Grid Technology for Equipment Resource Sharing System

A Public Grid Computing Framework Based on a Hierarchical Combination of Middleware

DHOSPF: Adaptive Parallel Routing Table Computation for Next Generation Routers

Research of the Grid Computing System Applied in Optical Simulation

Cluster Router: Homogeneous Ospf for Distributedcontrol Plane

Self-organizing communication-aware resource management for scheduling in Grid environment

Grid Computing Applied in Large-Scale Optical Computation

Joint Scheduling of Computation and Network Resource in Optical Grid

A Fast-Convergence Routing of the Hot-Potato

Bgp-Grid: A Distributed Bgp Policy Simulation and Evaluation System

Communication Contention Reduction in Joint Scheduling for Optical Grid Computing

Empowering Computing and Networks Convergence System with Distributed Cooperative Routing

Adaptive Task Scheduling on Optical Grid

GRID: Gradient Routing with In-Network Aggregation for Distributed Training

Research on Routing Strategy for InterGrid

A Novel Routing and Wavelength Assignment Algorithm for Multicast in Optical Grid Networks

Research and Implementation of Distributed Simulation and Parallel Rendering System Based on Grid