Prophet - Real-time Queue Length Inference in Programmable Switches.

Shuhe Wang,Jun Bi,Chen Sun,Yu Zhou

DOI: https://doi.org/10.1145/3314148.3318050

2019-01-01

Abstract:No abstract available.

What problem does this paper attempt to address?

Sra: Switch Resource Aggregation For Application Offloading In Programmable Networks

Hongyan Liu,Xiang Chen,Qun Huang,Haifeng Zhou,Dong Zhang,Chunming Wu

DOI: https://doi.org/10.1109/GLOBECOM42002.2020.9322112

2020-01-01

Abstract:Programmable switches empower network applications with line-rate packet processing performance by allowing the offloading of applications. However, the resource of a programmable switch is extremely limited, which significantly limits the application offloading. Existing solutions to the problem either provide poor efficiency or suffer from accuracy drop. In this paper, we propose SRA, a system that loosens switch resource constraints for application offloading via resource aggregation. SRA provides administrators with an intuitive compiler directive to customize application offloading by resource aggregation. According to compiler directives, it automatically places the program on the substrate network, while maintaining original packet processing logics. We implement a prototype of SRA in P4, and establish an experimental testbed consisting of three 32x100 Gbps Barefoot switches. The experimental results indicate that SRA enhances two real-world applications with sufficient resources while maintaining high performance.
Processor Scheduling in Programmable Router Based on Queue Length Thresholds

徐恪,林闯,吴建平

DOI: https://doi.org/10.3321/j.issn:0372-2112.2001.11.003

2001-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:Programmable router not only forwards IP packets but also executes computing tasks. CPU scheduling in the programmable router is an important open problem till now. Authors establish general software architecture of programmable router firstly. Based on the architecture, authors present a novel CPU scheduling algorithm based on queue length thresholds. We model this algorithm using stochastic Petri nets. The analysis results show that the scheduling algorithm can fulfill the requirements of computing of both best-effort flows and QoS flows in programmable router at the same time.
A Novel Processor Scheduling Schema in Programmable Router Based on Queue Length Thresholds

LIN Chuang,Wu Jianping

DOI: https://doi.org/10.3772/j.issn.1006-6748.2004.01.001

2004-01-01

Abstract:Programmable router may execute computing tasks except for forwarding IP packets. How to schedule the CPU in the programmable router is an important issue that needs to be solved. In this paper, the authors establish general software architecture of programmable router firstly. Based on this architecture, authors present a novel CPU scheduling algorithm based on queue length thresholds. We model this algorithm using stochastic Petri nets. The analytic results show that this scheduling algorithm can guarantee the requirements of computing of best-effort flows and QoS flows in programmable router at the same time.
Switch Real-Time Industrial Ethernet with Mixed Scheduling Policy

JM Chen,W Zhi,YX Sun

DOI: https://doi.org/10.1109/iecon.2002.1185334

2002-01-01

Abstract:There is a strong interest of using the cheap and simple Ethernet technology for industrial network control system. However, the lack of real-time services has prevented this change of used network technology. In order to realize real-time communication over Ethernet in industrial application, one must be able to bound the medium access time within an acceptable limit. But the multiple access nature of Ethernet makes it impossible to guarantee a deterministic medium access time. In this paper, we introduce the IEEE 802.1p queuing feature in full-duplex switches, and propose a mixed scheduling policy (MSP) for the lay 2 switches in Ethernet. MSP adopts different scheduling policy for different real-time requirements frames. The objective is mainly to study the worst-case response time for real-time periodic frames and the mean delay time for time-critical aperiodic frames by setting the appropriate frames priority to meet the industrial application.
System-level Exploration of Queuing Management Schemes for Input Queue Packet Switches

Chen He,Marcello Lajolo,Margarida Jacome

2002-01-01

Abstract:In high-performance packet switches, data queuing has to al- low real-time memory (de)allocation, buffering, retrieving, and forwarding of incoming packets. Its implementation must be highly optimized to combine high speed, low power, large data storage, and high memory bandwidth. In this paper, such data queuing is used as a case study to demonstrate the effective- ness of a new system-level exploration method that embodies the widely accepted concepts of behavior/architecture code- sign. The method we propose is called architectural probing and it allows to selectively gather functional information from a functional diagram and feed it into the architectural diagram allowing to reduce the amount of details that are simulated at the architectural level, while still maintaining a high degree of accuracy. Assuming that a multi-bank memory architecture is used for data storage, the method allows to evaluate the impact of different data management algorithms and different system parameters such as DMA size and packet payload size, in terms of power and performance tradeoff by estimating the ave rage energy per bit transferred, on each architectural component involved in the implementation of the queuing management system (e.g., memories, buses and bus arbiters).
Delay Comparison of Different Switch Architectures

S. Adams,Longbo Huang,Abhay K. Parekh,J. Walrand

2013-01-01

Abstract:We compare the delays experienced by packet flows when transmitted using different scheduling algorithms across a crossbar switch. The two scheduling algorithms we consider are iterative SLIP [5] and QCSMA [3]. We first compare them under the assumptions that all packets have the same length, and then under the assumption that the half the packets have the maximum allowable length and half have the minimum allowable length. Our findings suggest that the variation in packet length has a non-negligible effect on throughput vs delay results. For longlived TCP connections with varying packet lengths, QCSMA derived schedulers seem to do only marginally better than SLIP. In highly loaded core switches with many short-lived TCP connections, we expect to see a large improvement in delay performance of QCSMA over SLIP.
Dynamic Per-Flow Queues for TSN Switches

Wenxue Wu,Zhen Li,Tong Zhang,Xiaoqin Feng,Liwei Zhang,Xuelong Qi,Fengyuan Ren

DOI: https://doi.org/10.23919/date58400.2024.10546696

2024-01-01

Abstract:Dynamic Per-Flow Queues (DFQ) extend queues from per-class to per-flow in Time-Sensitive Networking (TSN) switches that overcome large resource consumption by dynamically mapping a fixed number of physical queues to active flows. It can implement per-flow queuing with much less on-chip resource. Compared to brute-force hardware queues, DFQ prototyped on an FPGA, can effectively manage more per-flow queues, allowing for improved priority scheduling with minimal throughput and latency impact.
Design and Implementation of a Queue Manager for IP Switches with Massive Ports

Jing Wang,Lufeng Qiao,Qinghua Chen,Zhen Zheng,Jian Yang

DOI: https://doi.org/10.1109/cisp.2015.7408129

2015-01-01

Abstract:In shared memory switch fabrics, cell-copy or address-copy is used to realize multicast or broadcast in the existing queue managers and address-copy will occupy less on-chip memory and so is widely used. When there are a large number of physical ports in the switch, the number of pointer buffers will increase accordingly, which makes it difficult to meet the design requirements in the case where storage resource is limited. To address this issue, an Address Transfer Queue (ATQ) is added in the queue manager to store multicast or broadcast packet pointers and all the queues share one pointer memory, which will reduce the on-chip pointer memory requirements greatly. To solve the problem of pointer contention between each queues, an index queue is introduced into the queue manager. The whole design is implemented in a Xilinx's xc6vlx130t FPGA, the utilization of hardware resource is listed and comparison with normal queue manager shows that 81% of the block RAM can be saved for an 8 ports switch.
QPS-r: A Cost-Effective Iterative Switching Algorithm for Input-Queued Switches.

Long Gong,Jun Xu,Liang Liu,Siva Theja Maguluri

DOI: https://doi.org/10.1016/j.peva.2021.102197

IF: 2.205

2021-01-01

Performance Evaluation

Abstract:In an input-queued switch, a crossbar schedule, or a matching between the input ports and the output ports needs to be computed for each switching cycle, or time slot. It is a challenging research problem to design switching algorithms that produce high-quality matchings yet have a very low computational complexity when the switch has a large number of ports. Indeed, there appears to be a fundamental tradeoff between the computational complexity of the switching algorithm and the quality of the computed matchings. Parallel maximal matching algorithms (adapted for switching) appear to be a sweet tradeoff point in this regard. On one hand, they provide the following performance guarantees: Using maximal matchings as crossbar schedules results in at least 50% switch throughput and order-optimal (i.e., independent of the switch size N) average delay bounds for various traffic arrival processes. On the other hand, their computational complexities can be as low as O(log2 N) per port/processor, which is much lower than those of the algorithms for finding matchings of higher qualities such as maximum weighted matching. In this work, we propose QPS-r, a parallel iterative switching algorithm that has the lowest possible computational complexity: O(1) per port. Yet, the matchings that QPS-r computes have the same quality as maximal matchings in the following sense: Using such matchings as crossbar schedules results in exactly the same aforementioned provable throughput and delay guarantees as using maximal matchings, as we show using Lyapunov stability analysis. Although QPS-r builds upon an existing add-on technique called Queue-Proportional Sampling (QPS), we are the first to discover and prove this nice property of such matchings. We also demonstrate that QPS-3 (running 3 iterations) has comparable empirical throughput and delay performances as iSLIP (running log2 N iterations), a refined and optimized representative maximal matching algorithm adapted for switching.
Dynamic queue length thresholds for scheduling real-time traffic in ATM networks

Chuang Lin,Lam, E.C.M.

DOI: https://doi.org/10.1109/ICC.1999.765398

1999-01-01

Abstract:New schemes of scheduling real-time traffic in high speed ATM networks are proposed for multiple priority queues based on dynamic queue length thresholds in real-time scheduling. The proposed schemes will provide guaranteed real-time service for each connection and cell sequence integrity for virtual channel/path characteristics. We provide the stochastic Petri net model of these schemes and an approximate analysis technique, which significantly reduce the complexity of the model solution and can be applied to real ATM switch models. Using numerical results we show that our schemes outperform well known schemes such as the head-of-line priority control and the queue length threshold policy
Distributed Load Adaptive Scheduling for High Speed Input Queued Switch

ST Sun,YJ Zhao,SM He,YF Zheng,W Gao

DOI: https://doi.org/10.1109/glocom.2004.1378145

2004-01-01

Abstract:Input queued switching architectures have become predominant in high speed switches and routers. In this paper, we change the point of view from weight-based matching to weight-based service, and propose a distributed load adaptive scheduling (DLAS) algorithm. In DLAS, the round robin arbiters are used to find a matching between the input ports and output ports. Once the matching between an input-output pair is established, the scheduler will keep it for a certain period, which is a function of the number of cells queued in the corresponding VOQ. Simulation results show that our scheme achieves high throughput and low delay under admissible traffic. For uniform Bernoulli i.i.d. traffic, it achieves 100% throughput, and for nonuniform traffic, its throughput is almost 100%.
Adaptive Approximate Fair Queueing for Shared-memory Programmable Switches

Danfeng Shan,Guangyu Peng,Shuzhen Ren,Jinchao Ma,Siyu Long,Yazhe Tang

DOI: https://doi.org/10.1109/tnse.2024.3377814

IF: 6.6

2024-01-01

IEEE Transactions on Network Science and Engineering

Abstract:Fair Queueing (FQ) is an ideal fair bandwidth allocation scheme but is rarely deployed in production networks due to its high complexity. Driven by the prevalence of commercial programmable switching ASICs (e.g., Broadcom Trident 4, Cisco Silicon One, and Intel Tofino), several recent approaches have shown that FQ can be approximated with limited FIFO queues. However, these approaches (implicitly) assume that each queue has a dedicated buffer, while commodity switching chips usually employ a globally shared memory and dynamically allocate buffer to each queue. When directly applied to shared-memory switches, these approaches are inadaptive to the traffic dynamics. In this paper, we reveal this problem with simulations and explore the intrinsic trade-off between buffer efficiency and fairness. Based on the observations, we design Adaptive Approximate Fair Queueing (A(2)FQ), a practical approximate FQ algorithm that is adaptive to traffic dynamics. At its heart, A(2)FQ dynamically changes the number of effective queues according to traffic characteristics. Extensive experiments and simulations show that A(2)FQ can improve fairness by up to 19.7x.
Parallel Switch System with QoS Guarantee for Real-Time Traffic

Wen-Jie Li,Bin Liu,Yang Xu,Heng Liao

DOI: https://doi.org/10.1007/s11390-006-1012-x

2006-01-01

Abstract:This paper studies the load-balancing algorithm and quality of service (QoS) control mechanism in a 320Gb/s switch system, which incorporates four packet-level parallel switch planes. Eight priorities for both unicast and multicast traffic are implemented, and the highest priority with strict QoS guarantee is designed for real-time traffic. Through performance analysis under multi-priority burst traffic, we demonstrate that the load-balancing algorithm is efficient, and the switch system not only provides excellent performance to real-time traffic, but also efficiently allocates bandwidth among other traffic of lower priorities. As a result, this parallel switch system is more scalable towards next generation core routers with QoS guarantee, as well as ensures in-order delivery of IP packets.
Preemptive Short-Packet-First Scheduling in Input Queueing Switches

LI Wen-jie,LIU Bin

DOI: https://doi.org/10.3321/j.issn:0372-2112.2005.04.001

2005-01-01

Abstract:Scheduling algorithms make a great impact on the performance of input queueing switches.From Internet traffic characteristics,it is pointed out that short packets should be guaranteed higher priority and lower delay in scheduling algorithms.In general packet-mode scheduling,short packets suffer from long waiting time due to the continuous transferring of cells of long packets.To solve this problem,we study the low-complexity preemptive packet-mode scheduling and propose the algorithm called preemptive short packets first (P-SPF).P-SPF improves the TCP performance by means of the fact that round-trip delays of TCP flows are greatly reduced.Both the analysis in queueing theory and the simulation results with respect to a real traffic model show that P-SPF can achieve almost zero average packet waiting time for short packets,while keeping a high overall throughput up to 94%.
Programmable Switch as a Parallel Computing Device

Li Chen,Ge Chen,Justinas Lingys,Kai Chen

DOI: https://doi.org/10.48550/arXiv.1803.01491

2018-03-05

Abstract:Modern switches have packet processing capacity of up to multi-tera bits per second, and they are also becoming more and more programmable. We seek to understand whether the programmability can translate packet processing capacity to computational power for parallel computing applications. In this paper, we first develop a simple mathematical model to understand the costs and overheads of data plane computation. Then we validate the the performance benefits of offloading computation to network. Using experiments on real data center network, we finnd that offloading computation to the data plane results in up to 20x speed-up for a simple Map-Reduce application. Motivated by this, we propose a parallel programming framework, p4mr, to help users efficiently program multiple switches. We successfully build and test a prototype of p4mr on a simulated testbed.

Networking and Internet Architecture,Distributed, Parallel, and Cluster Computing
Fixed-Length Switching Vs. Variable-Length Switching in Input-Queued Ip Switches

CC Hu,XF Chen,WJ Li,B Liu

DOI: https://doi.org/10.1109/ipom.2004.1547602

2004-01-01

Abstract:Many large-scale, high speed routers adopt input-queued switches with virtual output queuing (VOQ) for preventing head of line (HOL) blocking. Switching based on cell-by-cell scheduling algorithms (fixed-length switching) have been widely studied for years, while a new idea of transferring IP packet based on a packet-by-packet scheduling algorithm (variable-length switching) has been proposed recently. Fixed-length and variable-length switching can be significantly different in performance and implementation complexity. This paper establishes experiments at the aim of evaluating one design issue: whether it should be fixed-length switching or variable-length switching. We investigate various performance measures of interest: bandwidth utilization, packet loss, segmentation and reassembling overhead, as well as average packet latency. The focus of the paper is on identifying key parameters that influence the outcome of this comparison, and on quantifying the potential benefits of each switching mode.
Flexible Switching Architecture with Virtual-Queue for Time-Sensitive Networking Switches

Qiwen Yun,Qimin Xu,Yanzhou Zhang,Yingxiu Chen,Yafei Sun,Cailian Chen

DOI: https://doi.org/10.1109/iecon48115.2021.9589372

2021-01-01

Abstract:Time-Sensitive Networking (TSN) is a series of standards designed to enhance reliable and real-time transmission. Switching architecture is the essential component in TSN switches to guarantee the different quality of service (QoS) requirements. However, most existing TSN switching architectures are based on the fixed queue scheduling such as Input Queue or Output Queue, which leads to complex schedule processes and inefficient memory utilization. Therefore, a flexible and efficient switching architecture is needed in terms of heterogeneous traffics requirements. This paper proposes a Virtual-Queue Switching (VQS) architecture with Parallel Shared Memory (PSM) for TSN switches. First, we develop a virtual queue scheduler using the queue ID and the flow rank. By configuring the queue ID and the flow rank, the VQS architecture supports multiple scheduling strategies. Second, parallel shared memory (PSM) management is designed to ensure that storage of TS flows takes precedence over other flows. All kinds of flows share storage resources in PSM, which improves memory utilization. At last, a scheduling algorithm for IEEE 802.1Qbv based on VQS architecture is designed. Compared From the comparison results with the previous switching
QPS-r: A Cost-Effective Crossbar Scheduling Algorithm and Its Stability and Delay Analysis

Long Gong,Jun Xu,Liang Liu,Siva Theja Maguluri

DOI: https://doi.org/10.48550/arxiv.1905.05392

2019-01-01

Abstract:In an input-queued switch, a crossbar schedule, or a matching between the input ports and the output ports needs to be computed in each switching cycle, or time slot. Designing switching algorithms with very low computational complexity, that lead to high throughput and small delay is a challenging problem. There appears to be a fundamental tradeoff between the computational complexity of the switching algorithm and the resultants throughput and delay. Parallel maximal matching algorithms (adapted for switching) appear to have stricken a sweet spot in this tradeoff, and prior work has shown the following performance guarantees. Using maximal matchings in every time slot results in at least 50% switch throughput and order-optimal (i.e., independent of the switch size N) average delay bounds for various traffic arrival processes. On the other hand, their computational complexity can be as low as $O(log^2N)$ per port/processor, which is much lower than those of the algorithms such as maximum weighted matching which ensures better throughput performance. In this work, we propose QPS-r, a parallel iterative switching algorithm that has the lowest possible computational complexity: O(1) per port. Using Lyapunov stability analysis, we show that the throughput and delay performance is identical to that of maximal matching algorithm. Although QPS-r builds upon an existing technique called Queue-Proportional Sampling (QPS), in this paper, we provide analytical guarantees on its throughput and delay under i.i.d. traffic as well as a Markovian traffic model which can model many realistic traffic patterns. We also demonstrate that QPS-3 (running 3 iterations) has comparable empirical throughput and delay performances as iSLIP (running $log_2 N$ iterations), a refined and optimized representative maximal matching algorithm adapted for switching.
Application of Distributed Scheduling Algorithm in VOQ Switch

XU Xiao-fei

2006-01-01

Abstract:To improve the communication efficiency,a new communication-scheduling algorithm named DSA(Distributed Scheduling Algorithm)was put forward in VOQ switch by scheduling high-speed data packet in every output port independently.Compared with other traditional scheduling algorithms,which can only schedule the constant length message,the DSA can directly schedule the communication under variable message length.The simulation results show that the DSA scheduler outperforms iSLIP scheduling algorithm under all traffic.DSA can work efficiently in VOQ switch.
How Powerful Switches Should be Deployed: A Precise Estimation Based on Queuing Theory

Gengbiao Shen,Qing Li,Shuo Ai,Yong Jiang,Mingwei Xu,Xuya Jia

DOI: https://doi.org/10.1109/INFOCOM.2019.8737629

2019-01-01

Abstract:Software-Defined Networking (SDN) provides a tractable and efficient architecture for operators to customize their network functions. Many traditional Data Center Networks (DCNs) are upgraded by SDN to improve link utilization and management flexibility, but they are lack of the instructions for selecting the substitutive SDN switches with the proper flow table space to achieve cost-effective and energy-saving networks. In this paper, we fill the gap of solving the flow table space estimation problem based on queuing theory. First, we divide the life process of a flow table entry into the packet-in process, the handling process and the serving process to establish a queuing system to estimate the least required number of the flow table entries of SDN switches. Second, we analyze the traffic distribution of DCNs to calculate the critical parameters in our model. Third, on the basis of the essence of the structured topologies in DCNs, we construct a probability model of routing strategies to quantize the influence of path selection. Comprehensive experiments show that the relative flow table space estimation error of our model can be less than 10%, which can give operators insights into the requirement of the SDN switches at specific positions.

Prophet - Real-time Queue Length Inference in Programmable Switches.

Sra: Switch Resource Aggregation For Application Offloading In Programmable Networks

Processor Scheduling in Programmable Router Based on Queue Length Thresholds

A Novel Processor Scheduling Schema in Programmable Router Based on Queue Length Thresholds

Switch Real-Time Industrial Ethernet with Mixed Scheduling Policy

System-level Exploration of Queuing Management Schemes for Input Queue Packet Switches

Delay Comparison of Different Switch Architectures

Dynamic Per-Flow Queues for TSN Switches

Design and Implementation of a Queue Manager for IP Switches with Massive Ports

QPS-r: A Cost-Effective Iterative Switching Algorithm for Input-Queued Switches.

Dynamic queue length thresholds for scheduling real-time traffic in ATM networks

Distributed Load Adaptive Scheduling for High Speed Input Queued Switch

Adaptive Approximate Fair Queueing for Shared-memory Programmable Switches

Parallel Switch System with QoS Guarantee for Real-Time Traffic

Preemptive Short-Packet-First Scheduling in Input Queueing Switches

Programmable Switch as a Parallel Computing Device

Fixed-Length Switching Vs. Variable-Length Switching in Input-Queued Ip Switches

Flexible Switching Architecture with Virtual-Queue for Time-Sensitive Networking Switches

QPS-r: A Cost-Effective Crossbar Scheduling Algorithm and Its Stability and Delay Analysis

Application of Distributed Scheduling Algorithm in VOQ Switch

How Powerful Switches Should be Deployed: A Precise Estimation Based on Queuing Theory