A Reinforcement Learning-Based Traffic Engineering Algorithm for Enterprise Network Backbone Links

Haixiu Cheng,Yingxin Luo,Ling Zhang,Zhiwen Liao

DOI: https://doi.org/10.3390/electronics13081441

IF: 2.9

2024-04-11

Electronics

Abstract:Large enterprise networks typically rely on expensive, high-speed backbone links to connect multiple campuses across diverse regions. As the volume of traffic traversing these backbone links increases, traffic engineering techniques are employed to filter or redirect traffic flows. Nevertheless, simple rerouting strategies can introduce business disruptions such as packet reordering, which significantly impact the user experience. To address this issue, we introduce an enhanced traffic scheduling algorithm named Critical Flow Rerouting with Weight- Reinforcement Learning(CFRW-RL), which builds upon the critical flow rerouting-reinforcement learning (CFR-RL) algorithm. CFRW-RL incorporates the principles of reinforcement learning, accounting for both the weights and classifications of data flows. This approach enables the algorithm to prioritize flows with lower weights for rerouting. The simulation results demonstrate that CFRW-RL significantly minimizes the rerouting of high-priority business flows and reduces business interference compared with the CFR-RL algorithm and that it maintains a similar computational complexity.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

The paper aims to solve the traffic engineering problem in the enterprise network backbone links. With the enterprise network spanning multiple campuses across different regions and relying on high-speed backbone links to transmit a large amount of traffic, simple traffic redirection strategies can lead to service interruptions, such as packet reordering, significantly affecting user experience. To address this issue, the paper proposes a weighted critical flow rerouting algorithm based on reinforcement learning (CFRW-RL). It combines the principles of reinforcement learning with the original critical flow rerouting-reinforcement learning (CFR-RL) algorithm, taking into account the weights and classifications of data flows. The algorithm prioritizes rerouting critical flows with lower weights to reduce rerouting for high-priority business flows, minimizing business disruptions while maintaining comparable computational complexity to the CFR-RL algorithm. Through simulation experiments, the algorithm demonstrates advantages in optimizing network performance and reducing service interruptions.

A Reinforcement Learning-Based Traffic Engineering Algorithm for Enterprise Network Backbone Links

TRCC: Transferable Congestion Control with Reinforcement Learning

CFR-RL: Traffic Engineering with Reinforcement Learning in SDN

Freeway network traffic management based on distributed reinforcement learning

Traffic Measurement Optimization Based on Reinforcement Learning in Large-Scale IP Backbone Networks

Traffic Measurement Optimization Based on Reinforcement Learning in Large-Scale ITS-Oriented Backbone Networks.

A Machine Learning Method for Dynamic Traffic Control and Guidance on Freeway Networks

Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning

Efficiency and equity based freeway traffic network flow control

Traffic Engineering in Hybrid Software Defined Network Via Reinforcement Learning

A Freeway Traffic Flow Control Model Based on Distributed Reinforcement Learning

ERODRL: Efficient ISP Routing Optimization Via Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

Deep Reinforcement Learning-Based Traffic Engineering in Cloud-Edge-End Collaboration Environments

DRL-TAL: Deep Reinforcement Learning-Based Traffic-Aware Load Balancing in Data Center Networks

Traffic Engineering in a Shared Inter-DC WAN Via Deep Reinforcement Learning

Distributed Traffic Engineering in Hybrid Software Defined Networks: A Multi-agent Reinforcement Learning Framework

Reinforcement Learning Based Congestion Control in a Real Environment.

Integrated Traffic Control for Freeway Recurrent Bottleneck Based on Deep Reinforcement Learning

Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

Deep reinforcement learning based multi-layered traffic scheduling scheme in data center networks