Imitation Learning Based Heavy-Hitter Scheduling Scheme in Software-Defined Industrial Networks
Yazhi Liu,Qianqian Wu,Jianwei Niu,Xiong Li,Zheng Song
DOI: https://doi.org/10.1109/tii.2021.3130279
IF: 12.3
2022-06-01
IEEE Transactions on Industrial Informatics
Abstract:To realize flexible networking and on-demand topology reconstructing, software-defined industrial networks (SDINs) are increasingly embracing the flat structure. Similar to software defined networks (SDN), SDIN suffers from low traffic scheduling efficiency caused by large and imbalanced flows, known as the heavy hitters problem. Due to such heavy hitters, industrial networks may fail to satisfy applications QoS requirements, which results in more severe damages. To improve flow scheduling efficiency under heavy hitters, this article introduces a novel imitation learning-based flow scheduling (ILFS) method. ILFS utilizes P4-based In-band Network Telemetry (INT) to collect fine-grained, real-time traffic data from SDINs data plane. In the control plane, it integrates the Generative Adversarial Imitation Learning (GAIL) model with a soft actor critic to preserve the experiences of flow, thereby better scheduling large flows. Our experiments thoroughly compare ILFSs performance with several state-of-the-art traffic scheduling strategies. The results indicate that ILFS successfully controls the link bandwidth the utilization between 10$\%$ and 80$\%$ and significantly improves the average network throughput and link utilization rate.
automation & control systems,computer science, interdisciplinary applications,engineering, industrial