Abstract:Modern data center power distribution networks place greater demands on the stability and reliability of power supply. Growing network computing demands and complex network environments can cause network congestion, which in turn leads to network traffic overload and power supply equipment overload. Therefore, network congestion is one of the most important problems faced by data center power distribution networks. In this paper, we propose an approach called ACC-RL based on reinforcement learning (RL), which can effectively avoid network congestion and improve energy performance. ACC-RL models the congestion control task as a Partially Observable Markov Decision Process (POMDP). It is independent of the estimated value function and supports deterministic policies. It also sets the reward value function using real-time network information such as the transmission rate, RTT, and switch queue length, with the target transmission rate as the target equilibrium point. ACC-RL is highly general, can be trained on datasets running in different network environments, and generates a robust congestion control policy. The experimental results show that ACC-RL can solve the congestion problem without any predefined scenarios in different network environments. It can control the network traffic well, thus ensuring the stability and reliability of the power supply in the distribution network. We conduct network simulation experiments through NS-3. We set up different scenarios for experiments and data analysis in many-to-one, all-to-all, and long–short network environments. Compared with the popular rule-based congestion control algorithms such as TIMELY, DCQCN, and HPCC, ACC-RL shows different degrees of energy performance advantages in network metrics such as fairness, link utilization, and throughput.

Congestion Response Cost Assessment of Process-layer Network in Smart Substation

Network calculus based performance analysis of forces sctp tml in congestion avoidance stage

Research on Energy Saving and Emission Reduction Technology Based on Field Communication and Embedded Control Computer Data Exchange Algorithm

Study On Process Level Network Message Transmission Time Of Smart Substation

Assessment and Quantify the Impact of Different Data Flow Control Methods on Digital Substation Communication Network

Effectiveness evaluation model of smart substation automation system

Study on Communication Service Strategy for Congestion Issue in Smart Substation Communication Network

CP Fusion based Abnormal Traffic Dedection for Process Layer Network in Digital Substation

Quantitative Assessment of Stochastic Property of Network-Induced Time Delay in Smart Substation Cyber Communications.

Method for Congested Traffic Network State Analysis Based on Reasonable Routes

A Cross-Layer Congestion Control Strategy in Wireless Sensor Network

A Protection Method Based on Message Identification and Flow Monitoring for Managing the Congestion Arising from Network Attacks on Smart Substation

ACC-RL: Adaptive Congestion Control Based on Reinforcement Learning in Power Distribution Networks with Data Centers

HSR-based Intelligent Substation Process Level Communication Network

Regional Congestion Control in Datacenter Networks

Research for Congestion Due to Voltage Security Requirements

On the Modeling and Analysis of Communication Traffic in Intelligent Electric Power Substations

The Research Of Active Network Congestion Control Algorithm

Assessing the Impact of Advanced Technologies on Utilization Improvement of Substations

Regional Congestion Mitigation in Lossless Datacenter Networks.

A novel analytical method for optimal management of network congestion caused by electric vehicle charging stations