Abstract:Modern electrical systems are evolving with data communication networks, ushering in upgraded electrical infrastructures and enabling bidirectional communication between utility grids and consumers. The selection of communication technologies is crucial, where wireless communications have emerged as one of the main benefactor technologies due to its cost-effectiveness, scalability, and ease of deployment. Ensuring the streamlined transmission of diverse applications between residential users and utility control centers is crucial for the effective data delivery in smart grids. This paper proposes a congestion control mechanism tailored to smart grid applications using unreliable transport protocols such as UDP, which, unlike TCP, lacks inherent congestion control, presenting a significant challenge to the performance of the network. In this article, we have exploited a reinforcement learning (RL) algorithm and a deep Q-neural network (DQN), to manage congestion control under a UDP environment. In this particular instance, the DQN model learns on its own from interactions with the environment without the need to generate a dataset, rendering it apt for intricate and dynamic scenarios within smart grid communications. Our evaluation covers two scenarios: 1) a grid-like configuration, and 2) urban scenarios considering the deployment of smart meters in the cities of Montreal, Berlin and Beijing. These evaluations provide a comprehensive examination of the proposed DQN-based congestion control approach under different conditions, showing its effectiveness and adaptability. Conducting a comprehensive performance assessment in both scenarios leads to improvements in metrics such as packet delivery ratio, network throughput, fairness between different traffic sources, packet network transit time, and QoS provision.

Reinforcement Learning Based Congestion Control in a Real Environment.

TRCC: Transferable Congestion Control with Reinforcement Learning

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

Deep Reinforcement Learning for Smart City Communication Networks

A Deep Reinforcement Learning Framework for Optimizing Congestion Control in Data Centers

Internet Congestion Control via Deep Reinforcement Learning

Congestion Control in SDN-Based Networks via Multi-Task Deep Reinforcement Learning

RAN Information-Assisted TCP Congestion Control Using Deep Reinforcement Learning with Reward Redistribution

DeepCC: Multi-Agent Deep Reinforcement Learning Congestion Control for Multi-Path TCP Based on Self-Attention

Reinforcement learning for bandwidth estimation and congestion control in real-time communications

MA-CC: Cross-Layer Congestion Control via Multi-agent Reinforcement Learning

A Reinforcement Learning Congestion Control Algorithm for Smart Grid Networks

Towards Fair and Efficient Learning-based Congestion Control

A New Solution for Freeway Congestion: Cooperative Speed Limit Control Using Distributed Reinforcement Learning

An Intelligent Congestion Control Strategy in Heterogeneous V2X Based on Deep Reinforcement Learning

MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

ACC-RL: Adaptive Congestion Control Based on Reinforcement Learning in Power Distribution Networks with Data Centers

DECC: Achieving Low Latency in Data Center Networks with Deep Reinforcement Learning

ZiXia: A Reinforcement Learning Approach via Adjusted Ranking Reward for Internet Congestion Control

Demonstration-guided Deep Reinforcement Learning for Coordinated Ramp Metering and Perimeter Control in Large Scale Networks

A Cyber-Physical System for Freeway Ramp Meter Signal Control Using Deep Reinforcement Learning in a Connected Environment