Abstract:With the rapid advancement of the Internet of Things (IoT), there is a global surge in network traffic. Software-Defined Networks (SDNs) provide a holistic network perspective, facilitating software-based traffic analysis, and are more suitable to handle dynamic loads than a traditional network. The standard SDN architecture control plane has been designed for a single controller or multiple distributed controllers; however, a logically centralized single controller faces severe bottleneck issues. Most proposed solutions in the literature are based on the static deployment of multiple controllers without the consideration of flow fluctuations and traffic bursts, which ultimately leads to a lack of load balancing among controllers in real time, resulting in increased network latency. Moreover, some methods addressing dynamic controller mapping in multi-controller SDNs consider load fluctuation and latency but face controller placement problems. Earlier, we proposed priority scheduling and congestion control algorithm (eSDN) and dynamic mapping of controllers for dynamic SDN (dSDN) to address this issue. However, the future growth of IoT is unpredictable and potentially exponential; to accommodate this futuristic trend, we need an intelligent solution to handle the complexity of growing heterogeneous devices and minimize network latency. Therefore, this paper continues our previous research and proposes temporal deep Q learning in the dSDN controller. A Temporal Deep Q learning Network (tDQN) serves as a self-learning reinforcement-based model. The agent in the tDQN learns to improve decision-making for switch-controller mapping through a reward–punish scheme, maximizing the goal of reducing network latency during the iterative learning process. Our approach—tDQN—effectively addresses dynamic flow mapping and latency optimization without increasing the number of optimally placed controllers. A multi-objective optimization problem for flow fluctuation is formulated to divert the traffic to the best-suited controller dynamically. Extensive simulation results with varied network scenarios and traffic show that the tDQN outperforms traditional networks, eSDNs, and dSDNs in terms of throughput, delay, jitter, packet delivery ratio, and packet loss.

Optimization of Load Balancing Strategy by Self-powered Sensor and Digital Twins in Software Defined Networks

An Optimal Load Distribution and Real-Time Control Strategy for Integrated Energy System Based on Nonlinear Model Predictive Control

Intelligent Optimizing Scheme for Load Balancing in Software Defined Networks

Dynamic Load-Balancing Vertical Control for Large-Scale Software-Defined Internet of Things

A Load Balancing Strategy of SDN Controller Based on Distributed Decision

Dynamic Load Balancing Using Software Defined Networks

Load Balancing Strategy for SDN Multi-Controller Clusters Based on Load Prediction

Research on SDN Load Balancing Based on Ant Colony Optimization Algorithm

Network-Balanced Algorithm Based on Hierarchical Subnet Space for Software-Defined Wireless Sensor Networks

A Novel Control Plane Optimization Strategy For Important Nodes In Sdn-Iot Networks

An SDN-based Hybrid Strategy for Load Balancing in Data Center Networks

Energy‐aware dynamic‐link load balancing method for a software‐defined network using a multi‐objective artificial bee colony algorithm and genetic operators

Optimizing Network Performance with AI-Enabled Adaptive Routing in SDN

A Multicontroller Load Balancing Approach in Software-Defined Wireless Networks

Software Defined Network Architecture Based Research on Load Balancing Strategy

Exploiting Industrial Big Data Strategy for Load Balancing in Industrial Wireless Mobile Networks.

A Temporal Deep Q Learning for Optimal Load Balancing in Software-Defined Networks

An OpenFlow-Based Load Balancing Strategy in SDN

Controller Placement in Software Defined Internet of Things Using Optimization Algorithm

Load balancing scheme based on multi-objective optimization for software defined network

Fairness and Load Balancing in SDWN Using Handoff-Delay-Based Association Control and Load Monitoring