Abstract:With the rapid advancement of the Internet of Things (IoT), there is a global surge in network traffic. Software-Defined Networks (SDNs) provide a holistic network perspective, facilitating software-based traffic analysis, and are more suitable to handle dynamic loads than a traditional network. The standard SDN architecture control plane has been designed for a single controller or multiple distributed controllers; however, a logically centralized single controller faces severe bottleneck issues. Most proposed solutions in the literature are based on the static deployment of multiple controllers without the consideration of flow fluctuations and traffic bursts, which ultimately leads to a lack of load balancing among controllers in real time, resulting in increased network latency. Moreover, some methods addressing dynamic controller mapping in multi-controller SDNs consider load fluctuation and latency but face controller placement problems. Earlier, we proposed priority scheduling and congestion control algorithm (eSDN) and dynamic mapping of controllers for dynamic SDN (dSDN) to address this issue. However, the future growth of IoT is unpredictable and potentially exponential; to accommodate this futuristic trend, we need an intelligent solution to handle the complexity of growing heterogeneous devices and minimize network latency. Therefore, this paper continues our previous research and proposes temporal deep Q learning in the dSDN controller. A Temporal Deep Q learning Network (tDQN) serves as a self-learning reinforcement-based model. The agent in the tDQN learns to improve decision-making for switch-controller mapping through a reward–punish scheme, maximizing the goal of reducing network latency during the iterative learning process. Our approach—tDQN—effectively addresses dynamic flow mapping and latency optimization without increasing the number of optimally placed controllers. A multi-objective optimization problem for flow fluctuation is formulated to divert the traffic to the best-suited controller dynamically. Extensive simulation results with varied network scenarios and traffic show that the tDQN outperforms traditional networks, eSDNs, and dSDNs in terms of throughput, delay, jitter, packet delivery ratio, and packet loss.

Virtualized controller placement for multi-domain optical transport networks using machine learning

Controller Placement Based on Hierarchical Multi-center SDN

Traffic-aware dynamic controller placement in SDN using NFV

Elevating optical networks: Machine learning approach for optimal resource scheduling and performance boost

Self-adjusting resilient control plane for virtual software-defined optical networks

Applying Multi-Controller Collaboration in Fine-Grained All-Optical Intra-Datacenter Networks

Machine Learning Assisted Optical Network Resource Scheduling in Data Center Networks

Two Use Cases of Machine Learning for SDN-Enabled IP/Optical Networks: Traffic Matrix Prediction and Optical Path Performance Prediction

Auto-Scaling Network Resources using Machine Learning to Improve QoS and Reduce Cost

Resilient Control-Plane Design for T-SDN Based Optical Transport Networks

MEC-Based Dynamic Controller Placement in SD-IoV: A Deep Reinforcement Learning Approach

A Temporal Deep Q Learning for Optimal Load Balancing in Software-Defined Networks

Optical wireless communication based mobile edge computing integrated channel allocation using scheduling with machine learning protocols in advanced 5G networks

A Novel Multi-Controller Placement Scheme Against Single Controller Failure in Software Defined Optical Networks

Load-Aware Dynamic Controller Placement Based on Deep Reinforcement Learning in SDN-Enabled Mobile Cloud-Edge Computing Networks

Capacity, resilience and virtual embedding in elastic optical networks planning with adopted machine learning

Enabling Traffic Forecasting with Cloud-native SDN Controller in Transport Networks

Towards Controller Placement for Robust Software-Defined Networks

ICLB: intelligent controllers load balancing for software-defined based optical data center networks

Predictive resource allocation and VNF deployment using ensemble learning

Multi-Tenant Software-Defined Hybrid Optical Switched Data Centre