Abstract:With the rapid advancement of the Internet of Things (IoT), there is a global surge in network traffic. Software-Defined Networks (SDNs) provide a holistic network perspective, facilitating software-based traffic analysis, and are more suitable to handle dynamic loads than a traditional network. The standard SDN architecture control plane has been designed for a single controller or multiple distributed controllers; however, a logically centralized single controller faces severe bottleneck issues. Most proposed solutions in the literature are based on the static deployment of multiple controllers without the consideration of flow fluctuations and traffic bursts, which ultimately leads to a lack of load balancing among controllers in real time, resulting in increased network latency. Moreover, some methods addressing dynamic controller mapping in multi-controller SDNs consider load fluctuation and latency but face controller placement problems. Earlier, we proposed priority scheduling and congestion control algorithm (eSDN) and dynamic mapping of controllers for dynamic SDN (dSDN) to address this issue. However, the future growth of IoT is unpredictable and potentially exponential; to accommodate this futuristic trend, we need an intelligent solution to handle the complexity of growing heterogeneous devices and minimize network latency. Therefore, this paper continues our previous research and proposes temporal deep Q learning in the dSDN controller. A Temporal Deep Q learning Network (tDQN) serves as a self-learning reinforcement-based model. The agent in the tDQN learns to improve decision-making for switch-controller mapping through a reward–punish scheme, maximizing the goal of reducing network latency during the iterative learning process. Our approach—tDQN—effectively addresses dynamic flow mapping and latency optimization without increasing the number of optimally placed controllers. A multi-objective optimization problem for flow fluctuation is formulated to divert the traffic to the best-suited controller dynamically. Extensive simulation results with varied network scenarios and traffic show that the tDQN outperforms traditional networks, eSDNs, and dSDNs in terms of throughput, delay, jitter, packet delivery ratio, and packet loss.

Delay-Aware Routing in Software-Defined Networks Via Network Tomography and Reinforcement Learning

QoS Routing Optimization Based on Deep Reinforcement Learning in SDN

A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization

Managing Recurrent Virtual Network Updates in Multi-Tenant Datacenters: A System Perspective

DROM: Optimizing the Routing in Software-Defined Networks with Deep Reinforcement Learning

A Routing Optimization Method for Software-Defined Optical Transport Networks Based on Ensembles and Reinforcement Learning

DQS: A QoS-Driven Routing Optimization Approach in SDN using Deep Reinforcement Learning

Delay-bounded Topology Construction and Routing Integration for Time-critical Services

An Intelligent Routing Mechanism Based on Deep Reinforcement Learning

Real-time Update with Joint Optimization of Route Selection and Update Scheduling for SDNs

QoS-Aware Adaptive Routing in Multi-layer Hierarchical Software Defined Networks: A Reinforcement Learning Approach

A Routing Optimization Method for Software-Defined SGIN Based on Deep Reinforcement Learning

Including artificial intelligence in a routing protocol using Software Defined Networks

Deep Reinforcement Learning for On-demand Intelligent Routing in Deterministic Networks

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

A Temporal Deep Q Learning for Optimal Load Balancing in Software-Defined Networks

Load-Balancing Software-Defined Networking Through Hybrid Routing

Deep Graph Reinforcement Learning Based Intelligent Traffic Routing Control for Software-Defined Wireless Sensor Networks

AQROM: A quality of service aware routing optimization mechanism based on asynchronous advantage actor-critic in software-defined networks

Traffic-aware optimal routing in software defined networks by predicting traffic using neural network

Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach