Abstract:With the rapid advancement of the Internet of Things (IoT), there is a global surge in network traffic. Software-Defined Networks (SDNs) provide a holistic network perspective, facilitating software-based traffic analysis, and are more suitable to handle dynamic loads than a traditional network. The standard SDN architecture control plane has been designed for a single controller or multiple distributed controllers; however, a logically centralized single controller faces severe bottleneck issues. Most proposed solutions in the literature are based on the static deployment of multiple controllers without the consideration of flow fluctuations and traffic bursts, which ultimately leads to a lack of load balancing among controllers in real time, resulting in increased network latency. Moreover, some methods addressing dynamic controller mapping in multi-controller SDNs consider load fluctuation and latency but face controller placement problems. Earlier, we proposed priority scheduling and congestion control algorithm (eSDN) and dynamic mapping of controllers for dynamic SDN (dSDN) to address this issue. However, the future growth of IoT is unpredictable and potentially exponential; to accommodate this futuristic trend, we need an intelligent solution to handle the complexity of growing heterogeneous devices and minimize network latency. Therefore, this paper continues our previous research and proposes temporal deep Q learning in the dSDN controller. A Temporal Deep Q learning Network (tDQN) serves as a self-learning reinforcement-based model. The agent in the tDQN learns to improve decision-making for switch-controller mapping through a reward–punish scheme, maximizing the goal of reducing network latency during the iterative learning process. Our approach—tDQN—effectively addresses dynamic flow mapping and latency optimization without increasing the number of optimally placed controllers. A multi-objective optimization problem for flow fluctuation is formulated to divert the traffic to the best-suited controller dynamically. Extensive simulation results with varied network scenarios and traffic show that the tDQN outperforms traditional networks, eSDNs, and dSDNs in terms of throughput, delay, jitter, packet delivery ratio, and packet loss.

DQN Approach for Adaptive Self-Healing of VNFs in Cloud-Native Network

Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach

DeepThrottle: Deep Reinforcement Learning for Router Throttling to Defend Against DDoS Attack in SDN

AQMDRL: Automatic Quality of Service Architecture Based on Multistep Deep Reinforcement Learning in Software-Defined Networking

VNE Solution for Network Differentiated QoS and Security Requirements: From the Perspective of Deep Reinforcement Learning

Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning

DDQP: A Double Deep Q-Learning Approach to Online Fault-Tolerant SFC Placement

Auto-Scaling Network Resources using Machine Learning to Improve QoS and Reduce Cost

Management and Orchestration of Virtual Network Functions via Deep Reinforcement Learning

Network Resource Allocation Strategy Based on Deep Reinforcement Learning

Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

A Temporal Deep Q Learning for Optimal Load Balancing in Software-Defined Networks

Optimized Resource Allocation for Cloud-Native 6G Networks: Zero-Touch ML Models in Microservices-based VNF Deployments

Intelligent load balancing in data center software‐defined networks

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Deep Reinforcement Learning for Orchestrating Cost-Aware Reconfigurations of vRANs

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

Resilience-based post disaster recovery optimization for infrastructure system via Deep Reinforcement Learning

Deep Reinforcement Learning for Resource Demand Prediction and Virtual Function Network Migration in Digital Twin Network

Enhancing Software‐Defined Networking With Dynamic Load Balancing and Fault Tolerance Using a Q‐Learning Approach