Abstract:The cross-domain multicast routing problem in a software-defined wireless network with multiple controllers is a classic NP-hard optimization problem. As the network size increases, designing and implementing cross-domain multicast routing paths in the network requires not only designing efficient solution algorithms to obtain the optimal cross-domain multicast tree but also ensuring the timely and flexible acquisition and maintenance of global network state information. However, existing solutions have a limited ability to sense the network traffic state, affecting the quality of service of multicast services. In addition, these methods have difficulty adapting to the highly dynamically changing network states and have slow convergence speeds. To this end, this paper aims to design and implement a multiagent deep reinforcement learning based cross-domain multicast routing method for SDWN with multicontroller domains. First, a multicontroller communication mechanism and a multicast group management module are designed to transfer and synchronize network information between different control domains of the SDWN, thus effectively managing the joining and classification of members in the cross-domain multicast group. Second, a theoretical analysis and proof show that the optimal cross-domain multicast tree includes an interdomain multicast tree and an intradomain multicast tree. An agent is established for each controller, and a cooperation mechanism between multiple agents is designed to effectively optimize cross-domain multicast routing and ensure consistency and validity in the representation of network state information for cross-domain multicast routing decisions. Third, a multiagent reinforcement learning-based method that combines online and offline training is designed to reduce the dependence on the real-time environment and increase the convergence speed of multiple agents.

Multicast Schedule for Multi-Message over Multi-Channel: A Permutation-based Wolpertinger Deep Reinforcement Learning Method

Multicast Scheduling over Multiple Channels: A Distribution-Embedding Deep Reinforcement Learning Method

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

Wireless Channel Prediction for Multi-user Physical Layer with Deep Reinforcement Learning

A Reinforcement Learning Approach for Multipath TCP Data Scheduling

Deep Reinforcement Learning for Wireless Scheduling in Distributed Networked Control

Decentralized Federated Reinforcement Learning for User-Centric Dynamic TFDD Control

Adaptive Video Streaming for Massive MIMO Networks Via Approximate MDP and Reinforcement Learning

Multipath TCP Meets Reinforcement Learning: A Novel Energy-Efficient Scheduling Approach in Heterogeneous Wireless Networks

Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks

Multi-User Delay-Constrained Scheduling With Deep Recurrent Reinforcement Learning

MA-CDMR: An Intelligent Cross-domain Multicast Routing Method based on Multiagent Deep Reinforcement Learning in Multi-domain SDWN

Effective Multi-User Delay-Constrained Scheduling with Deep Recurrent Reinforcement Learning

Adaptive transmission scheduling over fading channels for energy-efficient cognitive radio networks by reinforcement learning

Deep Reinforcement Learning-based Power Control and Bandwidth Allocation Policy for Weighted Cost Minimization in Wireless Networks

Energy-Aware MPTCP Scheduling in Heterogeneous Wireless Networks Using Multi-Agent Deep Reinforcement Learning Techniques

Structured Reinforcement Learning for Delay-Optimal Data Transmission in Dense mmWave Networks

Deep Reinforcement Learning Based Mode Selection and Power Allocation Scheme for Convergent Power-Efficient Network.

Intelligent multicast routing method based on multi-agent deep reinforcement learning in SDWN

Distributed Adaptive Multiuser Scheduling Via Multi-Agent Reinforcement Learning in Multicell MIMO Cellular Networks

DRL Assisted Multi-Objective Algorithm for Multicast Scheduling in Elastic Optical Network