Abstract:The cross-domain multicast routing problem in a software-defined wireless network with multiple controllers is a classic NP-hard optimization problem. As the network size increases, designing and implementing cross-domain multicast routing paths in the network requires not only designing efficient solution algorithms to obtain the optimal cross-domain multicast tree but also ensuring the timely and flexible acquisition and maintenance of global network state information. However, existing solutions have a limited ability to sense the network traffic state, affecting the quality of service of multicast services. In addition, these methods have difficulty adapting to the highly dynamically changing network states and have slow convergence speeds. To this end, this paper aims to design and implement a multiagent deep reinforcement learning based cross-domain multicast routing method for SDWN with multicontroller domains. First, a multicontroller communication mechanism and a multicast group management module are designed to transfer and synchronize network information between different control domains of the SDWN, thus effectively managing the joining and classification of members in the cross-domain multicast group. Second, a theoretical analysis and proof show that the optimal cross-domain multicast tree includes an interdomain multicast tree and an intradomain multicast tree. An agent is established for each controller, and a cooperation mechanism between multiple agents is designed to effectively optimize cross-domain multicast routing and ensure consistency and validity in the representation of network state information for cross-domain multicast routing decisions. Third, a multiagent reinforcement learning-based method that combines online and offline training is designed to reduce the dependence on the real-time environment and increase the convergence speed of multiple agents.

Multicast Scheduling over Multiple Channels: A Distribution-Embedding Deep Reinforcement Learning Method

Multicast Schedule for Multi-Message over Multi-Channel: A Permutation-based Wolpertinger Deep Reinforcement Learning Method

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

Adaptive Video Streaming for Massive MIMO Networks Via Approximate MDP and Reinforcement Learning

Deep Reinforcement Learning Based Computation Offloading in Heterogeneous MEC Assisted by Ground Vehicles and Unmanned Aerial Vehicles

Cache-Enabled Multicast Content Pushing with Structured Deep Learning

Energy-Aware MPTCP Scheduling in Heterogeneous Wireless Networks Using Multi-Agent Deep Reinforcement Learning Techniques

Multi-Agent Reinforcement Learning based Uplink OFDMA for IEEE 802.11ax Networks

Distributed Adaptive Multiuser Scheduling Via Multi-Agent Reinforcement Learning in Multicell MIMO Cellular Networks

Optimal Dynamic Multicast Scheduling for Cache-Enabled Content-Centric Wireless Networks.

MA-CDMR: An Intelligent Cross-domain Multicast Routing Method based on Multiagent Deep Reinforcement Learning in Multi-domain SDWN

Multiple Access for Heterogeneous Wireless Networks with Imperfect Channels Based on Deep Reinforcement Learning

DeepMPR: Enhancing Opportunistic Routing in Wireless Networks through Multi-Agent Deep Reinforcement Learning

DRL Assisted Multi-Objective Algorithm for Multicast Scheduling in Elastic Optical Network

Assigning Credit with Partial Reward Decoupling in Multi-Agent Proximal Policy Optimization

Multi-agent Deep Reinforcement Learning for Cross-Layer Scheduling in Mobile Ad-Hoc Networks

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

Research on Multi-Agent Communication and Collaborative Decision-Making Based on Deep Reinforcement Learning

Towards Beam Hopping and Power Allocation in Multi-Beam Satellite Systems with Parameterized Reinforcement Learning

Multi-Agent Reinforcement Learning Based Distributed Multi-User Scheduling and Beamforming Design in Multi-Cell Systems

Intelligent multicast routing method based on multi-agent deep reinforcement learning in SDWN