Abstract:The cross-domain multicast routing problem in a software-defined wireless network with multiple controllers is a classic NP-hard optimization problem. As the network size increases, designing and implementing cross-domain multicast routing paths in the network requires not only designing efficient solution algorithms to obtain the optimal cross-domain multicast tree but also ensuring the timely and flexible acquisition and maintenance of global network state information. However, existing solutions have a limited ability to sense the network traffic state, affecting the quality of service of multicast services. In addition, these methods have difficulty adapting to the highly dynamically changing network states and have slow convergence speeds. To this end, this paper aims to design and implement a multiagent deep reinforcement learning based cross-domain multicast routing method for SDWN with multicontroller domains. First, a multicontroller communication mechanism and a multicast group management module are designed to transfer and synchronize network information between different control domains of the SDWN, thus effectively managing the joining and classification of members in the cross-domain multicast group. Second, a theoretical analysis and proof show that the optimal cross-domain multicast tree includes an interdomain multicast tree and an intradomain multicast tree. An agent is established for each controller, and a cooperation mechanism between multiple agents is designed to effectively optimize cross-domain multicast routing and ensure consistency and validity in the representation of network state information for cross-domain multicast routing decisions. Third, a multiagent reinforcement learning-based method that combines online and offline training is designed to reduce the dependence on the real-time environment and increase the convergence speed of multiple agents.

Deep Reinforcement Learning Based Multicast Mode Selection for SFN

DHRL-FNMR: An Intelligent Multicast Routing Approach Based on Deep Hierarchical Reinforcement Learning in SDN

Factor graph-based deep reinforcement learning for path selection scheme in full-duplex wireless multihop networks

Intelligent multicast routing method based on multi-agent deep reinforcement learning in SDWN

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Dynamic Clustering and Resource Allocation Using Deep Reinforcement Learning for Smart-Duplex Networks

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Reconfiguring Multicast Sessions in Elastic Optical Networks Adaptively with Graph-Aware Deep Reinforcement Learning

MA-CDMR: An Intelligent Cross-domain Multicast Routing Method based on Multiagent Deep Reinforcement Learning in Multi-domain SDWN

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

Meta Federated Reinforcement Learning for Distributed Resource Allocation

Deep Reinforcement Learning Based Online Network Selection in CRNs With Multiple Primary Networks

NDN-MMRA : Multi-Stage Multicast Rate Adaptation in Named Data Networking WLAN

Deep Reinforcement Learning Based Resource Allocation for Content Distribution in Fog Radio Access Networks

Spectrum-efficient user grouping and resource allocation based on deep reinforcement learning for mmWave massive MIMO-NOMA systems

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

Model-based Deep Learning for Wireless Resource Allocation in RSMA Communications Systems

Load-Aware Distributed Resource Allocation for MF-TDMA Ad Hoc Networks: A Multi-Agent DRL Approach.

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Multicast Scheduling over Multiple Channels: A Distribution-Embedding Deep Reinforcement Learning Method