Abstract:In the emerging Web 3.0 applications for mass customized and personalized manufacturing, smart mobile resources need to interact with each other and other resources to achieve efficient collaborative manufacturing. Existing wireless communication solutions cannot leverage multi-antenna technology and the movement direction of smart mobile resources to meet the high requirements for communication rate and reliability in high-performance manufacturing processes. Therefore, this paper proposes a task-aware distributed channel access scheme for multi-antenna smart mobile resources in a factory. First, this paper introduces an edge-cloud collaboration framework for smart factories to support autonomous wireless access point selection for mobile resources. Second, a user-centric active wireless channel access scheme is proposed and a channel resource allocation optimization problem is formulated for mobile resources to leverage multiple antennas and movement direction to address the unstable connection problem. Third, a centralized-training-and-distributed-execution multi-agent reinforcement learning (MARL) model with a specially designed neural network architecture is built for smart mobile resources, effectively using important input information of the next interaction objects for mobile resources. Simulation results show that the proposed MARL scheme outperforms common schemes of 3GPP LTE, traditional reinforcement learning schemes, and random selection schemes in improving communication rate and stability.

Multi-agent Reinforcement Learning Based Distributed Channel Access for Industrial Edge-Cloud Web 3.0

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Multiagent Deep Reinforcement Learning for Joint Multichannel Access and Task Offloading of Mobile-Edge Computing in Industry 4.0

Multi-Agent Reinforcement Learning Based Distributed Transmission in Collaborative Cloud-Edge Systems.

Multi-Agent Reinforcement Learning For Joint Wireless And Computational Resource Allocation In Mobile Edge Computing System

Multi-agent deep reinforcement learning for end—edge orchestrated resource allocation in industrial wireless networks

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Multi-Agent Reinforcement Learning for Dynamic Resource Management in 6G In-X Subnetworks

Reinforcement Learning based Multi-connectivity Resource Allocation in Factory Automation Systems

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning for Network Selection and Resource Allocation in Heterogeneous multi-RAT Networks

Multiagent RL Aided Task Offloading and Resource Management in Wi-Fi 6 and 5G Coexisting Industrial Wireless Environment

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Collaborative Optimization of Wireless Communication and Computing Resource Allocation based on Multi-Agent Federated Weighting Deep Reinforcement Learning

Online Multi-Agent Reinforcement Learning for Multiple Access in Wireless Networks

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Multi-Agent Deep Reinforcement Learning for Massive Access in 5G and Beyond Ultra-Dense NOMA System

Computation Rate Maximization for SCMA-Aided Edge Computing in IoT Networks: A Multi-Agent Reinforcement Learning Approach

Federated Multi-Agent DRL for Radio Resource Management in Industrial 6G in-X subnetworks

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment