Abstract:Future Internet involves several emerging technologies such as 5G and beyond 5G networks, vehicular networks, unmanned aerial vehicle (UAV) networks, and Internet of Things (IoTs). Moreover, the future Internet becomes heterogeneous and decentralized with a large number of involved network entities. Each entity may need to make its local decision to improve the network performance under dynamic and uncertain network environments. Standard learning algorithms such as single-agent Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) have been recently used to enable each network entity as an agent to learn an optimal decision-making policy adaptively through interacting with the unknown environments. However, such an algorithm fails to model the cooperations or competitions among network entities, and simply treats other entities as a part of the environment that may result in the non-stationarity issue. Multi-agent Reinforcement Learning (MARL) allows each network entity to learn its optimal policy by observing not only the environments but also other entities' policies. As a result, MARL can significantly improve the learning efficiency of the network entities, and it has been recently used to solve various issues in the emerging networks. In this paper, we thus review the applications of MARL in emerging networks. In particular, we provide a tutorial of MARL and a comprehensive survey of applications of MARL in next-generation Internet. In particular, we first introduce single-agent RL and MARL. Then, we review a number of applications of MARL to solve emerging issues in the future Internet. The issues consist of network access, transmit power control, computation offloading, content caching, packet routing, trajectory design for UAV-aided networks, and network security issues. Finally, we discuss the challenges, open issues, and future directions related to the applications of MARL in the future Internet.

Towards an Agent-Based Architecture using Deep Reinforcement Learning for Intelligent Internet of Things Applications.pdf

Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges

Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey

Deep Learning in Industrial Internet of Things: Potentials, Challenges, and Emerging Applications

Multi-agent Reinforcement Learning Approach to Enhance Proactive and Resilience System based IoT

Architecture, Generative Model, and Deep Reinforcement Learning for IoT Applications: Deep Learning Perspective

A Multi-Agents Deep Reinforcement Learning Autonomous Security Management Approach for Internet of Things

Deep Reinforcement Learning Multi-Agent System for Resource Allocation in Industrial Internet of Things

Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive Survey

Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodology

An adversarial environment reinforcement learning-driven intrusion detection algorithm for Internet of Things

Recent Reinforcement Learning and Blockchain Based Security Solutions for Internet of Things: Survey

Collaborative multi-agents in dynamic industrial internet of things using deep reinforcement learning

Deep Learning for the Industrial Internet of Things (IIoT): A Comprehensive Survey of Techniques, Implementation Frameworks, Potential Applications, and Future Directions

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Artificial Intelligence Enabled Internet of Things: Network Architecture and Spectrum Access

A Web of Things Architecture for Digital Twin Creation and Model-Based Reinforcement Control

Artificial intelligence Internet of Things: A new paradigm of distributed sensor networks

Deep and Reinforcement Learning Technologies on Internet of Vehicle (IoV) Applications: Current Issues and Future Trends

Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks