Abstract:Mobile-edge computing (MEC) is a promising technology for the fifth-generation (5G) and sixth-generation (6G) architectures, which provides resourceful computing capabilities for Internet of Things (IoT) devices, such as virtual reality, mobile devices, and smart cities. In general, these IoT applications always bring higher energy consumption than traditional applications, which are usually energy-constrained. To provide persistent energy, many references have studied the offloading problemto save energy consumption. However, the dynamic environment dramatically increases the optimization difficulty of the offloading decision. In this paper, we aim to minimize the energy consumption of the entireMECsystem under the latency constraint by fully considering the dynamic environment. UnderMarkov games, we propose amulti-agent deep reinforcement learning approach based on the bi-level actorcritic learning structure to jointly optimize the offloading decision and resource allocation, which can solve the combinatorial optimization problem using an asymmetric method and compute the Stackelberg equilibrium as a better convergence point than Nash equilibrium in terms of Pareto superiority. Our method can better adapt to a dynamic environment during the data transmission than the single-agent strategy and can effectively tackle the coordination problem in the multi-agent environment. The simulation results show that the proposed method could decrease the total computational overhead by 17.8% compared to the actor-critic-based method and reduce the total computational overhead by 31.3%, 36.5%, and 44.7% compared with randomoffloading, all local execution, and all offloading execution, respectively.

Energy-Efficient Collaborative Inference in MEC: A Multi-Agent Reinforcement Learning Based Approach

Reinforcement Learning Based Energy-Efficient Collaborative Inference for Mobile Edge Computing

Collaborative Inference for MEC Services Based on Multimodal Deep Neural Network.

A Deep Reinforcement Learning Approach for DNN Collaborative Inference in Mobile Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Smart Collaborative Optimizations Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

An Intelligent Collaborative Inference Approach of Service Partitioning and Task Offloading for Deep Learning Based Service in Mobile Edge Computing Networks.

Hierarchical Multi-Agent Deep Reinforcement Learning for Energy-Efficient Hybrid Computation Offloading

Collaborative Multi-Agent Deep Reinforcement Learning for Energy-Efficient Resource Allocation in Heterogeneous Mobile Edge Computing Networks

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Efficient Computation Offloading in Mobile Edge Computing

Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning

A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems

Cooperative Task Offloading for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning

Multi-Agent Reinforcement Learning For Joint Wireless And Computational Resource Allocation In Mobile Edge Computing System

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Joint Computation Offloading and Service Caching in Mobile Edge-Cloud Computing Via Deep Reinforcement Learning

Joint Optimization of Task Offloading and Resource Allocation Via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Network