Abstract:Multi-access edge computing has been considered as a promising solution for enabling computation-intensive yet latency-sensitive applications at resource-constrained wireless devices (WDs). To improve the spectrum efficiency for multi-WD computation offloading, this paper considers nonorthogonal multiple access (NOMA) assisted two-tier multiaccess edge computing scenario, which exploits the computation resources of both the edge servers (ESs) and the cloudlet server (CS) deployed at different tiers. In particular, the WDs can offload partial workloads to different ESs simultaneously via NOMA, and the ESs can form a NOMA-group to further offload partially received workloads to the CS for processing. We investigate the total energy consumption minimization problem by jointly optimizing the two-tier offloading decisions, the NOMA transmission duration, and the computation resource allocation. Due to the successive interference cancellation in the NOMA and the coupling effect in two-tier offloading, the formulated optimization problem is strictly non-convex. To address this difficulty, we exploit the hierarchical relationship among the joint optimization variables, and then propose a hybrid deep reinforcement learning (HDRL) algorithm to learn two policies that determine the coupled variables, i.e., the ESs' offloading decisions and the NOMA transmission duration, respectively. Then, the remaining decision variables can be jointly optimized by using the convex optimization methods directly based on the results provided by the HDRL algorithm. Specifically, the HDRL algorithm that uses different policies to determine the coupled variables can converge faster than the existing solutions that learn a single policy to determine all variables. Experimental results are provided to validate the performance of our proposed HDRL algorithm in comparison with two other learning-based algorithms.

Backscatter-Assisted Computation Offloading for Energy Harvesting IoT Devices via Policy-based Deep Reinforcement Learning

Two-Tier Multi-Access Partial Computation Offloading Via NOMA: A Hybrid Deep Learning Approach for Energy Minimization

Learning-Based Computation Offloading for IoT Devices With Energy Harvesting

Dynamic Computation Offloading With Energy Harvesting Devices: A Hybrid-Decision-Based Deep Reinforcement Learning Approach

Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Energy-Efficient Space–Air–Ground Integrated Edge Computing for Internet of Remote Things: A Federated DRL Approach

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

Joint Task Offloading and Resource Allocation for Intelligent Reflecting Surface-Aided Integrated Sensing and Communication Systems Using Deep Reinforcement Learning Algorithm

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning