Abstract:Multi-access edge computing has been considered as a promising solution for enabling computation-intensive yet latency-sensitive applications at resource-constrained wireless devices (WDs). To improve the spectrum efficiency for multi-WD computation offloading, this paper considers nonorthogonal multiple access (NOMA) assisted two-tier multiaccess edge computing scenario, which exploits the computation resources of both the edge servers (ESs) and the cloudlet server (CS) deployed at different tiers. In particular, the WDs can offload partial workloads to different ESs simultaneously via NOMA, and the ESs can form a NOMA-group to further offload partially received workloads to the CS for processing. We investigate the total energy consumption minimization problem by jointly optimizing the two-tier offloading decisions, the NOMA transmission duration, and the computation resource allocation. Due to the successive interference cancellation in the NOMA and the coupling effect in two-tier offloading, the formulated optimization problem is strictly non-convex. To address this difficulty, we exploit the hierarchical relationship among the joint optimization variables, and then propose a hybrid deep reinforcement learning (HDRL) algorithm to learn two policies that determine the coupled variables, i.e., the ESs' offloading decisions and the NOMA transmission duration, respectively. Then, the remaining decision variables can be jointly optimized by using the convex optimization methods directly based on the results provided by the HDRL algorithm. Specifically, the HDRL algorithm that uses different policies to determine the coupled variables can converge faster than the existing solutions that learn a single policy to determine all variables. Experimental results are provided to validate the performance of our proposed HDRL algorithm in comparison with two other learning-based algorithms.

A Learning Approach for Traffic Offloading in Stochastic Heterogeneous Cellular Networks.

Energy-Efficiency Oriented Traffic Offloading in Wireless Networks: A Brief Survey and a Learning Approach for Heterogeneous Cellular Networks

Two-Tier Multi-Access Partial Computation Offloading Via NOMA: A Hybrid Deep Learning Approach for Energy Minimization

QoS Optimization for Mobile Ad Hoc Cloud: A Multi-Agent Independent Learning Approach

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Traffic Aware Offloading for BS Sleeping in Heterogeneous Networks

Delay and Reliability Tradeoffs in Heterogeneous Cellular Networks.

When QoE Meets Learning: A Distributed Traffic-Processing Framework for Elastic Resource Provisioning in HetNets

Energy-Aware Traffic Offloading for Green Heterogeneous Networks

Mobile Traffic Offloading with Forecasting using Deep Reinforcement Learning

Combined learning for energy efficiency in heterogeneous cellular networks

Delay-Aware Massive Random Access for Machine-Type Communications Via Hierarchical Stochastic Learning

Combined learning for resource allocation in autonomous heterogeneous cellular networks.

Traffic-Aware Online Network Selection in Heterogeneous Wireless Networks

Selective Traffic Offloading on the Fly: A Machine Learning Approach

Delay-Optimal User Scheduling and Inter-Cell Interference Management in Cellular Network via Distributive Stochastic Learning

Traffic Offloading in Heterogeneous Networks with Energy Harvesting Personal Cells-Network Throughput and Energy Efficiency.

Capacity Offloading In Two-Tier Small Cell Networks Over Unlicensed Band: A Hierarchical Learning Framework

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Deep Reinforcement Learning-Based Energy Minimization Task Offloading and Resource Allocation for Air Ground Integrated Heterogeneous Networks