Abstract:Recently, smart cities, healthcare system, and smart vehicles have raised challenges on the capability and connectivity of state-of-the-art Internet-of-Things (IoT) devices, especially for the devices in hotspots area. Multiaccess edge computing (MEC) can enhance the ability of emerging resource-intensive IoT applications and has attracted much attention. However, due to the time-varying network environments, as well as the heterogeneous resources of network devices, it is hard to achieve stable, reliable, and real-time interactions between edge devices and their serving edge servers, especially in the 5G ultradense network (UDN) scenarios. Ultradense edge computing (UDEC) has the potential to fill this gap, especially in the 5G era, but it still faces challenges in its current solutions, such as the lack of: 1) efficient utilization of multiple 5G resources (e.g., computation, communication, storage, and service resources); 2) low overhead offloading decision making and resource allocation strategies; and 3) privacy and security protection schemes. Thus, we first propose an intelligent UDEC (I-UDEC) framework, which integrates blockchain and artificial intelligence (AI) into 5G UDEC networks. Then, in order to achieve real-time and low overhead computation offloading decisions and resource allocation strategies, we design a novel two-timescale deep reinforcement learning (2Ts-DRL) approach, consisting of a fast-timescale and a slow-timescale learning process, respectively. The primary objective is to minimize the total offloading delay and network resource usage by jointly optimizing computation offloading, resource allocation, and service caching placement. We also leverage federated learning (FL) to train the 2Ts-DRL model in a distributed manner, aiming to protect the edge devices' data privacy. Simulation results corroborate the effectiveness of both the 2Ts-DRL and FL in the I-UDEC framework and prove that our proposed algorithm can reduce task execution time up to 31.87%.

Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network

Dynamic Resource Management in MEC Powered by Edge Intelligence for Smart City Internet of Things

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Privacy‐preserving task offloading in mobile edge computing: A deep reinforcement learning approach

Task offloading mechanism based on federated reinforcement learning in mobile edge computing

Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

Federated Deep Reinforcement Learning for Online Task Offloading and Resource Allocation in WPC-MEC Networks

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Federated Deep Reinforcement Learning for Task Offloading in MEC-enabled Heterogeneous Networks

DPRL: Task Offloading Strategy Based on Differential Privacy and Reinforcement Learning in Edge Computing

When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multitimescale Resource Management for Multiaccess Edge Computing in 5G Ultradense Network

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Offloading in Mobile Edge Computing Based on Federated Reinforcement Learning

Mobility-Aware Computation Offloading With Load Balancing in Smart City Networks Using MEC Federation

Joint Computation Offloading and Resource Allocation in Multi-edge Smart Communities with Personalized Federated Deep Reinforcement Learning

Computation Offloading and Resource Allocation Based on DT-MEC-Assisted Federated Learning Framework

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Multi-type task offloading for wireless Internet of Things by federated deep reinforcement learning