Abstract:Multi-access mobile edge computing (MEC) is envisioned as a key enabling technology to support compute-intensive and delay-sensitive applications in railway Internet of Things (RIoT) networks. However, the time-varying channel variations in RIoT scenarios make it challenging to achieve efficient resource allocation. The emerging deep reinforcement learning (DRL) is able to respond to the above-mentioned challenge. In this paper, with the aim of reducing the total computational cost (weighted sum of consumed energy and delay), we investigate the dynamic resource management issue of joint subcarrier assignment, offloading ratio, power allocation and computation resource allocation in multi-access MEC assisted RIoT networks. To address this intractable mixed integer nonlinear programming issue, we put forward a hybrid DRL (HDRL) scheme, which is an integration of deep double Q-learning (DDQN) and deep deterministic policy gradient (DDPG). The HDRL algorithm is capable of learning the advisable strategies for actions including discrete-continuous hybrid variables. In HDRL algorithm, DDQN plays the role of making subcarrier assignment decision, and DDPG plays the role of making offloading ratio, power allocation as well as computation resource allocation decisions. Numerical results demonstrate that HDRL scheme can yield much less computational cost than the existing baselines for multi-access MEC assisted RIoT networks. In addition, the HDRL scheme is close to the near-optimal performance with comparatively low execution time.

Joint Optimization of Networking and Computing Resources for Green M2M Communications Based on DRL

Joint Optimization Of Computation Offloading And Ul/Dl Resource Allocation In Mec Systems

Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

Joint Optimization of Service Migration and Resource Allocation in Mobile Edge–Cloud Computing

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Energy-efficient M2M Communications with Mobile Edge Computing in Virtualized Cellular Networks

DRJOA: Intelligent Resource Management Optimization Through Deep Reinforcement Learning Approach in Edge Computing

IoT Computing Collaboration and Data-Aware Routing Algorithm for Edge Computing and DL

Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC

Energy-Efficient Resource Allocation for MEC and Blockchain-Enabled IoT Via CRL Approach.

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Energy-Efficient Machine-to-Machine (M2M) Communications in Virtualized Cellular Networks with Mobile Edge Computing (MEC)

Reinforcement Learning-Based Joint Task Offloading and Migration Schemes Optimization in Mobility-Aware MEC Network

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

Joint Optimization of Energy Consumption and Latency Based on DRL: an Edge Server Activation and Task Scheduling Scheme in IIoT.

Resource Optimization for Delay-Tolerant Data in Blockchain-Enabled IoT with Edge Computing: A Deep Reinforcement Learning Approach

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning