Abstract:Deep neural network (DNN) inference with low delay and high accuracy requirements is usually computation intensive. The collaboration among mobile devices and the network edge is a potential solution to support DNN inference. Moreover, the sampling rates of mobile devices can be dynamically configured to adapt to network conditions, which can be used to minimize the inference service delay. In this chapter, we first introduce the concept of DNN inference, and its two underlying technologies, i.e., mobile edge computing and machine learning. Then, we present a case study on collaborative DNN inference via device-edge orchestration. Specifically, taking the channel variation and task arrival randomness into consideration, we formulate the DNN inference delay minimization problem as a constrained Markov decision process (CMDP). In the problem, sampling rate adaption, inference task offloading, and edge computing resource allocation are jointly optimized while guaranteeing the long-term accuracy requirements of different inference services. To solve the problem, we propose a learning-based solution with three steps. Firstly, the CMDP is transformed into an MDP by leveraging the Lyapunov optimization technique. Secondly, a deep reinforcement learning (RL)-based algorithm is proposed to solve the transformed MDP. Thirdly, an optimization subroutine is embedded in the proposed deep RL algorithm to directly obtain the optimal edge computing resource allocation, thereby expediting the training process. Simulation results demonstrate that the proposed algorithm can reduce the average service delay and preserve long-term inference accuracy with a high probability.KeywordsDNN inferenceMobile edge computingReinforcement learningLyapunov optimizationConstrained Markov decision processAdaptive rate sampling

A Deep Reinforcement Learning Approach for DNN Collaborative Inference in Mobile Edge Computing

Joint DNN partitioning and task offloading in mobile edge computing via deep reinforcement learning

Reinforcement Learning Based Energy-Efficient Collaborative Inference for Mobile Edge Computing

Collaborative Deep Neural Network Inference via Mobile Edge Computing

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

Energy-Efficient Collaborative Inference in MEC: A Multi-Agent Reinforcement Learning Based Approach

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Collaborative Inference for MEC Services Based on Multimodal Deep Neural Network.

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Hybrid Decision Based Deep Reinforcement Learning for Energy Harvesting Enabled Mobile Edge Computing.

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multiagent Ensemble Deep Reinforcement Learning With Imitation Acceleration

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning for Dynamic Access Control with Battery Prediction for Mobile-Edge Computing in Green IoT Networks

Smart Collaborative Optimizations Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multi-Agent Ensemble Deep Reinforcement Learning with Imitation Acceleration

Collaborative Multi-Agent Deep Reinforcement Learning for Energy-Efficient Resource Allocation in Heterogeneous Mobile Edge Computing Networks