Abstract:The rapid development of artificial intelligence together with the powerful computation capabilities of the advanced edge servers make it possible to deploy learning tasks at the wireless network edge, which is dubbed as edge intelligence (EI). The communication bottleneck between the data resource and the server results in deteriorated learning performance as well as tremendous energy consumption. To tackle this challenge, we explore a new paradigm called learning-and-energy-efficient (LEE) EI, which simultaneously maximizes the learning accuracies and energy efficiencies of multiple tasks via data partition and rate control. Mathematically, this results in a multi-objective optimization problem. Moreover, the continuously varying communication rates introduce infinite variables, which further complicates the problem. To solve this complex problem, we consider the case with infinite server buffer capacity and one-shot data arrival at sensor. First, the number of variables is reduced to a finite level by exploiting the optimality of constant-rate transmission in each epoch. Second, the optimal solution of the multi-objective problem is found by applying the stratified sequencing or merging of objectives. By assuming higher priority of learning efficiency in stratified sequencing, the optimal data partition is derived in closed form by the Lagrange method, while the optimal rate control is proved to have the structure of directional water filling (DWF), based on which a string-pulling (SP) algorithm is proposed to obtain the numerical values. The DWF structure of rate control is also proved to be optimal in merging of objectives, which combines different objectives in a weighted manner. By exploiting the optimal rate changing properties, the SP algorithm is further extended to tackle the more challenging cases with limited server buffer capacity or bursty data arrival at sensor. The performance of the proposed joint data partition and rate control design is examined by extensive experiments based on public datasets.

Data transmission optimization in edge computing using multi-objective reinforcement learning

Energy‐aware Disaster Backup among Cloud Datacenters Using Multiobjective Reinforcement Learning in Software Defined Network

Data Partition and Rate Control for Learning and Energy Efficient Edge Intelligence

A Novel Video Transmission Optimization Mechanism Based on Reinforcement Learning and Edge Computing

An efficient data evacuation strategy using multi-objective reinforcement learning

Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading

Joint Optimization of Microservice Deployment and Routing in Edge Via Multi-Objective Deep Reinforcement Learning

Deep Reinforcement Learning Based Energy Efficient Resource Allocation for Wireless Powered Edge Computing Network

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Deep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond

Multi-objective Task Offloading for Highly Dynamic Heterogeneous Vehicular Edge Computing: an Efficient Reinforcement Learning Approach

DRJOA: Intelligent Resource Management Optimization Through Deep Reinforcement Learning Approach in Edge Computing

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Joint Optimization of Networking and Computing Resources for Green M2M Communications Based on DRL

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Multi-Objective Optimization of Energy Saving and Throughput in Heterogeneous Networks Using Deep Reinforcement Learning

Multi-objective Deep Reinforcement Learning for Mobile Edge Computing

Matching-Driven Deep Reinforcement Learning for Energy-Efficient Transmission Parameter Allocation in Multi-Gateway LoRa Networks

Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning

Joint Optimization of Energy Consumption and Latency Based on DRL: an Edge Server Activation and Task Scheduling Scheme in IIoT.

A Deep Reinforcement Learning Based Offloading Game in Edge Computing