Abstract:Heavy data load and wide cover range have always been crucial problems for big data processing in Internet of Things (IoT). Recently, mobile-edge computing (MEC) and unmanned aerial vehicle base stations (UAV-BSs) have emerged as promising techniques in IoT. In this article, we propose a three-layer online data processing network based on the MEC technique. On the bottom layer, raw data are generated by distributed sensors with local information. Upon them, UAV-BSs are deployed as moving MEC servers, which collect data and conduct initial steps of data processing. On top of them, a center cloud receives processed results and conducts further evaluation. For online processing requirements, the edge nodes should stabilize delay to ensure data freshness. Furthermore, limited onboard energy poses constraints to edge processing capability. In this article, we propose an online edge processing scheduling algorithm based on Lyapunov optimization. In cases of low data rate, it tends to reduce edge processor frequency for saving energy. In the presence of a high data rate, it will smartly allocate bandwidth for edge data offloading. Meanwhile, hovering UAV-BSs bring a large and flexible service coverage, which results in a path planning issue. In this article, we also consider this problem and apply deep reinforcement learning to develop an online path planning algorithm. Taking observations of around environment as an input, a CNN network is trained to predict action rewards. By simulations, we validate its effectiveness in enhancing service coverage. The result will contribute to big data processing in future IoT.

Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks

Deep Reinforcement Learning Based Freshness-Aware Path Planning for UAV-Assisted Edge Computing Networks with Device Mobility

Multi-UAV Mobile Edge Computing and Path Planning Platform based on Reinforcement Learning

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Priority-aware path planning and user scheduling for UAV-mounted MEC networks: A deep reinforcement learning approach

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Deep Reinforcement Learning-Based UAV Path Planning for Energy-Efficient Multitier Cooperative Computing in Wireless Sensor Networks

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Drone Swarm Path Planning for Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Toward Big Data Processing in IoT: Path Planning and Resource Management of UAV Base Stations in Mobile-Edge Computing System

User Association and Path Planning for UAV-Aided Mobile Edge Computing with Energy Restriction

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

Digital Twins-based Multi-agent Deep Reinforcement Learning for UAV-assisted Vehicle Edge Computing