Abstract:Unmanned aerial vehicles (UAVs) have a significant potential for sensing applications in further cellular networks due to their extensive coverage and flexible deployment. In this paper, we consider a multi-cell cellular network with a cellular-connected UAV, which senses data with onboard sensors and uploads sensory data to the ground base stations (BSs). To evaluate the freshness of sensory data, we employ the concept of age of information (AoI), which is defined as the time elapsed since the latest successful transmission of sensory data. A lower AoI implies fresher sensory data, which may lead to the increase of UAV operation time. To balance such tradeoff, we aim to minimize the weighted sum of operation time and total AoI for the UAV by jointly optimizing transmission scheduling, BS association, as well as UAV trajectory. The problem is formulated as a mixed-integer nonlinear programming (MINLP) problem, which is difficult to solve due to the time-varying propagation channels. To this end, we first characterize the average communication performance with statistic channel information, and then develop a search algorithm to obtain the optimal solution via employing the optimal structure as well as convex optimization techniques, while a low-complexity Double Graph based Algorithm (DGA) is developed to obtain a suboptimal solution. Then, by taking into account the site-specific performance and making fast decisions online, we propose a Deep reinforcement Learning Algorithm (DLA). Compared to DGA, DLA can adapt to the specific local environment and obtain a solution more rapidly once the training process is completed. Simulation results show that the proposed algorithms outperform the benchmarks about 30%, and achieve flexible tradeoff between operation time and AoI of UAV sensing, which is not available by considering just one objective.

Deep Reinforcement Learning-Based Solution for Minimizing the Alterable Urgency of Information in UAV- Enabled IIoT System

Intelligent Scheduling of UAVs and Sensors for Information Age Minimization at Wireless Powered Internet of Things

A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT

Age of Information Optimization with Heterogeneous UAVs Based on Deep Reinforcement Learning

Lifelong Learning for Minimizing Age of Information in Internet of Things Networks

Age of Information Minimization for UAV-assisted Internet of Things Networks: A Safe Actor-Critic with Policy Distillation Approach

UAV-Aided Lifelong Learning for AoI and Energy Optimization in Non-Stationary IoT Networks

AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method

Minimizing Age of Information for Hybrid UAV-RIS-Assisted Vehicular Networks

Energy-aware Path Planning for Obtaining Fresh Updates in UAV-IoT MEC systems

Joint Power Control and UAV Trajectory Design for Information Freshness Via Deep Reinforcement Learning

Age of Information Optimization in Aerial IRS-Assisted IoT communication system

Work Together to Keep Fresh: Hierarchical Learning for UAVs-assisted Data Time-Sensitive IoT

Minimizing Age of Information in UAV-Assisted Data Collection with Limited Charging Facilities

RL-based mobile edge computing scheme for high reliability low latency services in UAV-aided IIoT networks

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Age of Information in a Cellular Internet of UAVs: Sensing and Communication Trade-Off Design.

Deep Reinforcement Learning for Efficient Data Collection in UAV-Aided Internet of Things

A UoI-Optimal Policy for Timely Status Updates with Resource Constraint

Energy-efficient UAV-enabled Computation Offloading for Industrial Internet of Things: a Deep Reinforcement Learning Approach

Tradeoff Between Age of Information and Operation Time for UAV Sensing Over Multi-Cell Cellular Networks