Abstract:Unmanned aerial vehicles (UAVs) have a significant potential for sensing applications in further cellular networks due to their extensive coverage and flexible deployment. In this paper, we consider a multi-cell cellular network with a cellular-connected UAV, which senses data with onboard sensors and uploads sensory data to the ground base stations (BSs). To evaluate the freshness of sensory data, we employ the concept of age of information (AoI), which is defined as the time elapsed since the latest successful transmission of sensory data. A lower AoI implies fresher sensory data, which may lead to the increase of UAV operation time. To balance such tradeoff, we aim to minimize the weighted sum of operation time and total AoI for the UAV by jointly optimizing transmission scheduling, BS association, as well as UAV trajectory. The problem is formulated as a mixed-integer nonlinear programming (MINLP) problem, which is difficult to solve due to the time-varying propagation channels. To this end, we first characterize the average communication performance with statistic channel information, and then develop a search algorithm to obtain the optimal solution via employing the optimal structure as well as convex optimization techniques, while a low-complexity Double Graph based Algorithm (DGA) is developed to obtain a suboptimal solution. Then, by taking into account the site-specific performance and making fast decisions online, we propose a Deep reinforcement Learning Algorithm (DLA). Compared to DGA, DLA can adapt to the specific local environment and obtain a solution more rapidly once the training process is completed. Simulation results show that the proposed algorithms outperform the benchmarks about 30%, and achieve flexible tradeoff between operation time and AoI of UAV sensing, which is not available by considering just one objective.

Secure Status Updates for Internet of Drones: A Deep Q-Learning-Based Antenna Selection Approach

Smart Antenna Allocation for Wireless Surveillance

Optimal Transmit Antenna Selection Strategy For Mimo Wiretap Channel Based On Deep Reinforcement Learning

Information Freshness Aware Wireless Multi-User Uplink Physical Layer Security Communication

Age of Information in a Cellular Internet of UAVs: Sensing and Communication Trade-Off Design.

Dynamic resource allocation in IRS-assisted UAV wideband cognitive radio networks: A DDQN-TD3 approach

Deep Learning Methods for Secure IoT SWIPT Networks

Sensing and Communication Tradeoff Design for AoI Minimization in a Cellular Internet of UAVs

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

Learning-Based Robust and Secure Transmission for Reconfigurable Intelligent Surface Aided Millimeter Wave UAV Communications

DDPG-based Aerial Secure Data Collection

Deep Reinforcement Learning for Aerial Data Collection in Hybrid-Powered NOMA-IoT Networks

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

Social-Aware Peer Selection for Energy Efficient D2D Communications in UAV-Assisted Networks: A Q-Learning Approach

Age of Incorrect Information Minimization for Timely Status Updates in Satellite-based IoT

Radio Resource Management for Cellular-Connected UAV: A Learning Approach

Sensing, Communication, and Control Co-design for Energy Efficient Satellite-UAV Networks

Joint Beamforming and Trajectory Optimization for UAV-Assisted Double IRS Secure Transmission System: A Deep Reinforcement Learning Approach.

AoI-aware Sensing Scheduling and Trajectory Optimization for Multi-UAV-assisted Wireless Backscatter Networks

Tradeoff Between Age of Information and Operation Time for UAV Sensing Over Multi-Cell Cellular Networks

Interference-Aware Cooperative Anti-Jamming Distributed Channel Selection in UAV Communication Networks