Abstract:Unmanned Aerial Vehicles (UAVs) are gaining growing interests due to the paramount roles they play, particularly these days, in enabling new services that help modernize our transportation, supply chain, search and rescue, among others. They are capable of positively influencing wireless systems through enabling and fostering emerging technologies such as autonomous driving, vertical industries, virtual reality and so many others. The Internet of Vehicles is a prime sector benefiting from the services offered by future cellular systems in general and UAVs in particular, and this paper considers the problem of content delivery to vehicles on road segments with either overloaded or no available communication infrastructure. Incoming vehicles demand service from a library of contents that is partially cached at the UAV; the content of the library is also assumed to change as new vehicles carrying more popular contents arrive. Each inbound vehicle makes a request and the UAV decides on its best trajectory to provide service while maximizing a certain operational utility. Given the energy limitation at the UAV, we seek an energy efficient solution. Hence, our problem consists of jointly finding caching decisions, UAV trajectory and radio resource allocation which is formulated mathematically as a Mixed Integer Non-Linear Problem (MINLP). However, owing to uncertainties in the environment (e.g., random arrival of vehicles, their requests for contents and their existing contents), it is often hard and impractical to solve using standard optimization techniques. To this end, we formulate our problem as a Markov Decision Process (MDP) and we resort to tools such as Proximal Policy Optimization (PPO), a very promising Reinforcement Learning method, along with a set of crafted algorithms to solve our problem. Finally, we conduct simulation-based experiments to analyze and demonstrate the superiority of our solution approach compared with four counterparts and baseline schemes.

Probabilistic Caching Strategy and TinyML-Based Trajectory Planning in UAV-Assisted Cellular IoT System

Joint Cooperative Caching and UAV Trajectory Optimization Based on Mobility Prediction in the Internet of Connected Vehicles

Deep Reinforcement Learning-Based Content Placement and Trajectory Design in Urban Cache-Enabled UAV Networks

UAV-Assisted Content Delivery in Intelligent Transportation Systems-Joint Trajectory Planning and Cache Management

Joint Optimization of Caching Placement and Trajectory for UAV-D2D Networks

Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems

Adaptive Edge Caching in UAV-assisted 5G Network.

Caching Placement Optimization in UAV-assisted Cellular Networks: A Deep Reinforcement Learning based Framework

Deep Reinforcement Learning-Based Mobility-Aware UAV Content Caching and Placement in Mobile Edge Networks

Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience

Caching Unmanned Aerial Vehicle-Enabled Small-Cell Networks: Employing Energy-Efficient Methods That Store and Retrieve Popular Content

Caching UAV-enabled small-cell networks

Optimal Capacity Allocation and Caching Strategy for Multi-UAV Collaborative Edge Caching

Multi-UAV Content Caching Strategy and Cooperative, Complementary Content Transmission Based on Coalition Formation Game

Optimal UAV Caching and Trajectory in Aerial-Assisted Vehicular Networks: A Learning-Based Approach

Cache-Enabling UAV Communications: Network Deployment and Resource Allocation

Priority-Oriented Trajectory Planning for UAV-Aided Time-Sensitive IoT Networks

Cache Sharing in UAV-Enabled Cellular Network: A Deep Reinforcement Learning-Based Approach

Joint Caching, Communication, and Trajectory Optimization in Air-Ground Integrated Wireless Networks With Multiple UAVs and Multiple BSs

A Novel Strategic Caching and Availability Optimization for Wireless Unmanned Aerial Vehicle Communication Networks

Content Fetching Delay Optimization-Based Caching and Resource Allocation for UAV-Enabled Networks