Abstract:Relay-aided Device-to-Device (D2D) communication combining visible light communication (VLC) with radio frequency (RF) is a promising paradigm in the internet of things (IoT). Static relay limits the flexibility and maintaining connectivity of relays in Hybrid VLC/RF IoT systems. By using a drone as a relay station, it is possible to avoid obstacles such as buildings and to communicate in a line-of-sight (LoS) environment, which naturally aligns with the requirement of VLC Systems. To further support the application of VLC in the IoT, subject to the challenges imposed by the constrained coverage, the lack of flexibility, poor reliability, and connectivity, drone relay-aided D2D communication appears on the horizon and can be cost-effectively deployed for the large-scale IoT. This paper proposes a joint resource allocation and drones relay selection scheme, aiming to maximize the D2D system sum rate while ensuring the quality of service (QoS) requirements for cellular users (CUs) and D2D users (DUs). First, we construct a two-phase coalitional game to tackle the resource allocation problem, which exploits the combination of VLC and RF, as well as incorporates a greedy strategy. After that, a distributed cooperative multi-agent reinforcement learning (MARL) algorithm, called WoLF policy hill-climbing (WoLF-PHC), is proposed to address the drones relay selection problem. Moreover, to further reduce the computational complexity, we propose a lightweight neighbor–agent-based WoLF-PHC algorithm, which only utilizes historical information of neighboring DUs. Finally, we provide an in-depth theoretical analysis of the proposed schemes in terms of complexity and signaling overhead. Simulation results illustrate that the proposed schemes can effectively improve the system performance in terms of the sum rate and outage probability with respect to other outstanding algorithms.

Relay-dependent Path Replanning for Disconnected Drones Using Self-organized Communication Network

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Joint Resource Allocation and Drones Relay Selection for Large-Scale D2D Communication Underlaying Hybrid VLC/RF IoT Systems

UAV relay network deployment through the area with barriers

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

Adaptive Coding and Modulation Aided Mobile Relaying for Millimeter-Wave Flying Ad-Hoc Networks

Distributed reinforcement learning based framework for energy-efficient UAV relay against jamming

Obstacle-Aware and Energy-Efficient Multi-Drone Coordination and Networking for Disaster Response

A dynamic source routing protocol based on path reliability and link monitoring repair

Environmentally-Aware and Energy-Efficient Multi-Drone Coordination and Networking for Disaster Response

A Deep Reinforcement Learning Approach to Efficient Drone Mobility Support

Drone-Enabled Internet-of-Things Relay for Environmental Monitoring in Remote Areas Without Public Networks

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

Multi-UAV Relay Connectivity Optimization for Heterogeneous Users Based on Load Balancing and Throughput Maximization

Decoding Probability Analysis of Network-Coded Data Collection and Delivery by Relay Drones

FedRDR: Federated Reinforcement Distillation-Based Routing Algorithm in UAV-Assisted Networks for Communication Infrastructure Failures

Enabling resilient UAV swarms through multi-hop wireless communications

Reinforcement Learning Based Energy Efficient Robot Relay for Unmanned Aerial Vehicles Against Smart Jamming

A deep reinforcement learning framework and its implementation for UAV-aided covert communication

DDPG-based Aerial Secure Data Collection

Relay in the Sky: A UAV-Aided Cooperative Data Dissemination Scheduling Strategy in VANETs