Abstract:With the construction and development of the smart grid, the power business puts higher requirements on the communication capability of the network. In order to improve the energy efficiency of the space–air–ground-integrated power three-dimensional fusion communication network, we establish an optimization problem for joint air platform (AP) flight path selection, ground power facility (GPF) association, and power control. In solving the problem, we decompose the problem into two subproblems, one is the AP flight path selection subproblem and the other is the GPF association and power control subproblem. Firstly, based on the GPF distribution and throughput weights, we model the AP flight path selection subproblem as a Markov Decision Process (MDP) and propose a multi-agent iterative optimization algorithm based on the comprehensive judgment of GPF positions and workload. Secondly, we model the GPF association and power control subproblem as a multi-agent, time-varying K-armed bandit model and propose an algorithm based on multi-agent Temporal Difference (TD) learning. Then, by alternately iterating between the two subproblems, we propose a reinforcement learning (RL)-based joint optimization algorithm. Finally, the simulation results indicate that compared to the three baseline algorithms (random path, average transmit power, and random device association), the proposed algorithm improves an overall energy efficiency of the system of 16.23%, 86.29%, and 5.11% under various conditions (including different noise power levels, GPF bandwidth, and GPF quantities), respectively.

Resource Allocation in HetNets with Green Energy Supply Based on Deep Reinforcement Learning

A Power Allocation Scheme Based on Deep Reinforcement Learning in HetNets.

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid

Deep Reinforcement Learning Based Resource Allocation for Heterogeneous Networks

Green Resource Allocation and Energy Management in Heterogeneous Small Cell Networks Powered by Hybrid Energy

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks

Mobility-Aware Centralized Reinforcement Learning for Dynamic Resource Allocation in HetNets

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Network Resource Allocation Algorithm Using Reinforcement Learning Policy-Based Network in a Smart Grid Scenario

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks

Research on High-Efficiency Routing Protocols for HWSNs Based on Deep Reinforcement Learning

Parallel Deep Reinforcement Learning Based Online User Association Optimization in Heterogeneous Networks.

Semantic-Aware Resource Allocation Based on Deep Reinforcement Learning for 5G-V2X HetNets

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Reinforcement Learning-Based Resource Allocation and Energy Efficiency Optimization for a Space–Air–Ground-Integrated Network

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning.