Abstract:Path planning is a key enabling technology for drone-based applications, where the drone may encounter situations that require impromptu decisions to avoid task failure. Traditional works usually model it as an optimization problem with provable guarantees in a known map. However, they overlook the real-world uncertain dynamism (e.g. wind, illumination) stemming from the inadequate and inaccurate environmental information, which could pose risks to decision making and reduce the utility of path planning. To alleviate this uncertainty, we propose a Dynamic Environment-driven Path planning-oriented Deep Reinforcement Learning (DEP-DRL) paradigm that can be extended to more unfamiliar environments. We manage to do this by innovating in the following aspects: First, due to the influence of wind on the drone aerodynamic characteristics, we design a predictive drone state representation method which performs probabilistic wind-turbulence reasoning over drone kinematics in a deep reinforcement learning loop to conduct more realistic exploration. Then, we derive a system state transition mechanism for predicting future environmental observations and drone actions to minimize the potential system uncertainty and increase the path-planning success rate. We further propose an adaptive value updating strategy according to environmental illumination-based assessment in an online fashion. The experiments over different environments demonstrate the effectiveness of our method.

Automatic Path Planning for Spraying Drones Based on Deep Q-Learning

UAV Coverage Path Planning Based on Deep Reinforcement Learning

Collaborative Coverage Path Planning of UAV Cluster based on Deep Reinforcement Learning

Towards Real-Time Path Planning through Deep Reinforcement Learning for a UAV in Dynamic Environments

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

UAV Path Planning and Obstacle Avoidance Based on Reinforcement Learning in 3D Environments

Deep Reinforcement Learning for UAV Intelligent Mission Planning

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

A UAV Coverage Path Planning Algorithm Based on Double Deep Q-Network

Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning

Dynamic Environment-driven Autonomous Drone Path Planning via Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for UAV Path Planning Incorporating Vehicle Dynamics with Acceleration Control

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

A Data-Driven Dynamic Obstacle Avoidance Method for Liquid-Carrying Plant Protection UAVs

E-DQN-Based Path Planning Method for Drones in Airsim Simulator under Unknown Environment

Path Planning Research of a UAV Base Station Searching for Disaster Victims' Location Information Based on Deep Reinforcement Learning

Deep Reinforcement Learning-based Collaborative Multi-UAV Coverage Path Planning