Abstract:Scientific and engineering advances in wireless communication, sensors, propulsion, and other areas are rapidly making it possible to develop unmanned air vehicles (UAVs) with sophisticated capabilities. UAVs have come to the forefront as tools for airborne reconnaissance to search for, detect, and destroy enemy targets in relatively complex environments. They potentially reduce risk to human life, are cost effective, and are superior to manned aircraft for certain types of missions. It is desirable for UAVs to have a high level of intelligent autonomy to carry out mission tasks with little external supervision and control. This raises important issues involving tradeoffs between centralized control and the associated potential to optimize mission plans, and decentralized control with great robustness and the potential to adapt to changing conditions. UAV capabilities have been extended several ways through armament (e.g., Hellfire missiles on Predator UAVs), increased endurance and altitude (e.g., Global Hawk), and greater autonomy. Some known barriers to full-scale implementation of UAVs are increased communication and control requirements as well as increased platform and system complexity. One of the key problems is how UAV systems can handle incomplete and uncertain information in dynamic environments. Especially when the system is composed of heterogeneous and distributed UAVs, the overall system complexity is increased under such conditions. Presented through the use of published papers, this dissertation lays the groundwork for the study of methodologies for handling incomplete and uncertain information for distributed control systems. An agent-based simulation framework is built to investigate mathematical approaches (optimization) and emergent intelligence approaches. The first paper provides a mathematical approach for systems of UAVs to handle incomplete and uncertain information. The second paper describes an emergent intelligence approach for UAVs, again in handling incomplete and uncertain information. The third paper combines mathematical and emergent intelligence approaches.

Mission Decision-Making for UAV under Dynamic Environment

Multi-UAV Cooperative Air Combat Target Assignment Method Based on VNS-IBPSO in Complex Dynamic Environment

Research on Unmanned Underwater Vehicle Threat Assessment

Distributed Control Systems with Incomplete and Uncertain Information

Research on Autonomous Maneuvering Decision of UCAV based on Approximate Dynamic Programming

UAV Mission Path Planning Based on Reinforcement Learning in Dynamic Environment

Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

Robust Satisficing Decision Making for Unmanned Aerial Vehicle Complex Missions under Severe Uncertainty

UUV Autonomous Decision-Making Method Based on Dynamic Influence Diagram

Automated Maneuvering Decision for UAVs in Forest Surveillance and Fire Detection Missions

Autonomous Decision-Making Method for Combat Mission of UAV based on Deep Reinforcement Learning

Digital Twin-Enabled Decision-Making Framework for Multi-UAV Mission Planning: A Multiagent Deep Reinforcement Learning Perspective

Distributed Multi-Target Search and Surveillance Mission Planning for Unmanned Aerial Vehicles in Uncertain Environments

Autonomous Maneuver Decision of UCAV Air Combat Based on Double Deep Q Network Algorithm and Stochastic Game Theory

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning

Enhancing multi-UAV air combat decision making via hierarchical reinforcement learning

An Actor-Critic-Based UAV-BSs Deployment Method for Dynamic Environments

Unmanned aerial vehicle swarm mission reliability modeling and evaluation method oriented to systematic and networked mission

Situational continuity-based air combat autonomous maneuvering decision-making

Dynamic environment UAV deployment algorithm based on potential game theory