Abstract:Majority of aircraft under the Urban Air Mobility (UAM) concept are expected to be of the electric vertical takeoff and landing (eVTOL) vehicle type, which will operate out of vertiports. While this is akin to the relationship between general aviation aircraft and airports, the conceived location of vertiports within dense urban environments presents unique challenges in managing the air traffic served by a vertiport. This challenge becomes pronounced within increasing frequency of scheduled landings and take-offs. This paper assumes a centralized air traffic controller (ATC) to explore the performance of a new AI driven ATC approach to manage the eVTOLs served by the vertiport. Minimum separation-driven safety and delays are the two important considerations in this case. The ATC problem is modeled as a task allocation problem, and uncertainties due to communication disruptions (e.g., poor link quality) and inclement weather (e.g., high gust effects) are added as a small probability of action failures. To learn the vertiport ATC policy, a novel graph-based reinforcement learning (RL) solution called "Urban Air Mobility- Vertiport Schedule Management (UAM-VSM)" is developed. This approach uses graph convolutional networks (GCNs) to abstract the vertiport space and eVTOL space as graphs, and aggregate information for a centralized ATC agent to help generalize the environment. Unreal Engine combined with Airsim is used as the simulation environment over which training and testing occurs. Uncertainties are considered only during testing, due to the high cost of Mc sampling over such realistic simulations. The proposed graph RL method demonstrates significantly better performance on the test scenarios when compared against a feasible random decision-making baseline and a first come first serve (FCFS) baseline, including the ability to generalize to unseen scenarios and with uncertainties.

Negotiation Approach by Reinforcement Learning for Takeoff Sequencing Decision in Airports

Autonomous Air Traffic Controller: A Deep Multi-Agent Reinforcement Learning Approach

A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control

Deep Reinforcement Learning for Real-Time Ground Delay Program Revision and Corresponding Flight Delay Assignments

Autonomous Airline Revenue Management: A Deep Reinforcement Learning Approach to Seat Inventory Control and Overbooking

A Multi-Agent Reinforcement Learning Approach for System-Level Flight Delay Absorption

Airport gate assignment problem with deep reinforcement learning

A Deep Multi-Agent Reinforcement Learning Approach to Autonomous Separation Assurance

A Machine Learning Approach to Air Traffic Route Choice Modelling

Reinforcement Learning for Freight Booking Control Problems

Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management

Graph Learning Based Decision Support for Multi-Aircraft Take-Off and Landing at Urban Air Mobility Vertiports

An Autonomous Free Airspace En-route Controller using Deep Reinforcement Learning Techniques

Adaptive Dynamic Programming with Reinforcement Learning on Optimization of Flight Departure Scheduling

A Centralized Multi-Agent Negotiation Approach to Collaborative Air Traffic Resource Management Planning

An ETA-Based Tactical Conflict Resolution Method for Air Logistics Transportation

General real-time three-dimensional multi-aircraft conflict resolution method using multi-agent reinforcement learning

Fairness and Collaboration in Network Air Traffic Flow Management: An Optimization Approach

General multi-agent reinforcement learning integrating heuristic-based delay priority strategy for demand and capacity balancing

Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks

Using Reinforcement Learning to Improve Airspace Structuring in an Urban Environment