Abstract:IntroductionIn a complex environment where the messages exchange intensively among the agents, a difficulty task is to decide the best action for new arriving messages during on-line control.A typical form of communication in Air Traffic Flow Management (ATFM) is verbal language to exchange the information and there is almost no digital recording of this communication between pilot and air controller.As the development of distributed computation system [1], the digital message communication is proposed especially for processing the immense amount of messages.In a real case such as the First Integrated Center of Air Defense and Air Traffic Control -CINDACTA I, in Brasilia, the system monitors 70% of the traffic flow in Brazil.According to the air traffic control procedure in CINDACTA I, Flight Information Region of Brasilia -FIR-BS is divided into 14 sectors and managed by 3 regional supervisors (Sao Paulo, Rio de Janeiro and Brasilia).Every air controller monitors his sector and is responsible to his supervisor.Only supervisor can make a decision to manage the air traffic flow.Any action is realized by air controller according to the decision of supervisor.For example, a decision may be to hold a flight in an airport for more 10 minutes, or assign the priority to another flight in the landing processing.In CINDACTA I, the monitor system (equipment and operation software) is suitable, but there is no a general system to manage and synchronize the traffic dynamically and to support the decision for adequate traffic management.Supervisor makes the decision just by his experience without quantity analyses of the impact of the action.To resolve this kind of problem, some researches were developed using the solution of Artificial Intelligence and others according to the new conception of ATFM.A distributed ATM system has been studied in Australia [2].The advantages of that approach are inherent distribution, autonomy, communication and reliability.Prevôt, from NASA Ames Research Center, has studied a distributed approach for operator interfaces and intelligent flight guidance, management and decision support [3].An application of multi-agent coordination techniques in ATM, which sets up a methodological framework using multi-agent coordination techniques that supports the collaborative work in ATM has also been presented recently by Eurocontrol [4].It should be mentioned that the multi-agent

Autonomous Air Traffic Controller: A Deep Multi-Agent Reinforcement Learning Approach

A Deep Multi-Agent Reinforcement Learning Approach to Autonomous Separation Assurance

A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control

An Autonomous Free Airspace En-route Controller using Deep Reinforcement Learning Techniques

A Multi-Agent Reinforcement Learning Approach for Conflict Resolution in Dense Traffic Scenarios

An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning

Strategic Conflict Management using Recurrent Multi-agent Reinforcement Learning for Urban Air Mobility Operations Considering Uncertainties

A Multi-Agent Reinforcement Learning Approach for System-Level Flight Delay Absorption

General real-time three-dimensional multi-aircraft conflict resolution method using multi-agent reinforcement learning

Autonomous air traffic separation assurance through machine learning

Deep Reinforcement Learning Based Conflict Detection and Resolution in Air Traffic Control

Reinforcement Learning to Support Meta-Level Control in Air Traffic Management

Improving Autonomous Separation Assurance through Distributed Reinforcement Learning with Attention Networks

Multi-Level Objective Control of AVs at a Saturated Signalized Intersection with Multi-Agent Deep Reinforcement Learning Approach

General multi-agent reinforcement learning integrating adaptive manoeuvre strategy for real-time multi-aircraft conflict resolution

Enhancing Air Traffic Control: A Transparent Deep Reinforcement Learning Framework for Autonomous Conflict Resolution

Deep Reinforcement-Learning-Based Air-Combat-Maneuver Generation Framework

Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management

Hierarchical Multi-Agent Reinforcement Learning for Air Combat Maneuvering

Optimizing Collision Avoidance in Dense Airspace using Deep Reinforcement Learning

Decentralized Trajectory and Power Control Based on Multi-Agent Deep Reinforcement Learning in UAV Networks