Abstract:Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due to largely improved data availability and computing power in the aviation industry. Many aviation-based applications can be formulated or treated as sequential decision-making problems. Some of them are offline planning problems, while others need to be solved online and are safety-critical. In this survey paper, we first describe standard RL formulations and solutions. Then we survey the landscape of existing RL-based applications in aviation. Finally, we summarize the paper, identify the technical gaps, and suggest future directions of RL research in aviation.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: in aviation applications, how to use Reinforcement Learning (RL) technology to solve complex decision - making problems and improve the safety, efficiency and sustainability in the aviation field. Specifically, the paper aims to: 1. **Review existing research**: Provide a comprehensive overview of Reinforcement Learning in aviation applications, including basic concepts, algorithms and their successful implementation cases in the aviation field. 2. **Identify key technological gaps**: Point out the technological challenges faced when applying Reinforcement Learning to the aviation field, especially in safety - critical applications such as aircraft collision avoidance systems. 3. **Propose future research directions**: Emphasize the need for continuous innovation and cooperation between Reinforcement Learning and the aviation field to promote the further development of this field. ### Main contributions of the paper - **Identify state - of - the - art algorithms**: Determine the most successful Reinforcement Learning algorithms in aviation applications and provide references for researchers. - **Technical gap analysis**: Discuss the key technical problems encountered in practical applications, especially the challenges related to safety certification. - **Inter - disciplinary cooperation**: Promote the communication and cooperation between researchers in Reinforcement Learning and the aviation field and promote technological innovation in this field. ### Specific application areas The paper explores in detail the applications of Reinforcement Learning in the following aviation fields: 1. **Flight control**: Use RL to develop adaptive flight controllers to improve flight stability and responsiveness. 2. **Air traffic management**: Optimize air traffic flow management through RL to reduce delays and improve safety. 3. **Airline revenue management**: Use RL to dynamically adjust fare and seat allocation strategies to maximize revenue. 4. **Aircraft maintenance scheduling**: Predict failures and optimize maintenance plans through RL to improve the availability and reliability of aircraft. 5. **Fault - tolerant control**: Use RL to enhance fault detection and recovery capabilities to ensure flight safety. 6. **Flight planning**: Use RL to dynamically optimize flight routes to improve efficiency and safety. 7. **Air traffic flow management**: Adjust flight paths in real - time through RL to deal with emergencies and ensure the efficient operation of the airspace system. ### Conclusion The paper not only provides a comprehensive review of Reinforcement Learning in the aviation field, but also points out the directions of future research and the challenges faced, laying the foundation for the further development of this field.

A Survey on Reinforcement Learning in Aviation Applications

Application of Deep Reinforcement Learning in UAVs: A Review

Reinforcement Learning in Process Industries: Review and Perspective

Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation

Recent Advances in Reinforcement Learning in Finance

Comprehensive Survey of Reinforcement Learning: From Algorithms to Practical Challenges

Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey

Review of Deep Reinforcement Learning Approaches for Conflict Resolution in Air Traffic Control

Controlling Fleets of Autonomous Mobile Robots with Reinforcement Learning: A Brief Survey

Reinforcement Learning in Healthcare: A Survey

Autonomous air traffic separation assurance through machine learning

Aircraft Line Maintenance Scheduling Using Simulation and Reinforcement Learning

State-wise Safe Reinforcement Learning: A Survey

Deep Reinforcement Learning for Autonomous Driving: A Survey

Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey

Automated Reinforcement Learning: An Overview

A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation

A Review of Reinforcement Learning in Financial Applications

A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control

Reinforcement learning: Introduction to theory and potential for transport applications