Abstract:Using computers to replace pilot seats in air traffic control (ATC) simulators is an effective way to improve controller training efficiency and reduce training costs. To achieve this, we propose a deep reinforcement learning model, RoBERTa-RL (RoBERTa with Reinforcement Learning), for generating pilot repetitions. RoBERTa-RL is based on the pre-trained language model RoBERTa and is optimized through transfer learning and reinforcement learning. Transfer learning is used to address the issue of scarce data in the ATC domain, while reinforcement learning algorithms are employed to optimize the RoBERTa model and overcome the limitations in model generalization caused by transfer learning. We selected a real-world area control dataset as the target task training and testing dataset, and a tower control dataset generated based on civil aviation radio land-air communication rules as the test dataset for evaluating model generalization. In terms of the ROUGE evaluation metrics, RoBERTa-RL achieved significant results on the area control dataset with ROUGE-1, ROUGE-2, and ROUGE-L scores of 0.9962, 0.992, and 0.996, respectively. On the tower control dataset, the scores were 0.982, 0.954, and 0.982, respectively. To overcome the limitations of ROUGE in this field, we conducted a detailed evaluation of the proposed model architecture using keyword-based evaluation criteria for the generated repetition instructions. This evaluation criterion calculates various keyword-based metrics based on the segmented results of the repetition instruction text. In the keyword-based evaluation criteria, the constructed model achieved an overall accuracy of 98.8% on the area control dataset and 81.8% on the tower control dataset. In terms of generalization, RoBERTa-RL improved accuracy by 56% compared to the model before improvement and achieved a 47.5% improvement compared to various comparative models. These results indicate that employing reinforcement learning strategies to enhance deep learning algorithms can effectively mitigate the issue of poor generalization in text generation tasks, and this approach holds promise for future application in other related domains.

Automated Spoken-to-Coded Pilot Weather Reports in General Aviation

Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulator

A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers

Training General Aviation Pilots for Convective Weather Situations

Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports

Natural Language Processing of Aviation Occurrence Reports for Safety Management

Semantic Encoding Algorithm for Classification and Retrieval of Aviation Safety Reports

Grammar Based Speaker Role Identification for Air Traffic Control Speech Recognition

Natural Language Processing (NLP) in Aviation Safety: Systematic Review of Research and Outlook into the Future

Realization and design of a pilot assist decision-making system based on speech recognition

Research on automatic pilot repetition generation method based on deep reinforcement learning

Automating UAV Flight Readiness Approval using Goal-Directed Answer Set Programming

Evaluating an education/training module to foster knowledge of cockpit weather technology

ScenicNL: Generating Probabilistic Scenario Programs from Natural Language

A review: development of named entity recognition (NER) technology for aeronautical information intelligence

AviationGPT: A Large Language Model for the Aviation Domain

Automatic Speech Recognition Post-Processing for Readability: Task, Dataset and a Two-Stage Pre-Trained Approach

Practical Evaluation of ChatGPT Performance for Radiology Report Generation

From Words to Flight: Integrating OpenAI ChatGPT with PX4/Gazebo for Natural Language-Based Drone Control

Speech Recognition for Analysis of Police Radio Communication

A method for identifying relevant topics of pilot simulator training based on clustering of flight safety reports