Abstract:A deep learning-based safety monitoring framework for air traffic control (ATC) systems is proposed in this paper to reduce human errors and relieve the controllers' workload by regulating the controlling procedure, eliminating communication misunderstanding, monitoring flight conformance, and detecting potential conflicts. The framework comprises automatic speech recognition (ASR), controlling intent inference (CII), and control safety monitoring (CSM) subsystems. The pipeline of the proposed framework can be described as follows: the ASR subsystem translates the pilot-controller voice communications (PCVCs) into texts, which are then converted to the predefined data structure by the CII subsystem. Three types of air traffic safety measures, including repetition check, flight conformance verification, and potential conflict detection, are finally validated by the CSM subsystem. An improved end-to-end ASR model with convolutional, bidirectional long short-term memory (BLSTM) and fully connected (FC) layers is trained using the connectionist temporal classification loss function. The BLSTM and FC combined CII model is designed to infer the controlling intent and slot filling. A language model is also trained in this subsystem to improve the overall performance of the framework. After converting the PCVCs to ATC data, the CSM subsystem checks the given safety monitoring tasks and sends warnings to the current system. The experimental results show that the proposed ASR model obtains a better performance than that of other approaches, and the tasks in the CII subsystem are fulfilled with a high classification precision. The CSM subsystem is also tested to confirm its safety monitoring function by playing back the data and several simulated instructions. To the best of our knowledge, this is pioneering work in the safety monitoring of flight control by recognizing the PCVCs with deep learning-based methods.

Air Traffic Control Command Monitoring System Based on Information Integration

Information-integration Based Air Traffic Control Command Monitoring System- ATCCMS

Enhancing Air Traffic Control Communication Systems with Integrated Automatic Speech Recognition: Models, Applications and Performance Evaluation

Research on Civil Aviation Air Traffic Information System Based on Safety Guarantee

A Real-Time ATC Safety Monitoring Framework Using a Deep Learning Approach

Study of Multi-Mission Management Technology on the TT&C Network

Integrated Display and Simulation for Automatic Dependent Surveillance–Broadcast and Traffic Collision Avoidance System Data Fusion

Railway Comprehensive Monitoring and Warning System Framework Based on Space-air-Vehicle-Ground Integration Network

Train-Centric Communication Based Autonomous Train Control System

TICS-A New Intelligent Urban Real Time Traffic Control System

ISAC-Assisted Collision Avoidance Mechanism for Vehicle-to-Infrastructure Systems

Data-driven Traffic Dynamic Understanding and Safety Monitoring Applications

Intelligent Monitoring and Control System for underground mine rail transportation based on communication-based train control (CBTC) system and AI computing

A City Monitoring System Based on Real-Time Communication Interaction Module and Intelligent Visual Information Collection System

Reliability Prediction and Safety Evaluation of ATC Automation System

Local Airspace Traffic Prediction and Flow Control Strategy Recommendation System.

Enhancing Integrated Sensing and Communication (ISAC) Performance for a Searching–Deciding Alternation Radar-Comm System with Multi-Dimension Point Cloud Data

Study on Integrated Aircraft Environment Surveillance System and Its Digital Simulation Test

Research on assessment of air traffic control operation quality based on track data

Research of Multi-Information Integration for the Aircraft Ground De-icing Monitoring System Based on GIS and GPRS