Abstract:Safety is a top priority for civil aviation. Data mining in digital Flight Data Recorder (FDR) or Quick Access Recorder (QAR) data, commonly referred to as black box data on aircraft, has gained interest for proactive safety management. New anomaly detection methods, primarily clustering methods, have been developed to monitor pilot operations and detect any risks from such flight data. However, all existing anomaly detection methods are offline learning — the models are trained once using historical data and used for all future predictions. In practice, new flight data are accumulated continuously and analyzed every month at airlines. Clustering such dynamically growing data is challenging for an offline method because it is memory and time intensive to re-train the model every time new data come in. If the model is not re-trained, false alarms or missed detections may increase since the model cannot reflect changes in data patterns. To address this problem, we propose a novel incremental anomaly detection method based on Gaussian Mixture Model (GMM) to identify common patterns and detect outliers in flight operations from digital flight data. It is a probabilistic clustering model of flight operations that can incrementally update its clusters based on new data rather than to re-cluster all data from scratch. It trains an initial GMM model based on historical offline data. Then, it continuously adapts to new incoming data points via an expectation–maximization (EM) algorithm. To track changes in flight operation patterns, only model parameters need to be saved, not the raw flight data. The proposed method was tested on three sets of simulation data and two sets of real-world flight data. Compared with the traditional offline GMM method, the proposed method can generate similar clustering results with significantly reduced processing time (57 %–99 % time reduction in testing sets) and memory usage (91 %–95 % memory usage reduction in testing sets). Preliminary results indicate that the incremental learning scheme is effective in dealing with dynamically growing data in flight data analytics.

Unsupervised Flight Phase Recognition with Flight Data Clustering Based on GMM

An incremental clustering method for anomaly detection in flight data

Study on Machine Learning Methods for General Aviation Flight Phase Identification

Dynamic Driving Intention Recognition of Vehicles with Different Driving Styles of Surrounding Vehicles

Research on Flight Type Recognition Technology Based on Information Fusion

Research on Engine Thrust and Load Factor Prediction by Novel Flight Maneuver Recognition Based on Flight Test Data

Aircraft Trajectory Clustering in Terminal Airspace Based on Deep Autoencoder and Gaussian Mixture Model

Minimally Supervised Topological Projections of Self-Organizing Maps for Phase of Flight Identification

Multivariate Time Series Feature Extraction and Clustering Framework for Multi-Function Radar Work Mode Recognition

Traffic flow clustering framework using drone video trajectories to identify surrogate safety measures

Flight Situation Recognition Under Different Weather Conditions

CurveCluster+: Curve Clustering for Hard Landing Pattern Recognition and Risk Evaluation Based on Flight Data

A Flight Trajectory Prediction Method based on Trajectory Clustering

Spatial Information-Aware Flight Safety Forecasting Model for Unmanned Aerial Vehicles Based on Deep Learning and Grey Analysis

Cluster Head Detection for Hierarchical UAV Swarm With Graph Self-supervised Learning

Aircraft Behavior Recognition on Trajectory Data with a Multimodal Approach

Toward Safer Flight Training: The Data-Driven Modeling of Accident Risk Network Using Text Mining Based on Deep Learning

Machine Learning Based Flight State Prediction for Improving UAV Resistance to Uncertainty

Flight Data Outlier Detection by Constrained LSTM-autoencoder.

Data-driven multivariate regression-based anomaly detection and recovery of unmanned aerial vehicle flight data

Railway Fault Text Clustering Method Using an Improved Dirichlet Multinomial Mixture Model