Abstract:Safety is a top priority for civil aviation. Data mining in digital Flight Data Recorder (FDR) or Quick Access Recorder (QAR) data, commonly referred to as black box data on aircraft, has gained interest for proactive safety management. New anomaly detection methods, primarily clustering methods, have been developed to monitor pilot operations and detect any risks from such flight data. However, all existing anomaly detection methods are offline learning — the models are trained once using historical data and used for all future predictions. In practice, new flight data are accumulated continuously and analyzed every month at airlines. Clustering such dynamically growing data is challenging for an offline method because it is memory and time intensive to re-train the model every time new data come in. If the model is not re-trained, false alarms or missed detections may increase since the model cannot reflect changes in data patterns. To address this problem, we propose a novel incremental anomaly detection method based on Gaussian Mixture Model (GMM) to identify common patterns and detect outliers in flight operations from digital flight data. It is a probabilistic clustering model of flight operations that can incrementally update its clusters based on new data rather than to re-cluster all data from scratch. It trains an initial GMM model based on historical offline data. Then, it continuously adapts to new incoming data points via an expectation–maximization (EM) algorithm. To track changes in flight operation patterns, only model parameters need to be saved, not the raw flight data. The proposed method was tested on three sets of simulation data and two sets of real-world flight data. Compared with the traditional offline GMM method, the proposed method can generate similar clustering results with significantly reduced processing time (57 %–99 % time reduction in testing sets) and memory usage (91 %–95 % memory usage reduction in testing sets). Preliminary results indicate that the incremental learning scheme is effective in dealing with dynamically growing data in flight data analytics.

Anomaly detection in aircraft data using Recurrent Neural Networks (RNN)

Anomaly Detection for Aircraft Based on Multivariate LSTM and Predictive Residual Test

A Real Time Anomaly Detection Method Based on Variable N-Gram for Flight Data.

Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder

Learning Long-Range Relationships for Temporal Aircraft Anomaly Detection

Robust Anomaly Detection for Multivariate Time Series Through Stochastic Recurrent Neural Network

Impact of Recurrent Neural Networks and Deep Learning Frameworks on Real-time Lightweight Time Series Anomaly Detection

A Knns Based Anomaly Detection Method Applied for Uav Flight Data Stream

Imbalanced Aircraft Data Anomaly Detection

Anomaly detection in multivariate time series data using deep ensemble models

Automatic Real-time Anomaly Detection for Autonomous Aerial Vehicles

Network Traffic Anomaly Detection Using Recurrent Neural Networks

A Comparison of Deep Learning Architectures for Spacecraft Anomaly Detection

Unmanned Aerial Vehicle Flight Data Anomaly Detection Based on Multi-Rate Aware LSTM

Unmanned Aerial Vehicle Flight Data Anomaly Detection Based on Multirate-Aware LSTM

Exploring the effects of RNNs and deep learning frameworks on real‐time, lightweight, adaptive time series anomaly detection

Anomalous Trajectory Detection Using Recurrent Neural Network

A Novel End-to-end Anomaly Detection Framework for Spacecraft Using MINE and LSTM-VAE with Attention Mechanism

Data-driven multivariate regression-based anomaly detection and recovery of unmanned aerial vehicle flight data

An efficient algorithm for anomaly detection in a flight system using dynamic bayesian networks

An incremental clustering method for anomaly detection in flight data