Data-driven multivariate regression-based anomaly detection and recovery of unmanned aerial vehicle flight data

Lei Yang,Shaobo Li,Chuanjiang Li,Caichao Zhu
DOI: https://doi.org/10.1093/jcde/qwae023
2024-03-14
Journal of Computational Design and Engineering
Abstract:Flight data anomaly detection is crucial to ensuring the safe operation of unmanned aerial vehicles (UAVs) and has been extensively studied. However, the accurate modeling and analysis of flight data is challenging due to the influence of random noise. Meanwhile, existing methods are often inadequate in parameter selection and feature extraction when dealing with large-scale and high-dimensional flight data. This paper proposes a data-driven multivariate regression-based framework considering spatio-temporal correlation for UAV flight data anomaly detection and recovery, which integrates the techniques of correlation analysis (CA), one-dimensional convolutional neural network and long short-term memory (1D CNN-LSTM), and error filtering (EF), named CA-1DCL-EF. Specifically, correlation analysis is first performed on original UAV flight data to select parameters with correlation to reduce the model input and avoid the negative impact of irrelevant parameters on the model. Next, a regression model based on 1D CNN-LSTM is designed to fully extract the spatio-temporal features of UAV flight data and realize parameter mapping. Then, to overcome the effect of random noise, a filtering technique is introduced to smooth the errors to improve the anomaly detection performance. Finally, two common anomaly types are injected into real UAV flight datasets to verify the effectiveness of the proposed method.
computer science, interdisciplinary applications,engineering, multidisciplinary
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper aims to address the issue of anomaly detection and recovery in Unmanned Aerial Vehicle (UAV) flight data. Specifically, the paper proposes a data-driven framework CA-1DCL-EF based on multivariate regression to handle UAV flight data with spatiotemporal correlations. #### Main Issues: 1. **Insufficient Parameter Selection**: Existing methods often lack sufficient parameter selection and feature extraction when dealing with large-scale high-dimensional flight data. 2. **Limitations in Spatiotemporal Feature Extraction**: Current methods mainly rely on Long Short-Term Memory networks (LSTM), but they have limitations in handling complex spatiotemporal characteristics and multi-parameter interactions in flight data. 3. **Impact of Random Noise**: Random noise in real flight data caused by sensor errors, external environment, and other factors affects the accuracy of existing methods. 4. **Lack of Data Recovery Functionality**: Some existing methods perform well in anomaly detection but neglect the functionality of data recovery. ### Overview The paper proposes a new framework CA-1DCL-EF to address the above issues through the following steps: 1. **Correlation Analysis**: Use the Maximal Information Coefficient (MIC) for correlation analysis to filter out relevant flight parameters as model inputs, reducing the negative impact of irrelevant parameters on model performance. 2. **1D CNN-LSTM Model**: Combine the advantages of 1D Convolutional Neural Networks (1D CNN) and LSTM to design a regression model capable of comprehensively extracting spatiotemporal features. 3. **Error Filtering**: Introduce error filtering techniques to smooth errors and improve anomaly detection performance. ### Method Framework 1. **Data Preprocessing**: Normalize the raw UAV flight data. 2. **Parameter Selection**: Use MIC for correlation analysis to select relevant parameters. 3. **Model Training**: Train the 1D CNN-LSTM model and construct input data using a sliding window method. 4. **Anomaly Detection and Data Recovery**: Achieve anomaly detection by comparing the smoothed test error with a threshold and achieve data recovery by replacing anomalous data with predicted data. ### Experimental Validation The paper validates the effectiveness of the proposed method through experiments on a real high-dimensional UAV flight dataset and provides detailed evaluation and comparison.