Abstract:Froth flotation, a widely used mineral beneficiation technique, generates substantial volumes of data, offering the opportunity to extract valuable insights from these data for production line analysis. The quality of flotation data is critical to designing accurate prediction models and process optimisation. Unfortunately, industrial flotation data are often compromised by quality issues such as outliers that can produce misleading or erroneous analytical results. A general approach is to preprocess the data by replacing or imputing outliers with data values that have no connection with the real state of the process. However, this does not resolve the effect of outliers, especially those that deviate from normal trends. Outliers often occur across multiple variables, and their values may occur in normal observation ranges, making their detection challenging. An unresolved challenge in outlier detection is determining how far an observation must be to be considered an outlier. Existing methods rely on domain experts' knowledge, which is difficult to apply when experts encounter large volumes of data with complex relationships. In this paper, we propose an approach to conduct outlier analysis on a flotation dataset and examine the efficacy of multiple machine learning (ML) algorithms—including k-Nearest Neighbour (kNN), Local Outlier Factor (LOF), and Isolation Forest (ISF)—in relation to the statistical 2σ rule for identifying outliers. We introduce the concept of "quasi-outliers" determined by the 2σ threshold as a benchmark for assessing the ML algorithms' performance. The study also analyses the mutual coverage between quasi-outliers and outliers from the ML algorithms to identify the most effective outlier detection algorithm. We found that the outliers by kNN cover outliers of other methods. We use the experimental results to show that outliers affect model prediction accuracy, and excluding outliers from training data can reduce the average prediction errors.

Study on Test Method for Outlier of Flight Data

One Effective Method of Outlier Detection in Flight Data

Remaining Useful Life Prediction of the Aviation Engine Based on the Long-Short-Term-Memory Network with a Feature Selection Mechanism.

Outlier Detection Algorithm Based on Reachable Neighbor

Flight Data Outlier Detection by Constrained LSTM-autoencoder.

A method of outlier detection using fuzzy-set theory in radar measure data processing

Parallel crosschecking neural network based fault-tolerant flight parameter estimation and faulty sensor identification

A Prognostic Approach to Improve System Reliability for Aircraft System

Integration Of Ann And Statistical Method For Outlier Detection In Complex System

Detecting Outliers in Data with Correlated Measures

Anomaly detection in aircraft data using Recurrent Neural Networks (RNN)

Machine learning based technique for outlier detection and result prediction in combustion diagnostics

Aeromagnetic Compensation Algorithm Robust to Outliers of Magnetic Sensor Based on Huber Loss Method

A Neural Network Weights Initialization Approach for Diagnosing Real Aircraft Engine Inter-Shaft Bearing Faults

Regression Model for Civil Aero-Engine Gas Path Parameter Deviation Based on Deep Domain-Adaptation with Res-BP Neural Network

Aircraft HRRP classification based on RBFNN

A Novel Outlier Detection Method for Multivariate Data

Robust Multi-Kernel Nearest Neighborhood for Outlier Detection

Effective Outlier Detection for Ensuring Data Quality in Flotation Data Modelling Using Machine Learning (ML) Algorithms

Aircraft Target Recognition Method Based on Radial-Basis-function Neural Networks

Application of Fuzzy Self-Organizing Neural Network to Aeroengine Fault Diagnosis