Abstract:Pilots of aircraft face varying degrees of cognitive workload even during normal flight operations. Periods of low cognitive workload may be followed by periods of high cognitive workload and vice versa. During such changing demands, there exists potential for increased error on behalf of the pilots due to periods of boredom or excessive cognitive task demand. To further understand cognitive workload in aviation, the present study involved collection of electroencephalogram (EEG) data from ten (10) collegiate aviation students in a live-flight environment in a single-engine aircraft. Each pilot possessed a Federal Aviation Administration (FAA) commercial pilot certificate and either FAA class I or class II medical certificate. Each pilot flew a standardized flight profile representing an average instrument flight training sequence. For data analysis, we used four main sub-bands of the recorded EEG signals: delta, theta, alpha, and beta. Power spectral density (PSD) and log energy entropy of each sub-band across 20 electrodes were computed and subjected to two feature selection algorithms (recursive feature elimination (RFE) and lasso cross-validation (LassoCV), and a stacking ensemble machine learning algorithm composed of support vector machine, random forest, and logistic regression. Also, hyperparameter optimization and tenfold cross-validation were used to improve the model performance, reliability, and generalization. The feature selection step resulted in 15 features that can be considered an indicator of pilots' cognitive workload states. Then these features were applied to the stacking ensemble algorithm, and the highest results were achieved using the selected features by the RFE algorithm with an accuracy of 91.67% (± 0.11), a precision of 93.89% (± 0.09), recall of 91.67% (± 0.11), F-score of 91.22% (± 0.12), and the mean ROC-AUC of 0.93 (± 0.06). The achieved results indicated that the combination of PSD and log energy entropy, along with well-designed machine learning algorithms, suggest the potential for the use of EEG to discriminate periods of the low, medium, and high workload to augment aircraft system design, including flight automation features to improve aviation safety.

Pilot's Cognitive State Recognition Using Wavelet Singular Entropy and Gaussian Process Classification Via Full Flight Simulation

Mental workload recognition using ECG and machine learning in simulated flight tasks

Modeling and analysis of fatigue detection with multi-channel data fusion

Detection of Pilots' Psychological Workload during Turning Phases Using EEG Characteristics

Using machine learning methods and EEG to discriminate aircraft pilot cognitive workload during flight

A Method for Classification and Evaluation of Pilot’s Mental States Based on CNN

Recognition of Different Turning Behaviors of Pilots Based on Flight Simulator and fNIRS Data

Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks

Decoding EEG-based Workload Levels Using Spatio-temporal Features Under Flight Environment

Detection of mental fatigue state using heart rate variability and eye metrics during simulated flight

Monitoring pilot trainees' cognitive control under a simulator-based training process with EEG microstate analysis

Assessment of Pilots’ Cognitive Competency Using Situation Awareness Recognition Model Based on Visual Characteristics

Sustained Attention States Recognition with EEG and Eye-Tracking in the GradCPT.

Inferring Cognitive State of Pilot's Brain Under Different Maneuvers During Flight

Identification of Pilots' Fatigue Status Based on Electrocardiogram Signals

Fatigue Detection of Pilots' Brain Through Brains Cognitive Map and Multilayer Latent Incremental Learning Model

Nonparametric Bayesian Prior Inducing Deep Network for Automatic Detection of Cognitive Status

Self-Paced Dynamic Infinite Mixture Model for Fatigue Evaluation of Pilots' Brains

Classification of Electrophysiological Signatures With Explainable Artificial Intelligence: The Case of Alarm Detection in Flight Simulator

Decoding Fatigue Levels of Pilots Using EEG Signals with Hybrid Deep Neural Networks

Assessing the Effects of Various Physiological Signal Modalities on Predicting Different Human Cognitive States