Abstract:Objective: This simulation study investigated factors influencing sustained performance and fatigue during operation of multiple Unmanned Aerial Systems (UAS). The study tested effects of time-on-task and automation reliability on accuracy in surveillance tasks and dependence on automation. It also investigated the role of trait and state individual difference factors. Background: Warm's resource model of vigilance has been highly influential in human factors, but further tests of its applicability to complex, real-world tasks requiring sustained attention are necessary. Multi-UAS operation differs from standard vigilance paradigms in that the operator must switch attention between multiple subtasks, with support from automation. Method: 131 participants performed surveillance tasks requiring signal discrimination and symbol counting with a multi-UAS simulation configured to impose low cognitive demands, for 2 hr. Automation reliability was manipulated between-groups. Five Factor Model personality traits were measured prior to performance. Subjective states were assessed with the Dundee Stress State Questionnaire. Results: Performance accuracy on the more demanding surveillance task showed a vigilance decrement, especially when automation reliability was low. Dependence on automation on this task declined over time. State but not trait factors predicted performance. High distress was associated with poorer performance in more demanding task conditions. Conclusions: Vigilance decrement may be an operational issue for multi-UAS surveillance missions. Warm's resource theory may require modification to incorporate changes in information processing and task strategy associated with multitasking in low-workload, fatiguing environments. Application: Interface design and operator evaluation for multi-UAS operations should address issues including motivation, stress, and sustaining attention to automation.

Monitoring the Performance of a Multi-UAV Operator Through Eye Tracking

Evaluating Multi-UAV Operator's Cognitive Workload Using Eye Tracking Data

Human Machine Collaborative Support Scheduling System of Intelligence Information from Multiple Unmanned Aerial Vehicles Based on Eye Tracker

Eye-Tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training

Fatigue Detection of Air Traffic Controllers Through Their Eye Movements

Usage of eye tracker technology in examining attention distribution of operators of unmanned aerial vehicles

Real-time Evaluation Method of Flight Mission Load Based on Sensitivity Analysis of Physiological Factors

On the Use of Real-Time Multi-Object Detection and Classification for Automated Assessment of Operator Visual Attention Allocation

A Multitask Cascading CNN with MultiScale Infrared Optical Flow Feature Fusion-Based Abnormal Crowd Behavior Monitoring UAV

Eye Tracking for Assessment of Mental Workload and Evaluation of RVD Interface

A Model for Quantifying Pilot's Situation Perception Based on Attention Allocation

A Human Visual Attention Analysis Model for Remote Interaction Interface of Unmanned Agricultural Vehicles

Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study

Eye Movements of Pilot Flying in Simulated Flight: an Eye-Tracking Study

Multiple Scales Pilot Action Pattern Recognition During Flight Task Using Video Surveillance

Detection of driver fatigue based on eye movements

A Monocular Inertial UAV SLAM Algorithm Leveraging Feature Clustering

Exploring Eye Tracking to Detect Cognitive Load in Complex Virtual Reality Training

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Monitoring the State of the Operator of the Ergatic System in UAV Control Tasks

Identification and Classification of Construction Equipment Operators' Mental Fatigue Using Wearable Eye-Tracking Technology