Exploration of multimodal alarms for civil aircraft flying task: A laboratory study

Wenzhe Cun,Suihuai Yu,Jianjie Chu,Yanhao Chen,Jianhua Sun,Hao Fan

DOI: https://doi.org/10.1002/hfm.21026

2024-02-08

Human Factors and Ergonomics in Manufacturing & Service Industries

Abstract:Human Factors and Ergonomics in Manufacturing &Service Industries, EarlyView.

engineering, manufacturing,ergonomics

What problem does this paper attempt to address?

The Attention Aware System: A Human-Computer Interaction Interface in the Multi-Task Context

Wen-jing YIN,Bai-hua XU,Xiang-yu CUI

DOI: https://doi.org/10.3969/j.issn.1006-6020.2006.03.015

2006-01-01

Abstract:The attention aware system is such a human-computer interaction system that aims to support users in better maintaining or switching their attention focus in the multi-task context.Attention aware systems are designed based on the theories of cognitive psychology and cognitive ergonomics.This paper offers a review of the current approach to attention aware systems,which is composed of three parts:to detect user's current attentional state,to make an evaluation of user's interruptibility and to optimize the style of notifications.Finally,the paper discusses the most promising research direction for development of attention aware systems
Aircraft human‐machine interaction assistant design: A novel multimodal data processing and application framework

Ao Wu,Yang Jin,Maolong Lv,Huanyu Li,Leyan Li,Rennong Yang

DOI: https://doi.org/10.1049/cth2.12754

IF: 2.67

2024-10-29

IET Control Theory and Applications

Abstract:A novel multimodal data processing and application framework to support the implementation of an aircraft human‐machine interaction assistant (AHMIA) is presented. The AHIMIA enables active‐command and passive‐response interactions with pilots and process three input modes, including voice inputs, situation inputs, and plan inputs. During aircraft operations, pilots rely on human‐machine interaction platforms to access essential information services. However, the development of a highly usable aerial assistant necessitates the incorporation of two interaction modes: active‐command and passive‐response modes, along with three input modes: voice inputs, situation inputs, and plan inputs. This research focuses on the design of an aircraft human‐machine interaction assistant (AHMIA), which serves as a multimodal data processing and application framework for human‐to‐machine interaction in a fully voice‐controlled manner. For the voice mode, a finetuned FunASR model is employed, leveraging private aeronautical datasets to enable specific aeronautical speech recognition. For the situation mode, a hierarchical situation events extraction model is proposed, facilitating the utilization of high‐level situational features. For the plan mode, a multi‐formations double‐code network plan diagram with a timeline is utilized to effectively represent plan information. Notably, to bridge the gap between human language and machine language, a hierarchical knowledge engine named process‐event‐condition‐order‐skill (PECOS) is introduced. PECOS provides three distinct products: the PECOS model, the PECOS state chart, and the PECOS knowledge description. Simulation results within the air confrontation scenario demonstrate that AHMIA enables active‐command and passive‐response interactions with pilots, thereby enhancing the overall interaction modality.

automation & control systems,engineering, electrical & electronic,instruments & instrumentation
Evaluation of Multimodal and Multi-Staged Alerting Strategies for Forward Collision Warning Systems

Jun Ma,Jiateng Li,Hongwei Huang

DOI: https://doi.org/10.3390/s22031189

2022-02-04

Abstract:V2X is used for communication between the surrounding pedestrians, vehicles, and roadside units. In the Forward Collision Warning (FCW) of Phase One scenarios in V2X, multimodal modalities and multiple warning stages are the two main warning strategies of FCW. In this study, three warning modalities were introduced, namely auditory warning, visual warning, and haptic warning. Moreover, a multimodal warning and a novel multi-staged HUD warning were established. Then, the above warning strategies were evaluated in objective utility, driving performance, visual workload, and subjective evaluation. As for the driving simulator of the experiment, SCANeR was adopted to develop the driving scenario and an open-cab simulator was built based on Fanatec hardware. Kinematic parameters, location-related data and eye-tracking data were then collected. The results of the Analysis of Variance (ANOVA) indicate that the multimodal warning is significantly better than that of every single modality in utility and longitudinal car-following performance, and there is no significant difference in visual workload between multimodal warning and the baseline. The utility and longitudinal driving performance of multi-staged warning are also better than those of single-stage warning. Finally, the results provide a reference for the warning strategy design of the FCW in Intelligent Connected Vehicles.
Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Zhibin Zhou,Yitao Fan,Wenan Li,Hao Jiang,Weitao You,Lingyun Sun

DOI: https://doi.org/10.1080/10447318.2024.2381895

IF: 4.92

2024-01-01

International Journal of Human-Computer Interaction

Abstract:The interaction between autonomous vehicles (AVs) and pedestrians has gained significant attention, leading to the exploration of external human-machine interfaces (eHMIs) equipped on AVs to facilitate effective communication. While existing research suggests that perceptions of vehicle appearances may influence interactions between pedestrians and AVs, a comprehensive study on the eHMIs related to AV appearance remains lacking. Therefore, we conducted a virtual reality (VR) experiment to investigate how AV appearances affect pedestrians' acceptance regarding Awareness, Intent, and Harmony during interactions with various eHMIs. Leveraging the fuzzy set qualitative comparative analysis (fsQCA) method, we identified specific combinations of AV appearances and eHMIs that yield either high or low-performance interactions. For example, our findings reveal that text displays exhibit high performance in terms of awareness on AVs that are aggressive and ordinary. Furthermore, we distilled design guidelines to provide actionable suggestions for the design of eHMIs, fostering the acceptance of AVs among pedestrians.
ALARMS: Alerting and Reasoning Management System for Next Generation Aircraft Hazards

Alan S. Carlin,Nathan Schurr,Janusz Marecki

DOI: https://doi.org/10.48550/arXiv.1203.3470

IF: 14.4

2012-03-15

Artificial Intelligence

Abstract:The Next Generation Air Transportation System will introduce new, advanced sensor technologies into the cockpit. With the introduction of such systems, the responsibilities of the pilot are expected to dramatically increase. In the ALARMS (ALerting And Reasoning Management System) project for NASA, we focus on a key challenge of this environment, the quick and efficient handling of aircraft sensor alerts. It is infeasible to alert the pilot on the state of all subsystems at all times. Furthermore, there is uncertainty as to the true hazard state despite the evidence of the alerts, and there is uncertainty as to the effect and duration of actions taken to address these alerts. This paper reports on the first steps in the construction of an application designed to handle Next Generation alerts. In ALARMS, we have identified 60 different aircraft subsystems and 20 different underlying hazards. In this paper, we show how a Bayesian network can be used to derive the state of the underlying hazards, based on the sensor input. Then, we propose a framework whereby an automated system can plan to address these hazards in cooperation with the pilot, using a Time-Dependent Markov Process (TMDP). Different hazards and pilot states will call for different alerting automation plans. We demonstrate this emerging application of Bayesian networks and TMDPs to cockpit automation, for a use case where a small number of hazards are present, and analyze the resulting alerting automation policies.
An Activity Management System for Office Workers Using Multimodal Data

Xiangying Zhang,Pai Zheng,Qiqi He,Tao Peng,Wangchujun Tang,Hongling Ye,Renzhong Tang

DOI: https://doi.org/10.1109/case49997.2022.9926455

2022-01-01

Abstract:Lacking a certain level of activity is associated with multiple health issues, and activity management is significant for office workers who sit 77% of working hours. Recent studies on the Internet of Things spur the advent of applications for daily activity management. However, there is no activity management system collecting data unobtrusively and continuously, which provides activity recognition and assessment for office workers. Hence, this study develops a multimodal activity management system based on an infrared array sensor placed on the desk, a sensing chair, and a mobile phone. This system contains data collection, activity recognition, and activity assessment. A deep learning algorithm based on the feature-level fusion strategy is leveraged to fuse the multimodal activity data and achieve recognition. The activity assessment considers energy expenditure and sedentary bout to reflect office workers' activity characteristics. Finally, an experiment is conducted to verify the feasibility of the proposed system. The results show that recognition accuracy can reach 99.9% and 83.9% by using the validation set approach and leave-one-subject-out cross-validation approach, respectively.
Integrating Ergonomics Into Safety Management: A Conceptual Risk Assessment Model for Tower Controllers at Multiple Altitudes

Quan Shao,Min Dong,Zhiyuan Shen,Rui Yang,Hong Wang

DOI: https://doi.org/10.1109/access.2021.3091528

IF: 3.9

2021-01-01

IEEE Access

Abstract:Plateau and high plateau airports aggravate tower controllers' vulnerability, facing high safety risks, yet the risk evaluation paradigm to manage safety at multiple altitudes still lacks. The study aimed to investigate the effects of altitudes on controllers' mental workload and fatigue to assess the safety risk and introduced voices, mental workload, and fatigue, into a conceptual risk assessment model. Controllers from the Civil Aviation Administration of China (CAAC) conducted the experimental tasks, reporting mental workload and perception fatigue across three altitudes: 0 m, 2243 m, and 3569.7 m. With experimental data: this research (1) quantitatively compared the voice feature differences with feature engineering, and an image quality measure, (2) explored the effects of altitude, sleep, and fatigue, (3) tested the effects of altitude and task complexity on mental workload, and (4) evaluated the airport safety risks under ergonomic factors. Notably, the study revealed that Log-Mel spectrograms outperformed Mel Frequency Cepstral Coefficients (MFCC) in severe fatigue detection. Altitude and task complexity had significant main effects on the mental workload, but altitude had no significant moderator effects on the relationship between sleep and fatigue. The simulation results show that under the low task complexity, the operation risk is low over three airport elevations (with the human error rate $< mathrm { }{10}^{-3}$ ), whereas under the high task complexity, the operation risk increased with altitudes (from $1.73times {10}^{-3}$ to $mathrm { 1.02}times {10}^{-1}$ ). Together, these results suggest that ergonomic factors influenced airport safety risk at multiple altitudes and promisin- real-time fatigue detection with voice features at different altitudes.

computer science, information systems,telecommunications,engineering, electrical & electronic
Classification of Electrophysiological Signatures With Explainable Artificial Intelligence: The Case of Alarm Detection in Flight Simulator

Eva Massé,Olivier Bartheye,Ludovic Fabre

DOI: https://doi.org/10.3389/fninf.2022.904301

2022-06-16

Frontiers in Neuroinformatics

Abstract:Relevant sounds such as alarms are sometimes involuntarily ignored, a phenomenon called inattentional deafness. This phenomenon occurs under specific conditions including high workload (i.e., multitasking) and/or cognitive fatigue. In the context of aviation, such an error can have drastic consequences on flight safety. This study uses an oddball paradigm in which participants had to detect rare sounds in an ecological context of simulated flight. Cognitive fatigue and cognitive load were manipulated to trigger inattentional deafness, and brain activity was recorded via electroencephalography (EEG). Our results showed that alarm omission and alarm detection can be classified based on time-frequency analysis of brain activity. We reached a maximum accuracy of 76.4% when the algorithm was trained on all participants and a maximum of 90.5%, on one participant, when the algorithm was trained individually. This method can benefit from explainable artificial intelligence to develop efficient and understandable passive brain–computer interfaces, improve flight safety by detecting such attentional failures in real time, and give appropriate feedback to pilots, according to our ambitious goal, providing them with reliable and rich human/machine interactions.

neurosciences,mathematical & computational biology
Alert and on task: decoding how mental alertness and workload influence maritime operators task performance using task network modeling

Shengyuan Yan,Waqas Ahmed,Hanan Ahmed Saeed

DOI: https://doi.org/10.1007/s10111-024-00769-3

2024-06-06

Cognition Technology & Work

Abstract:The rapid technology growth in the maritime defense sector demands efficient and effective human performance, particularly in roles involving navigation, tactical decision-making, and emergency responses. To accommodate this demand, our study aims to find the effects of the two most significant performance influencing factors i.e., mental alertness and workload on the performance of Electronic Support Measures (ESM) receiver operators in complex task environments of a surface combat ship. A Discrete Event Simulation model with the Task Network Modeling approach was developed in IPME software. Alertness, measured by the Karolinska Sleepiness Scale (KSS), was predicted for Crew Chiefs' schedules (4–8, 6–6, and 8–8) using the Three Process Model in FIPS software. The simulation integrated KSS predictions and VACP workload values, with 10 simulation runs, for each schedule, to assess the effects of mental alertness and workload on the total number of signals missed, the total number of signals logged, and percentage time at risk. The findings reveal that mental alertness variation due to different shift patterns in combination with mental workload significantly influence performance metrics, especially during night time operations, highlighting potential attention lapses and reduced efficiency. This comprehensive analysis provides valuable insights into the dynamics of shift work and task demands, aiming to enhance operational safety and performance in critical environments. The study's methodology and findings offer a foundation for further research and practical applications in various industries where managing mental alertness and workload is crucial for safety and efficient crew performance.

engineering, industrial,ergonomics
Validation of “alarm Bar” Alternative Interface for Digital Control Panel Design: A Preliminary Experimental Study

Xiaojun Wu,Xihui Yuan,Zhizhong Li,Fei Song,Wei Sang

DOI: https://doi.org/10.1016/j.ergon.2014.11.002

IF: 2.884

2015-01-01

International Journal of Industrial Ergonomics

Abstract:Properly designed alarm systems can benefit operators in conducting routine and emergency tasks. With the digitization of main control rooms, the alarm interface can be designed in various ways that are different from the traditional "alarm tile" style. An innovative alarm bar interface is proposed in this paper. A preliminary lab experiment was conducted to compare the traditional alarm tile and the new alarm bar interfaces. Sixteen university students were recruited to participate in the experiment, in which two emergency scenarios, Loss of Coolant Accident and Steam Generator Tube Rupture, were tested. The experiment task included two parts: alarm detection and identification. The subjective ratings supported the innovative alarm bar design for better parameter trend perception. The objective performance measures showed that the simpler design of the alarm tile interface better aided the alarm detection performance, whereas the alarm bar interface had almost the same alarm identification performance as the alarm tile interface.Relevance to industry: An alarm system is critical for a complex industrial system. The experimental results show that design evaluation is more complex than it may seem. Although it has not been proved to be overwhelmingly superior to the tile design, the alarm bar design shows promise for aiding operators and needs to be further validated. (C) 2014 Elsevier B.V. All rights reserved.
Survey on Advanced Alarm Strategies Based on Multivariate Analysis

Fan Yang,Cen Guo

DOI: https://doi.org/10.1109/adconip.2017.7983850

2017-01-01

Abstract:Alarm management, as a topic of significant interest in both academia and industry, has a lot of unsolved open problems. In particular, univariate monitoring techniques can only handle fundamental problems, such as alarm chattering and bad actors, and yet they cannot meet all the requirements in practice to provide accurate information and guide to operators. For this purpose, we need to incorporate techniques developed in related areas to build a multivariate framework, which is the novel and advanced alarm strategy. Existing and developing methods are summarized in this paper, especially data-based methods, including the strategies based on multivariate statistics, performance deterioration, pattern matching in alarm floods, fault propagation, and risk assessment. Each method utilizes different type of information and has its own scope of application. Such methods shed some light on the future development of advanced alarm management.
Multimodal Warnings Design for In-Vehicle Robots under Driving Safety Scenarios

Jianmin Wang,Chengji Wang,Yujia Liu,Tianyang Yue,Yuxi Wang,Fang You

DOI: https://doi.org/10.3390/s23010156

2022-12-23

Abstract:In case of dangerous driving, the in-vehicle robot can provide multimodal warnings to help the driver correct the wrong operation, so the impact of the warning signal itself on driving safety needs to be reduced. This study investigates the design of multimodal warnings for in-vehicle robots under driving safety warning scenarios. Based on transparency theory, this study addressed the content and timing of visual and auditory modality warning outputs and discussed the effects of different robot speech and facial expressions on driving safety. Two rounds of experiments were conducted on a driving simulator to collect vehicle data, subjective data, and behavioral data. The results showed that driving safety and workload were optimal when the robot was designed to use negative expressions for the visual modality during the comprehension (SAT 2) phase and speech at a rate of 345 words/minute for the auditory modality during the comprehension (SAT 2) and prediction (SAT 3) phases. The design guideline obtained from the study provides a reference for the interaction design of driver assistance systems with robots as the interface.
Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study

Ryan W Wohleber,Gerald Matthews,Jinchao Lin,James L Szalma,Gloria L Calhoun,Gregory J Funke,C-Y Peter Chiu,Heath A Ruff

DOI: https://doi.org/10.1177/0018720818799468

Abstract:Objective: This simulation study investigated factors influencing sustained performance and fatigue during operation of multiple Unmanned Aerial Systems (UAS). The study tested effects of time-on-task and automation reliability on accuracy in surveillance tasks and dependence on automation. It also investigated the role of trait and state individual difference factors. Background: Warm's resource model of vigilance has been highly influential in human factors, but further tests of its applicability to complex, real-world tasks requiring sustained attention are necessary. Multi-UAS operation differs from standard vigilance paradigms in that the operator must switch attention between multiple subtasks, with support from automation. Method: 131 participants performed surveillance tasks requiring signal discrimination and symbol counting with a multi-UAS simulation configured to impose low cognitive demands, for 2 hr. Automation reliability was manipulated between-groups. Five Factor Model personality traits were measured prior to performance. Subjective states were assessed with the Dundee Stress State Questionnaire. Results: Performance accuracy on the more demanding surveillance task showed a vigilance decrement, especially when automation reliability was low. Dependence on automation on this task declined over time. State but not trait factors predicted performance. High distress was associated with poorer performance in more demanding task conditions. Conclusions: Vigilance decrement may be an operational issue for multi-UAS surveillance missions. Warm's resource theory may require modification to incorporate changes in information processing and task strategy associated with multitasking in low-workload, fatiguing environments. Application: Interface design and operator evaluation for multi-UAS operations should address issues including motivation, stress, and sustaining attention to automation.
Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks

Chunying Qian,Shuang Liu,Xiaoru Wanyan,Chuanyan Feng,Zhen Li,Wenye Sun,Yihang Wang

DOI: https://doi.org/10.3390/aerospace11110897

IF: 2.66

2024-11-01

Aerospace

Abstract:Situation awareness (SA) discrimination is significant, allowing for the pilot to maintain task performance and ensure flight safety, especially during high-stress flight tasks. Although previous research has attempted to identify and classify SA, existing SA discrimination models are predominantly binary and rely on traditional machine learning methods with limited physiological modalities. The current study aimed to construct a triple-class SA discrimination model for pilots facing high-stress tasks. To achieve this, a flight simulation experiment under typical high-stress tasks was carried out and deep learning algorithms (multilayer perceptron (MLP) and the attention mechanism) were utilized. Specifically, eye-tracking (ET), heart rate variability (HRV), and electroencephalograph (EEG) modalities were chosen as the model's input features. Comparing the unimodal models, the results indicate that EEG modality surpasses ET and HRV modalities, and the attention mechanism structure has advantageous implications for processing the EEG modalities. The most superior model fused the three modalities at the decision level, with two MLP backbones and an attention mechanism backbone, achieving an accuracy of 83.41% and proving that the model performance would benefit from multimodal fusion. Thus, the current research established a triple-class SA discrimination model for pilots, laying the foundation for the real-time evaluation of SA under high-stress aerial operating conditions and providing a reference for intelligent cockpit design and dynamic human–machine function allocation.

engineering, aerospace
The research on awareness alerting modeling and algorithm of Enhanced Ground Proximity Warning System

Song Dong,Li Miao,Zhou Yuhan

DOI: https://doi.org/10.1109/iciea.2009.5138507

2009-05-01

Abstract:The purpose of Enhanced Ground Proximity Warning System (EGPWS) is to help prevent accidents caused by Controlled Flight into Terrain (CFIT) and it is also an airborne electronic equipment to guarantee flight safety. Among all functional modules in EGPWS, awareness alerting module plays a key role. Based on the design of terrain database and the awareness alerting modes, the mathematical model of awareness alerting module are brought forward. On the basis of terrain database we designed, three awareness alerting algorithms are deducted and their efficiencies are compared with each other. The research on EGPWS in the paper plays a significant role for EGPWS development.
Evaluating the Impact of Warning Modalities and False Alarms in Pedestrian Crossing Alert System

Hesham Alyamani,Yucheng Yang,David Noyce,Madhav Chitturi,Kassem Fawaz

2024-10-09

Abstract:With the steadily increasing pedestrian fatalities, pedestrian safety is a growing concern, especially in urban environments. Advanced Driver Assistance Systems (ADAS) have been developed to mitigate road user risks by predicting potential pedestrian crossings and issuing timely driver alerts. However, there is limited understanding of how drivers respond to different modalities of alerts, particularly in the presence of false alarms. In this study, we utilized a full-scale driving simulator to compare the effectiveness of different alert modalities, audio-visual (AV), visual-tactile (VT), and audio-visual-tactile (AVT), in alerting drivers to various pedestrian jaywalking events. Our findings reveal that, compared to no alerts, multimodal alerts significantly increased the number of vehicles stopped for pedestrians and the distance to pedestrians when stopped. However, the false alarms negatively impacted driver trust, with some drivers exhibiting excessive caution, alert fatigue and anxiety, even including one instance where a driver fully stopped when no pedestrian was present.

Human-Computer Interaction
A Team Cognition Measurement Method for Single Pilot Operations Human-Machine System Design

Min LiMiao WangGuoqing WangYong ChenKelin Zhonga School of Aeronautics and Astronautics,Shanghai Jiao Tong University,Shanghai,Chinab Commercial Aircraft Corporation of China Ltd,Shanghai,Chinac China COMAC Shanghai Aircraft Design and Research Institute,Shanghai,ChinaMin Li received the B.E. degree from Qingdao University of Technology,China,in 2016 and the M.E. degree from Shandong University,China,in 2019. He is currently pursuing the Ph.D. degree with Shanghai Jiao Tong University,China. His research interests include human-machine systems,human-automation interaction and human-systems integration.Miao Wang received the M.E. and Ph.D. degrees from Northwestern Polytechnical University in 2008 and 2013,respectively. He is currently an assistant research fellow with Shanghai Jiao Tong University,China. His research is focused on avionics system,data mining and safety.Guoqing Wang received the M.E. and Ph.D. degrees from Northwestern Polytechnical University,China,in 1984,and 1990,respectively. He is currently a distinguished professor with Shanghai Jiao Tong University,China. His research interests include system architecture and avionics system.Yong Chen is currently a chief engineer with Commercial Aircraft Corporation of China Ltd,Shanghai,China. His research interests include regional aircraft development,single pilot operations and remotely piloted operations.Kelin Zhong is currently a senior engineer with Commercial Aircraft Corporation of China Ltd,Shanghai,China. His research interests include regional aircraft development,civil aircraft health monitoring and management,and avionics system synthesis.

DOI: https://doi.org/10.1080/10447318.2024.2340028

IF: 4.92

2024-04-18

International Journal of Human-Computer Interaction

Abstract:Team cognition is an important indicator to reflect the trend of single pilot operation (SPO) human-machine system team performance. How to measure team cognition to explore different function allocation decisions before the implementation of prototypes or simulators has become a significant step in the early SPO human-machine system design. Therefore, this article proposed a team cognition measurement method based on the social network analysis (SNA) method, namely cognitive social network analysis (CSNA). The CSNA method firstly identified the nodes, edge directions and channel resource values of each task; secondly calculated the cognitive demands of each task based on multiple resource theory; thirdly summed the cognitive demands of the same task to construct the association matrix; and finally calculated global and nodal network metrics. The results of the study showed that (1) the CSNA method could identify design flaws of the initial SPO human-machine system; (2) the CSNA method increased the ability to identify the changes in both the cognitive demands of tasks and the overall workloads of human agents compared to the SNA method; (3) the CSNA method could help researchers make reasonable design suggestions to improve the team performance of the redesigned SPO human-machine system. The above results not only verify the feasibility of the CSNA method, but also show that the CSNA method is superior to the current SNA method.

computer science, cybernetics,ergonomics
User Centered Design (VII): From Automated Flight Deck to Intelligent Flight Deck

Wei Xu

DOI: https://doi.org/10.48550/arXiv.2111.05974

IF: 6.4588

2021-11-10

Human-Computer Interaction

Abstract:Driven by the "user-centered design" philosophy, this paper first outlines the human factors problems of the flight deck automation for large civil aircraft and the human factors research carried out based on the "human-centered automation" approach. This paper then reviews the previous initial human factors research on intelligent civil flight deck based on the "human-centered AI" approach and discusses the prospects for future human factors research. Based on our proposed human factors engineering model for intelligent human-computer interaction and the framework of joint cognitive eco-systems, this paper proposes an initial human factors solution for the single-pilot operations of large civil aircraft and presents preliminary suggestions for future human factors research.
Analysis of Human Factors in Typical Accident Tests of Certain Type Flight Simulator

Guanghua Xing,Yingjun Sun,Fajiang He,Pengcheng Wei,Shicheng Wu,Haojie Ren,Zhixiong Chen

DOI: https://doi.org/10.3390/su15032791

IF: 3.9

2023-02-03

Sustainability

Abstract:With the improvement of modern aviation equipment manufacturing technology, there are relatively few failures due to the unreliability of the aircraft. However, human factors which resulted in air crashes and unsafe events are raised. In this paper, for many typical accident scenarios of a particular plane, the flight simulation verifications of the pilot's workload and behavior are carried out on the certain transport category airplane, namely the six-degrees-of-freedom full-motion flight simulator. The subjective and physiological evaluation methods combine to analyze the human factors of pilots in the sudden typical accident scene during a flight mission. The study uses eye trackers, professional heart rate monitors, cameras, and other equipment to collect the pilot's physiological information during the flight mission, and allows the pilots to fill in the subjective evaluation scale, establishing a subjective and objective evaluation index system. Thus, the human factors of pilots in typical fault situations are analyzed. The analysis shows the combined personal and accurate evaluation method, with the test equipment and environment proposed by this paper being feasible for the human factor evaluation in the accident or incident of transport category airplanes. It will benefit aviation stakeholders in determining the proper action to decrease the workload to an acceptable level.

environmental sciences,environmental studies,green & sustainable science & technology
Auditory Hazard Notifications in Intelligent Cockpits: the Impacts on Driver Trust and Workload During Automated Driving

Yizi Su,Qingkun Li,Zhenyuan Wang,Wenjun Wang,Zeyuan Huang,Cuixia Ma

DOI: https://doi.org/10.1109/icac61394.2024.10718825

2024-01-01

Abstract:While automated vehicles are expected to enhance driving safety and travel experience, full driving automation is yet to be achieved. For partially automated vehicles, human drivers are still required to be in the loop regarding the driving task and be ready to intervene if necessary, bringing challenges regarding driver trust and workload. Intelligent cockpits are the platform of the interactions and collaborations between drivers and automated driving systems, in which suitable notifications are anticipated to enhance drivers’ trust and reduce their workload. However, there is still a lack of research on the impacts of auditory hazard notifications, which hinders the development of human-centered intelligent cockpits for automated vehicles. To this end, this study systematically explores the impact of auditory hazard notifications in intelligent cockpits on driver trust and workload during partially automated driving in urban road scenarios. Based on a 32-participant driving simulation experiment, it was demonstrated that auditory hazard notifications significantly reduce driver workload. Moreover, the provision of more information through notifications was found to improve driver trust in automated vehicles. The present study contributes to developing human-centered intelligent cockpits, thus improving the driving safety, user experience, and public acceptance of automated vehicles.

Exploration of multimodal alarms for civil aircraft flying task: A laboratory study

The Attention Aware System: A Human-Computer Interaction Interface in the Multi-Task Context

Aircraft human‐machine interaction assistant design: A novel multimodal data processing and application framework

Evaluation of Multimodal and Multi-Staged Alerting Strategies for Forward Collision Warning Systems

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

ALARMS: Alerting and Reasoning Management System for Next Generation Aircraft Hazards

An Activity Management System for Office Workers Using Multimodal Data

Integrating Ergonomics Into Safety Management: A Conceptual Risk Assessment Model for Tower Controllers at Multiple Altitudes

Classification of Electrophysiological Signatures With Explainable Artificial Intelligence: The Case of Alarm Detection in Flight Simulator

Alert and on task: decoding how mental alertness and workload influence maritime operators task performance using task network modeling

Validation of “alarm Bar” Alternative Interface for Digital Control Panel Design: A Preliminary Experimental Study

Survey on Advanced Alarm Strategies Based on Multivariate Analysis

Multimodal Warnings Design for In-Vehicle Robots under Driving Safety Scenarios

Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study

Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks

The research on awareness alerting modeling and algorithm of Enhanced Ground Proximity Warning System

Evaluating the Impact of Warning Modalities and False Alarms in Pedestrian Crossing Alert System

A Team Cognition Measurement Method for Single Pilot Operations Human-Machine System Design

User Centered Design (VII): From Automated Flight Deck to Intelligent Flight Deck

Analysis of Human Factors in Typical Accident Tests of Certain Type Flight Simulator

Auditory Hazard Notifications in Intelligent Cockpits: the Impacts on Driver Trust and Workload During Automated Driving