Analysis on pulse rate variability for pilot workload assessment based on wearable sensor

Yunbiao Wang,Chenyang Zhang,Chenglin Liu,Kun Liu,Fang Xu,Jixue Yuan,Chaozhe Jiang,Chuang Liu,Weiwei Cao

DOI: https://doi.org/10.1002/hfm.21053

2024-09-29

Human Factors and Ergonomics in Manufacturing & Service Industries

Abstract:Human Factors and Ergonomics in Manufacturing &Service Industries, EarlyView.

engineering, manufacturing,ergonomics

What problem does this paper attempt to address?

Synthesized Quantitative Assessment of Human Mental Fatigue with EEG and HRV

QP Han,L Wang,P Wang,BC Wen

DOI: https://doi.org/10.1117/12.664237

2005-01-01

Abstract:The electroencephalograph (EEG) signals and heart rate variable (HRV) signals, which are relative to human body mental stress, are analyzed with the nonlinear dynamics and chaos. Based on calculated three nonlinear parameters, a synthesized quantitative criterion is proposed to assess the body's mental fatigue states. Firstly, the HRV and α wave of EEG from original signals are extracted based on wavelet transform technique. Then, the Largest Lyapunov Exponents, Complexity and Approximate Entropy, are calculated for both HRV and α wave. The three nonlinear parameters reflect quantitatively human physiological activities and can be used to evaluate the mental workload degree. Based on the computation and statistical analysis of practical EEG and HRV data, a synthesized quantitative assessment criterion is induced for mental fatigues with three nonlinear parameters of the above two rhythms. For the known 10 measured data of EEG and HRV signals, the assessment results are obtained with the above laws for different metal fatigue states. To compare with the practical cases, the identification accuracy of mental fatigue or not is up to 100 percent. Furthermore, the accuracies of weak fatigue, middle fatigue and serious fatigue mental workload are all relatively higher; they are about 94.44, 88.89, and 83.33 percent, respectively.
A comprehensive prediction and evaluation method of pilot workload

Chuanyan Feng,Xiaoru Wanyan,Kun Yang,Damin Zhuang,Xu Wu

DOI: https://doi.org/10.3233/THC-174201

Abstract:Background: The prediction and evaluation of pilot workload is a key problem in human factor airworthiness of cockpit. Objective: A pilot traffic pattern task was designed in a flight simulation environment in order to carry out the pilot workload prediction and improve the evaluation method. Methods: The prediction of typical flight subtasks and dynamic workloads (cruise, approach, and landing) were built up based on multiple resource theory, and a favorable validity was achieved by the correlation analysis verification between sensitive physiological data and the predicted value. Results: Statistical analysis indicated that eye movement indices (fixation frequency, mean fixation time, saccade frequency, mean saccade time, and mean pupil diameter), Electrocardiogram indices (mean normal-to-normal interval and the ratio between low frequency and sum of low frequency and high frequency), and Electrodermal Activity indices (mean tonic and mean phasic) were all sensitive to typical workloads of subjects. Conclusion: A multinominal logistic regression model based on combination of physiological indices (fixation frequency, mean normal-to-normal interval, the ratio between low frequency and sum of low frequency and high frequency, and mean tonic) was constructed, and the discriminate accuracy was comparatively ideal with a rate of 84.85%.
Mental workload recognition using ECG and machine learning in simulated flight tasks

Zebin Jiang,Ke Zhang,Kuijun Wu,Jie Xu,Xinyan Li,Yu Sun,Xianliang Ge,Ming Mao

DOI: https://doi.org/10.1109/IAEAC54830.2022.9930029

2022-01-01

Abstract:Effective mental workload recognition is of great significance for improving task performance and reducing accidents. Although prior research has achieved approximately 95% accuracy using electroencephalography (EEG), it is difficult to transplant into actual task scenarios due to the low portability of the device. Here, we introduce a mental workload recognition solution to give consideration to high recognition accuracy and portability. Heart rate variability (HRV) was extracted from the electrocardiogram (ECG) signals of 26 participants during simulated flight tasks, and the sensitive features were screened out using the generalized linear mixed model. Then, the three mental workload levels were classified and evaluated in combination with the machine learning method. Our solution achieved an accuracy of 98% for subject-independent mental workload recognition.
Detecting and Predicting Pilot Mental Workload Using Heart Rate Variability: A Systematic Review

Peizheng Wang,Robert Houghton,Arnab Majumdar

DOI: https://doi.org/10.3390/s24123723

IF: 3.9

2024-06-08

Sensors

Abstract:Measuring pilot mental workload (MWL) is crucial for enhancing aviation safety. However, MWL is a multi-dimensional construct that could be affected by multiple factors. Particularly, in the context of a more automated cockpit setting, the traditional methods of assessing pilot MWL may face challenges. Heart rate variability (HRV) has emerged as a potential tool for detecting pilot MWL during real-flight operations. This review aims to investigate the relationship between HRV and pilot MWL and to assess the performance of machine-learning-based MWL detection systems using HRV parameters. A total of 29 relevant papers were extracted from three databases for review based on rigorous eligibility criteria. We observed significant variability across the reviewed studies, including study designs and measurement methods, as well as machine-learning techniques. Inconsistent results were observed regarding the differences in HRV measures between pilots under varying levels of MWL. Furthermore, for studies that developed HRV-based MWL detection systems, we examined the diverse model settings and discovered that several advanced techniques could be used to address specific challenges. This review serves as a practical guide for researchers and practitioners who are interested in employing HRV indicators for evaluating MWL and wish to incorporate cutting-edge techniques into their MWL measurement approaches.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical
A Forecasting Framework for Predicting Perceived Fatigue: Using Time Series Methods to Forecast Ratings of Perceived Exertion with Features from Wearable Sensors

Sahand Hajifar,Hongyue Sun,Fadel M. Megahed,L. Allison Jones-Farmer,Ehsan Rashedi,Lora A. Cavuoto

DOI: https://doi.org/10.1016/j.apergo.2020.103262

2021-01-01

Abstract:Advancements in sensing and network technologies have increased the amount of data being collected to monitor the worker conditions. In this study, we consider the use of time series methods to forecast physical fatigue using subjective ratings of perceived exertion (RPE) and gait data from wearable sensors captured during a simulated in-lab manual material handling task (Lab Study 1) and a fatiguing squatting with intermittent walking cycle (Lab Study 2). To determine whether time series models can accurately forecast individual response and for how many time periods ahead, five models were compared: naïve method, autoregression (AR), autoregressive integrated moving average (ARIMA), vector autoregression (VAR), and the vector error correction model (VECM). For forecasts of three or more time periods ahead, the VECM model that incorporates historical RPE and wearable sensor data outperformed the other models with median mean absolute error (MAE) <1.24 and median MAE <1.22 across all participants for Lab Study 1 and Lab Study 2, respectively. These results suggest that wearable sensor data can support forecasting a worker's condition and the forecasts obtained are as good as current state-of-the-art models using multiple sensors for current time prediction.
Classifying Tasks Performed by Electrical Line Workers Using a Wrist-Worn Sensor: A Data Analytic Approach

Saeb Ragani Lamooki,Sahand Hajifar,Jacqueline Hannan,Hongyue Sun,Fadel Megahed,Lora Cavuoto

DOI: https://doi.org/10.1371/journal.pone.0261765

IF: 3.7

2022-01-01

PLoS ONE

Abstract:Electrical line workers (ELWs) experience harsh environments, characterized by long shifts, remote operations, and potentially risky tasks. Wearables present an opportunity for unobtrusive monitoring of productivity and safety. A prerequisite to monitoring is the automated identification of the tasks being performed. Human activity recognition has been widely used for classification for activities of daily living. However, the literature is limited for electrical line maintenance/repair tasks due to task variety and complexity. We investigated how features can be engineered from a single wrist-worn accelerometer for the purpose of classifying ELW tasks. Specifically, three classifiers were investigated across three feature sets (time, frequency, and time-frequency) and two window lengths (4 and 10 seconds) to identify ten common ELW tasks. Based on data from 37 participants in a lab environment, two application scenarios were evaluated: (a) intra-subject, where individualized models were trained and deployed for each worker; and (b) inter-subject, where data was pooled to train a general model that can be deployed for new workers. Accuracies ≥ 93% were achieved for both scenarios, and increased to ≥96% with 10-second windows. Overall and class-specific feature importance were computed, and the impact of those features on the obtained predictions were explained. This work will contribute to the future risk mitigation of ELWs using wearables.
Evaluation of a Strapless Heart Rate Monitor During Simulated Flight Tasks

Zhen Wang,Shan Fu

DOI: https://doi.org/10.1080/15459624.2015.1101121

2015-01-01

Journal of Occupational and Environmental Hygiene

Abstract:Pilots are under high task demands during flight. Monitoring pilot's physiological status is very important in the evaluation of pilot's workload and flight safety. Recently, physiological status monitor (PSM) has been embedded into a watch that can be used without a conventional chest strap. This makes it possible to unobtrusively monitor, log and transmit pilot's physiological measurements such as heart rate (HR) during flight tasks. The purpose of this study is to validate HR recorded by a strapless heart rate watch against criterion ECG-derived HR. Ten commercial pilots (mean +/- SD : age: 39.1 +/- 7.8years; total flight hours 7173.2 +/- 5270.9hr) performed three routinely trained flight tasks in a full flight simulator: wind shear go-around (WG), takeoff and climb (TC), and hydraulic failure (HF). For all tasks combined (overall) and for each task, differences between the heart rate watch measurements and the criterion data were small (mean difference [95% CI]: overall: -0.71beats/min [-0.85, -0.57]; WG: -0.90beats/min [-1.15, -0.65]; TC: -0.69beats/min [-0.98, -0.40]; HF: -0.61beats/min [-0.80, -0.42]). There were high correlations between the heart rate watch measurements and the ECG-derived HR for all tasks (r 0.97, SEE < 3). Bland-Altman plots also show high agreements between the watch measurements and the criterion HR. These results suggest that the strapless heart rate watch provides valid measurements of HR during simulated flight tasks and could be a useful tool for pilot workload evaluation.
Identification of Pilots' Fatigue Status Based on Electrocardiogram Signals

Ting Pan,Haibo Wang,Haiqing Si,Yao Li,Lei Shang

DOI: https://doi.org/10.3390/s21093003

2021-04-25

Abstract:Fatigue is an important factor affecting modern flight safety. It can easily lead to a decline in pilots' operational ability, misjudgments, and flight illusions. Moreover, it can even trigger serious flight accidents. In this paper, a wearable wireless physiological device was used to obtain pilots' electrocardiogram (ECG) data in a simulated flight experiment, and 1440 effective samples were determined. The Friedman test was adopted to select the characteristic indexes that reflect the fatigue state of the pilot from the time domain, frequency domain, and non-linear characteristics of the effective samples. Furthermore, the variation rules of the characteristic indexes were analyzed. Principal component analysis (PCA) was utilized to extract the features of the selected feature indexes, and the feature parameter set representing the fatigue state of the pilot was established. For the study on pilots' fatigue state identification, the feature parameter set was used as the input of the learning vector quantization (LVQ) algorithm to train the pilots' fatigue state identification model. Results show that the recognition accuracy of the LVQ model reached 81.94%, which is 12.84% and 9.02% higher than that of traditional back propagation neural network (BPNN) and support vector machine (SVM) model, respectively. The identification model based on the LVQ established in this paper is suitable for identifying pilots' fatigue states. This is of great practical significance to reduce flight accidents caused by pilot fatigue, thus providing a theoretical foundation for pilot fatigue risk management and the development of intelligent aircraft autopilot systems.
Detection of mental fatigue state using heart rate variability and eye metrics during simulated flight

Hao Qin,Xiaozhou Zhou,Xuhan Ou,Yue Liu,Chenqi Xue

DOI: https://doi.org/10.1002/hfm.20927

2021-06-24

Abstract:<p>Pilot mental fatigue is a growing concern in the aviation field due to its significant contributions to human errors and aviation accidents. Long work hours, sleep loss, circadian rhythm disruption, and workload are well-known reasons, but there is a need to accurately detect pilot mental fatigue to improve aviation safety. However, due to the highly restricted cockpit environment and the complex nature of mental fatigue, feasible in-flight detection remains under-investigated. The objective of this study is to define a promising approach for mental fatigue detection based on psychophysiological measurements in flying-relevant environments. Eleven participants engaged in a simulated flight experiment, where several conventional heart rate variability (HRV) and ocular indices were examined to study their relevance to mental fatigue. Additionally, a Toeplitz Inverse Covariance-Based Clustering (TICC) method was performed to determine the ground truth, after which supervised machine learning was adopted to enable automated mental fatigue detection using HRV and eye metrics. Results showed that HRV and eye metrics were sensitive to the mental fatigue induced by prolonged flight-relevant tasks. The TICC method helped determine the ground truth for mental fatigue and identify its three distinct levels. Furthermore, a supervised learning-based detection of mental fatigue was achieved using a support vector machine with the greatest detection accuracy of 91.8%. The findings and methodology of this study provide new insights into the fatigue countermeasures in restricted cockpit environment and lay the groundwork for further explorations into the mental fatigue induced by prolonged flight missions.</p>

engineering, manufacturing,ergonomics
Multi-domain analysis of ultra-short-term HRV for breathing pattern classification in wearable health devices

Puneet Arya,Mandeep Singh,M. D. Singh

DOI: https://doi.org/10.1186/s13634-024-01194-4

2024-12-03

EURASIP Journal on Advances in Signal Processing

Abstract:This research paper introduces an innovative approach to classify heart rate variability (HRV) time series into paced and spontaneous breathing patterns to reflect changes in the autonomic nervous system. This type of classification is beneficial in wearable devices for stress/relaxation level detection and in deciding therapeutic interventions. The "Multi-Domain Approach" methodology integrates three different techniques: standard HRV features, fuzzy recurrence plot (FRP)-based FRP_GLCM, and empirical mode decomposition-based IMF_FRP_GLCM. The study concentrates on analyzing HRV time series within shorter data segments, aligning with the requirements of contemporary wearable health devices and biofeedback systems. HRV data collected during spontaneous and slow-paced breathing were analyzed across data segments of 5, 4, 3, 2, and 1 min, incorporating feature selection and reduction methods. Results demonstrated that standard HRV features yielded optimal performance for 5-min segments, achieving an average accuracy of 90%. Interestingly, IMF_FRP features achieved comparable accuracy even for 1-min segments. As segment duration decreased, standard HRV feature accuracy declined while IMF_FRP accuracy stayed intact, eventually matching 5-min segment accuracy levels. The study underscores the surging demand for shorter data segment HRV analysis, driven by advancements in wearable smart watches technology and mobile applications for monitoring health and managing stress.

engineering, electrical & electronic
Determining Cognitive Workload Using Physiological Measurements: Pupillometry and Heart-Rate Variability

Xinyue Ma,Radmehr Monfared,Rebecca Grant,Yee Mey Goh,Ma,Monfared,Grant,Goh

DOI: https://doi.org/10.3390/s24062010

IF: 3.9

2024-03-22

Sensors

Abstract:The adoption of Industry 4.0 technologies in manufacturing systems has accelerated in recent years, with a shift towards understanding operators' well-being and resilience within the context of creating a human-centric manufacturing environment. In addition to measuring physical workload, monitoring operators' cognitive workload is becoming a key element in maintaining a healthy and high-performing working environment in future digitalized manufacturing systems. The current approaches to the measurement of cognitive workload may be inadequate when human operators are faced with a series of new digitalized technologies, where their impact on operators' mental workload and performance needs to be better understood. Therefore, a new method for measuring and determining the cognitive workload is required. Here, we propose a new method for determining cognitive-workload indices in a human-centric environment. The approach provides a method to define and verify the relationships between the factors of task complexity, cognitive workload, operators' level of expertise, and indirectly, the operator performance level in a highly digitalized manufacturing environment. Our strategy is tested in a series of experiments where operators perform assembly tasks on a Wankel Engine block. The physiological signals from heart-rate variability and pupillometry bio-markers of 17 operators were captured and analysed using eye-tracking and electrocardiogram sensors. The experimental results demonstrate statistically significant differences in both cardiac and pupillometry-based cognitive load indices across the four task complexity levels (rest, low, medium, and high). Notably, these developed indices also provide better indications of cognitive load responding to changes in complexity compared to other measures. Additionally, while experts appear to exhibit lower cognitive loads across all complexity levels, further analysis is required to confirm statistically significant differences. In conclusion, the results from both measurement sensors are found to be compatible and in support of the proposed new approach. Our strategy should be useful for designing and optimizing workplace environments based on the cognitive load experienced by operators.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Development and validation of an assessment index for quantifying cognitive task load in pilots under simulated flight conditions using heart rate variability and principal component analysis

Jinghua Yang,Mengjun Tang,Lin Cong,Jicheng Sun,Dalong Guo,Taihui Zhang,Kaiwen Xiong,Li Wang,Shan Cheng,Jin Ma,Wendong Hu

DOI: https://doi.org/10.1080/00140139.2023.2229075

IF: 2.5612

2023-07-07

Ergonomics

Abstract:To investigate whether high cognitive task load (CTL) for aircraft pilots can be identified by analysing heart-rate variability, electrocardiograms were recorded while cadet pilots ( n = 68) performed the plane tracking, anti-gravity pedalling, and reaction tasks during simulated flight missions. Data for standard electrocardiogram parameters were extracted from the R–R-interval series. In the research phase, low frequency power (LF), high frequency power (HF), normalised HF, and LF/HF differed significantly between high and low CTL conditions ( p < .05 for all). A principal component analysis identified three components contributing 90.62% of cumulative heart-rate variance. These principal components were incorporated into a composite index. Validation in a separate group of cadet pilots ( n = 139) under similar conditions showed that the index value significantly increased with increasing CTL ( p < .05). The heart-rate variability index can be used to objectively identify high CTL flight conditions. Practitioner summary: We used principal component analysis of electrocardiogram data to construct a composite index for identifying high cognitive task load in pilots during simulated flight. We validated the index in a separate group of pilots under similar conditions. The index can be used to improve cadet training and flight safety. Abbreviations : ANOVA: a one-way analysis of variance; AP: anti-gravity pedaling task; CTL: cognitive task load; ECG: electrocardiograms; HR: heart rate; HRV: heart-rate variability; HRVI: heart-rate variability index; PT: plane-tracking task; RMSSD: root-mean square of differences between consecutive R–R intervals; RT: reaction task; SDNN: standard deviation of R-R intervals; HF: high frequency power; HFnu: normalized HF; LF: low frequency power; LFnu: normalized LF; PCA: principal component analysis.

engineering, industrial,ergonomics,psychology, applied
Wearable network for multilevel physical fatigue prediction in manufacturing workers

Payal Mohapatra,Vasudev Aravind,Marisa Bisram,Young-Joong Lee,Hyoyoung Jeong,Katherine Jinkins,Richard Gardner,Jill Streamer,Brent Bowers,Lora Cavuoto,Anthony Banks,Shuai Xu,John Rogers,Jian Cao,Qi Zhu,Ping Guo

DOI: https://doi.org/10.1093/pnasnexus/pgae421

2024-10-15

PNAS Nexus

Abstract:Manufacturing workers face prolonged strenuous physical activities, impacting both financial aspects and their health due to work-related fatigue. Continuously monitoring physical fatigue and providing meaningful feedback is crucial to mitigating human and monetary losses in manufacturing workplaces. This study introduces a novel application of multimodal wearable sensors and machine learning techniques to quantify physical fatigue and tackle the challenges of real-time monitoring on the factory floor. Unlike past studies that view fatigue as a dichotomous variable, our central formulation revolves around the ability to predict multilevel fatigue, providing a more nuanced understanding of the subject's physical state. Our multimodal sensing framework is designed for continuous monitoring of vital signs, including heart rate, heart rate variability, skin temperature, and more, as well as locomotive signs by employing inertial motion units strategically placed at six locations on the upper body. This comprehensive sensor placement allows us to capture detailed data from both the torso and arms, surpassing the capabilities of single-point data collection methods. We developed an innovative asymmetric loss function for our machine learning model, which enhances prediction accuracy for numerical fatigue levels and supports real-time inference. We collected data on 43 subjects following an authentic manufacturing protocol and logged their self-reported fatigue. Based on the analysis, we provide insights into our multilevel fatigue monitoring system and discuss results from an in-the-wild evaluation of actual operators on the factory floor. This study demonstrates our system's practical applicability and contributes a valuable open-access database for future research.
Wearable Device-Based Real-Time Monitoring of Physiological Signals: Evaluating Cognitive Load Across Different Tasks

Ling He,Yanxin Chen,Wenqi Wang,Shuting He,Xiaoqiang Hu

2024-07-03

Abstract:This study employs cutting-edge wearable monitoring technology to conduct high-precision, high-temporal-resolution (1-second interval) cognitive load assessment on electroencephalogram (EEG) data from the FP1 channel and heart rate variability (HRV) data of secondary vocational students. By jointly analyzing these two critical physiological indicators, the research delves into their application value in assessing cognitive load among secondary vocational students and their utility across various tasks. The study designed two experiments to validate the efficacy of the proposed approach: Initially, a random forest classification model, developed using the N-BACK task, enabled the precise decoding of physiological signal characteristics in secondary vocational students under different levels of cognitive load, achieving a classification accuracy of 97%. Subsequently, this classification model was applied in a cross-task experiment involving the National Computer Rank Examination (Level-1), demonstrating the method's significant applicability and cross-task transferability in diverse learning contexts. Conducted with high portability, this research holds substantial theoretical and practical significance for optimizing teaching resource allocation in secondary vocational education, as well as for cognitive load assessment methods and monitoring. Currently, the research findings are undergoing trial implementation in the school.

Human-Computer Interaction,Artificial Intelligence,Computers and Society
Quantitative analysis of heart rate variability parameter and mental stress index

Jiasai Luo,Guo Zhang,Yiwei Su,Yi Lu,Yu Pang,Yuanfa Wang,Huiqian Wang,Kunfeng Cui,Yuhao Jiang,Lisha Zhong,Zhiwei Huang

DOI: https://doi.org/10.3389/fcvm.2022.930745

IF: 3.6

2022-07-25

Frontiers in Cardiovascular Medicine

Abstract:Background: Cardiovascular disease not only occurs in the elderly but also tends to become a common social health problem. Considering the fast pace of modern life, quantified heart rate variability (HRV) indicators combined with the convenience of wearable devices are of great significance for intelligent telemedicine. To quantify the changes in human mental state, this article proposes an improved differential threshold algorithm for R-wave detection and recognition of electrocardiogram (ECG) signals. Methods: HRV is a specific quantitative indicator of autonomic nerve regulation of the heart. The recognition rate is increased by improving the starting position of R wave and the time-window function of the traditional differential threshold method. The experimental platform is a wearable sign monitoring system constructed based on body area networks (BAN) technology. Analytic hierarchy process (AHP) is used to construct the mental stress assessment model, the weight judgment matrix is constructed according to the influence degree of HRV analysis parameters on mental stress, and the consistency check is carried out to obtain the weight value of the corresponding HRV analysis parameters. Results: Experimental results show that the recognition rate of R wave of real-time 5 min ECG data collected by this algorithm is >99%. The comprehensive index of HRV based on weight matrix can greatly reduce the deviation caused by the measurement error of each parameter. Compared with traditional characteristic wave recognition algorithms, the proposed algorithm simplifies the process, has high real-time performance, and is suitable for wearable analysis devices with low-configuration requirements. Conclusion: Our algorithm can describe the mental stress of the body quantitatively and meet the requirements of application demonstration.

cardiac & cardiovascular systems
Comparison Analysis of Different Time-Scale Heart Rate Variability Signals for Mental Workload Assessment in Human-Robot Interaction

Shiliang Shao,Ting Wang,Yawei Li,Chunhe Song,Yihan Jiang,Chen Yao

DOI: https://doi.org/10.1155/2021/8371637

2021-10-06

Wireless Communications and Mobile Computing

Abstract:Excessive mental workload affects human health and may lead to accidents. This study is motivated by the need to assess mental workload in the process of human-robot interaction, in particular, when the robot performs a dangerous task. In this study, the use of heart rate variability (HRV) signals with different time scales in mental workload assessment was analyzed. A humanoid dual-arm robot that can perform dangerous work was used as a human-robot interaction object. Electrocardiogram (ECG) signals of six subjects were collected in two states: during the task and in a relaxed state. Multiple time-scale (1, 3, and 5 min) HRV signals were extracted from ECG signals. Then, we extracted the same linear and nonlinear features from the HRV signals at different time scales. The performance of machine learning algorithms using the different time-scale HRV signals obtained during the human-robot interaction was evaluated. The results show that for the per-subject case with a 3 min HRV signal length, the K -nearest neighbor classifier achieved the best mental workload classification performance. For the cross-subject case with a 5 min time-scale signal length, the gentle boost classifier achieved the best mental workload classification accuracy. This study provides a novel research idea for using HRV signals to measure mental workload during human-robot interaction.

computer science, information systems,telecommunications,engineering, electrical & electronic
Heart Rate Variability of Pilots and Passenger Unders Impact and Vibration Circumstances

Meng ZOU,Shucai XU,Jinhuan ZHANG,Jialiang RU,Shilin HUANG

DOI: https://doi.org/10.3969/j.issn.1676-8484.2010.04.005

2010-01-01

Abstract:The influence of impact and vibration on the personnel heart rate variability(HRV) was studied using biomedical monitoring equipment to protect the driver and passenger security.Impact tests show that the heart rate increases by 1.4% to 44.3% with decreasing rMSSD(root mean square successive difference),LF(low frequeuce),and HF(high frequence),but increasing LF/HF.Vibration tests show that the average heart rates of the driver and co-driver increase by 12.6% and 4.8% after one hour's driving,with the rMSSD,LF,and HF being decreased,but the LF/HF being increased.The results indicate that the activities of the sympathetic nerve and pneumogastric nerve are weakened,and the psychological tensity trend is enhanced with increasing age and responsibility.Therefore,the HRV can be used to analyze the tension,fatigue as well as security monitoring,with broad prospects for application and research.
Assessing Workplace Stress Among Nurses Using Heart Rate Variability Analysis With Wearable ECG Device–A Pilot Study

Xinxia Li,Weiwei Zhu,Xiaofan Sui,Aizhi Zhang,Lijie Chi,Lu Lv

DOI: https://doi.org/10.3389/fpubh.2021.810577

IF: 5.2

2022-02-09

Frontiers in Public Health

Abstract:This study aims to measure workplace stress of nurses using heart rate variability (HRV) analysis based on data derived from wearable ECG heart rate monitors. The study population consists of 17 nurses at a major public hospital in China. Data was collected from 7 DON nurses (department of neurosurgery; all females; mean age: 31.43 ± 4.50), and 9 ICU nurses (intensive care unit; 8 females and 1 male; mean age: 31.33 ± 5.43). Each participant was asked to wear a wireless ECG heart rate monitor to measure stress level during work, and to complete the Chinese Nurses Stress Response Scale (CNSRS) after work as subjective response criteria. Demographic information, body posture, heart rate, R-R intervals (RRI), low frequency components (LF) and high frequency components (HF) were collected. LF%, LnHF and the squared root of the mean squared differences of successive NN intervals (RMSSD) based on HRV analysis were used to estimate the stress level of nurses. DON nurses reported a higher LF%, lower LnHF and lower RMSSD than ICU nurses. Work shifts were shown to have significant effects on LF%, LnHF and RMSSD respectively, with nurses in long shifts and night shifts reported high stress levels. Higher LF%, lower LnHF and lower RMSSD were found during work shift. Posture analysis revealed negative correlations with LnHF and RMSSD in walking and standing/sitting positions, and a significant negative correlation with LF% in lying-down position. Nurses with higher LF% reported higher CNSRS scores in all subscales, whereas nurses with lower LnHF or RMSSD reported higher CNSRS scores in social phobia and fatigue subscales. The results of this study support the idea that HRV can be used to investigate workplace stress among nurses under real work condition, and can serve as a preventive measure for identifying stress-related illnesses among nurses.

public, environmental & occupational health
Physiological workload assessment for highly flexible fine-motory assembly tasks using machine learning

Markus Brillinger,Samuel Manfredi,Dominik Leder,Martin Bloder,Markus Jäger,Konrad Diwold,Amer Kajmakovic,Michael Haslgrübler,Rudolf Pichler,Martin Brunner,Stefan Mehr,Viktorijo Malisa

DOI: https://doi.org/10.1016/j.cie.2023.109859

IF: 7.18

2024-01-05

Computers & Industrial Engineering

Abstract:In assembly of small-volume products, tasks are still frequently executed manually. However, the lead times foreseen for these tasks, often do not take into account the actual capabilities of the employees, which in turn leads to increased workload and the associated stress among the employees. This paper investigates how a commercially available wearable low-cost sensor and two machine learning algorithms can be applied to measure and evaluate heart rate, heart rate variability and respiration rate to establish a relationship with workload. The investigated algorithms, namely Random Forest and K-Nearest-Neighbours are able to distinguish between tasks phases and rest phases as well as between easy and difficult tasks executed by the employee, which is the main novelty of this paper.

computer science, interdisciplinary applications,engineering, industrial
Research of HRV as a Measure of Mental Workload in Human and Dual-Arm Robot Interaction

Shiliang Shao,Ting Wang,Yongliang Wang,Yun Su,Chunhe Song,Chen Yao

DOI: https://doi.org/10.3390/electronics9122174

IF: 2.9

2020-12-17

Electronics

Abstract:Robots instead of humans work in unstructured environments, expanding the scope of human work. The interactions between humans and robots are indirect through operating terminals. The mental workloads of human increase with the lack of direct perception to the real scenes. Thus, mental workload assessment is important, which could effectively avoid serious accidents caused by mental overloading. In this paper, the operating object is a dual-arm robot. The classification of operator’s mental workload is studied by using the heart rate variability (HRV) signal. First, two kinds of electrocardiogram (ECG) signals are collected from six subjects who performed tasks or maintained a relaxed state. Then, HRV data is obtained from ECG signals and 20 kinds of HRV features are extracted. Last, six different classifications are used for mental workload classification. Using each subject’s HRV signal to train the model, the subject’s mental workload is classified. Average classification accuracy of 98.77% is obtained using the K-Nearest Neighbor (KNN) method. By using the HRV signal of five subjects for training and that of one subject for testing with the Gentle Boost (GB) method, the highest average classification accuracy (80.56%) is obtained. This study has implications for the analysis of HRV signals characteristic of mental workload in different subjects, which could improve operators’ well-being and safety in the human-robot interaction process.

engineering, electrical & electronic,computer science, information systems,physics, applied

Analysis on pulse rate variability for pilot workload assessment based on wearable sensor

Synthesized Quantitative Assessment of Human Mental Fatigue with EEG and HRV

A comprehensive prediction and evaluation method of pilot workload

Mental workload recognition using ECG and machine learning in simulated flight tasks

Detecting and Predicting Pilot Mental Workload Using Heart Rate Variability: A Systematic Review

A Forecasting Framework for Predicting Perceived Fatigue: Using Time Series Methods to Forecast Ratings of Perceived Exertion with Features from Wearable Sensors

Classifying Tasks Performed by Electrical Line Workers Using a Wrist-Worn Sensor: A Data Analytic Approach

Evaluation of a Strapless Heart Rate Monitor During Simulated Flight Tasks

Identification of Pilots' Fatigue Status Based on Electrocardiogram Signals

Detection of mental fatigue state using heart rate variability and eye metrics during simulated flight

Multi-domain analysis of ultra-short-term HRV for breathing pattern classification in wearable health devices

Determining Cognitive Workload Using Physiological Measurements: Pupillometry and Heart-Rate Variability

Development and validation of an assessment index for quantifying cognitive task load in pilots under simulated flight conditions using heart rate variability and principal component analysis

Wearable network for multilevel physical fatigue prediction in manufacturing workers

Wearable Device-Based Real-Time Monitoring of Physiological Signals: Evaluating Cognitive Load Across Different Tasks

Quantitative analysis of heart rate variability parameter and mental stress index

Comparison Analysis of Different Time-Scale Heart Rate Variability Signals for Mental Workload Assessment in Human-Robot Interaction

Heart Rate Variability of Pilots and Passenger Unders Impact and Vibration Circumstances

Assessing Workplace Stress Among Nurses Using Heart Rate Variability Analysis With Wearable ECG Device–A Pilot Study

Physiological workload assessment for highly flexible fine-motory assembly tasks using machine learning

Research of HRV as a Measure of Mental Workload in Human and Dual-Arm Robot Interaction