EEG-based performance-driven adaptive automated hazard alerting system in security surveillance support

Xiaoshan Zhou,Pin-Chao Liao

DOI: https://doi.org/10.3390/su15064812

2022-11-09

Abstract:Computer-vision technologies have emerged to assist security surveillance. However, automation alert/alarm systems often apply a low-beta threshold to avoid misses and generates excessive false alarms. This study proposed an adaptive hazard diagnosis and alarm system with adjustable alert threshold levels based on environmental scenarios and operator's hazard recognition performance. We recorded electroencephalogram (EEG) data during hazard recognition tasks. The linear ballistic accumulator model was used to decompose the response time into several psychological subcomponents, which were further estimated by a Markov chain Monte Carlo algorithm and compared among different types of hazardous scenarios. Participants were most cautious about falling hazards, followed by electricity hazards, and had the least conservative attitude toward structural hazards. Participants were classified into three performance-level subgroups using a latent profile analysis based on task accuracy. We applied the transfer learning paradigm to classify subgroups based on their time-frequency representations of EEG data. Additionally, two continual learning strategies were investigated to ensure a robust adaptation of the model to predict participants' performance levels in different hazardous scenarios. These findings can be leveraged in real-world brain-computer interface applications, which will provide human trust in automation and promote the successful implementation of alarm technologies.

Human-Computer Interaction

What problem does this paper attempt to address?

The paper attempts to address the issue of a decline in operator trust in alarm systems due to the large number of false alarms generated by automated alarm systems in security monitoring, which affects the effectiveness and safety of the system. Specifically, existing automated alarm systems typically set lower alarm thresholds to reduce missed alarms (e.g., worker injuries, structural collapses, etc.), which leads to a large number of false alarms. These false alarms not only increase the workload of operators but may also cause operators to experience a "cry wolf" effect, where they ignore or delay responding to alarms, thereby increasing the risk of accidents.

To solve this problem, the study proposes an adaptive automated diagnostic and alarm system based on electroencephalography (EEG). This system can dynamically adjust alarm thresholds according to the environmental scenario and the operator's performance in hazard recognition tasks, in order to improve operator trust in automation and the overall performance of the system. By using EEG signals to monitor the operator's cognitive state and combining it with continuous learning technology, the system can maintain robustness in different scenarios, thereby providing more reliable support in practical applications.