CALM: Cognitive Assessment using Light-insensitive Model

Akhil Meethal,Anita Paas,Nerea Urrestilla Anguiozar,David St-Onge

2024-09-06

Abstract:The demand for cognitive load assessment with low-cost easy-to-use equipment is increasing, with applications ranging from safety-critical industries to entertainment. Though pupillometry is an attractive solution for cognitive load estimation in such applications, its sensitivity to light makes it less robust under varying lighting conditions. Multimodal data acquisition provides a viable alternative, where pupillometry is combined with electrocardiography (ECG) or electroencephalography (EEG). In this work, we study the sensitivity of pupillometry-based cognitive load estimation to light. By collecting heart rate variability (HRV) data during the same experimental sessions, we analyze how the multimodal data reduces this sensitivity and increases robustness to light conditions. In addition to this, we compared the performance in multimodal settings using the HRV data obtained from low-cost fitness-grade equipment to that from clinical-grade equipment by synchronously collecting data from both devices for all task conditions. Our results indicate that multimodal data improves the robustness of cognitive load estimation under changes in light conditions and improves the accuracy by more than 20% points over assessment based on pupillometry alone. In addition to that, the fitness grade device is observed to be a potential alternative to the clinical grade one, even in controlled laboratory settings.

Human-Computer Interaction

What problem does this paper attempt to address?

The problems that this paper attempts to solve are:

1. **The impact of changes in light conditions on the performance of Pupillometry - based Cognitive Load Estimation (CLE)**:
- The paper explores how the performance of cognitive load assessment using only pupillometry technology is affected under different lighting conditions. The study found that when the training set data comes from a bright environment and the test set data comes from a dark environment, the performance of the pupillometry - based model drops significantly, indicating that changes in lighting conditions have a large impact on the performance of the model.

2. **The role of multi - modal data (combining heart rate variability HRV and pupillometry) in improving the reliability and robustness of cognitive load assessment**:
- In order to reduce the impact of changes in lighting conditions on pupillometry technology, the paper proposes a multi - modal method, that is, using pupillometry and heart rate variability (HRV) data simultaneously to assess cognitive load. The research shows that the multi - modal method significantly improves the performance of the model, especially in the case of changes in lighting conditions, with a performance improvement of more than 20 percentage points.

3. **The performance comparison between low - cost fitness - level devices and clinical - level devices in a multi - modal setting**:
- The paper also compares the performance of low - cost fitness - level devices (such as Polar H10) and clinical - level devices (such as Biopac MP35) in obtaining HRV data in a multi - modal setting. The results show that in a controlled laboratory environment, even if the participants may move slightly, the performance of fitness - level devices is comparable to that of clinical - level devices, and even better in some cases.

Through the above research, the paper aims to provide a more reliable and robust method for cognitive load assessment, especially in practical application scenarios with large changes in lighting conditions. At the same time, the study also explores the application potential of low - cost devices in a multi - modal setting, providing an important reference for future research and practical applications.