Abstract:In today's society, our cognition is constantly influenced by information intake, attention switching, and task interruptions. This increases the difficulty of a given task, adding to the existing workload and leading to compromised cognitive performances. The human body expresses the use of cognitive resources through physiological responses when confronted with a plethora of cognitive workload. This temporarily mobilizes additional resources to deal with the workload at the cost of accelerated mental exhaustion. We predict that recent developments in physiological sensing will increasingly create user interfaces that are aware of the user's cognitive capacities, hence able to intervene when high or low states of cognitive workload are detected. Subsequently, we investigate suitable feedback modalities in a user-centric design process which are desirable for cognitive assistance. We then investigate different physiological sensing modalities to enable suitable real-time assessments of cognitive workload. We provide evidence that the human brain and eye gaze are sensitive to fluctuations in cognitive resting states. We show that electroencephalography and eye tracking are reliable modalities to assess mental workload during user interface operation. In the end, we present applications that regulate cognitive workload in home and work setting, investigate how cognitive workload can be visualized to the user, and show how cognitive workload measurements can be used to predict the efficiency of information intake through reading interfaces. Finally, we present our vision of future workload-aware interfaces. Previous interfaces were limited in their ability to utilize cognitive workload for user interaction. Together with the collected data sets, this thesis paves the way for methodical and technical tools that integrate workload-awareness as a factor for context-aware systems.

The Attention Aware System: A Human-Computer Interaction Interface in the Multi-Task Context

Task Optimization Leads to Human-like Top-down and Bottom-up Attention during Reading Comprehension

A Survey of Attention Management Systems in Ubiquitous Computing Environments

Switch detector: an activity spotting system for desktop.

Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics

Towards Social Role-Based Interruptibility Management

Enhancement Methods of Sustained Attention in Complex Systems: A Review

A Design of Global Workspace Model with Attention: Simulations of Attentional Blink and Lag-1 Sparing

Detecting Worker Attention Lapses in Human-Robot Interaction: An Eye Tracking and Multimodal Sensing Study

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

Workload-Aware Systems and Interfaces for Cognitive Augmentation

DeepFocus: Deep Encoding Brainwaves and Emotions with Multi-Scenario Behavior Analytics for Human Attention Enhancement

Design Principles for AI-Assisted Attention Aware Systems in Human-in-the-Loop Safety Critical Applications

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

Attention mechanisms in computer vision: A survey

Hey! Preparing Humans to Do Tasks in Self-adaptive Systems

Interference inhibition of multimodal information in digital interfaces and its rule of cognitive processing

Attention: Theory, Principles, Models and Applications

Detection of Distraction and Fatigue in Groups through the Analysis of Interaction Patterns with Computers

Driver inattention monitoring system based on multimodal fusion with visual cues to improve driving safety