Abstract:We present a visual analytics approach for multi-level visual exploration of users' interaction strategies in an interactive digital environment. The use of interactive touchscreen exhibits in informal learning environments, such as museums and science centers, often incorporate frameworks that classify learning processes, such as Bloom's taxonomy, to achieve better user engagement and knowledge transfer. To analyze user behavior within these digital environments, interaction logs are recorded to capture diverse exploration strategies. However, analysis of such logs is challenging, especially in terms of coupling interactions and cognitive learning processes, and existing work within learning and educational contexts remains limited. To address these gaps, we develop a visual analytics approach for analyzing interaction logs that supports exploration at the individual user level and multi-user comparison. The approach utilizes algorithmic methods to identify similarities in users' interactions and reveal their exploration strategies. We motivate and illustrate our approach through an application scenario, using event sequences derived from interaction log data in an experimental study conducted with science center visitors from diverse backgrounds and demographics. The study involves 14 users completing tasks of increasing complexity, designed to stimulate different levels of cognitive learning processes. We implement our approach in an interactive visual analytics prototype system, named VISID, and together with domain experts, discover a set of task-solving exploration strategies, such as "cascading" and "nested-loop', which reflect different levels of learning processes from Bloom's taxonomy. Finally, we discuss the generalizability and scalability of the presented system and the need for further research with data acquired in the wild.

ICEBOAT: An Interactive User Behavior Analysis Tool for Automotive User Interfaces

Exploring Millions of User Interactions with ICEBOAT: Big Data Analytics for Automotive User Interfaces

AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies

Visualizing Event Sequence Data for User Behavior Evaluation of In-Vehicle Information Systems

IVIPAT: an in-vehicle information processing analysis tool to optimize user interaction flows

"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

Augmented Affective-Cognition for Usability Study of In-Vehicle System User Interface

A Brief Survey on Interactive Automotive UI

Developing IncidentUI -- A Ride Comfort and Disengagement Evaluation Application for Autonomous Vehicles

I-Interaction: An Intelligent In-Vehicle User Interaction Model

Multitasking While Driving: How Drivers Self-Regulate Their Interaction with In-Vehicle Touchscreens in Automated Driving

Current study on interaction design in automotive intelligent cockpit

On the forces of driver distraction: Explainable predictions for the visual demand of in-vehicle touchscreen interactions

Designing Autonomous Driving HMI System: Interaction Need Insight and Design Tool Study.

A discrete-event simulation model for driver performance assessment: application to autonomous vehicle cockpit design optimization

Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Interactive cognition in self-driving

Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment

Evaluation of in-vehicle HMI using occlusion techniques: experimental results and practical implications

Game and Simulation Design for Studying Pedestrian-Automated Vehicle Interactions

How to Display Vehicle Information to Users of Automated Vehicles When Conducting Non-Driving-Related Activities