Abstract:We present a visual analytics approach for multi-level visual exploration of users' interaction strategies in an interactive digital environment. The use of interactive touchscreen exhibits in informal learning environments, such as museums and science centers, often incorporate frameworks that classify learning processes, such as Bloom's taxonomy, to achieve better user engagement and knowledge transfer. To analyze user behavior within these digital environments, interaction logs are recorded to capture diverse exploration strategies. However, analysis of such logs is challenging, especially in terms of coupling interactions and cognitive learning processes, and existing work within learning and educational contexts remains limited. To address these gaps, we develop a visual analytics approach for analyzing interaction logs that supports exploration at the individual user level and multi-user comparison. The approach utilizes algorithmic methods to identify similarities in users' interactions and reveal their exploration strategies. We motivate and illustrate our approach through an application scenario, using event sequences derived from interaction log data in an experimental study conducted with science center visitors from diverse backgrounds and demographics. The study involves 14 users completing tasks of increasing complexity, designed to stimulate different levels of cognitive learning processes. We implement our approach in an interactive visual analytics prototype system, named VISID, and together with domain experts, discover a set of task-solving exploration strategies, such as "cascading" and "nested-loop', which reflect different levels of learning processes from Bloom's taxonomy. Finally, we discuss the generalizability and scalability of the presented system and the need for further research with data acquired in the wild.

A Multi-level Interactive Lifelog Search Engine with User Feedback.

Improving Multi-Faceted Book Search by Incorporating Sparse Latent Semantic Analysis of Click-Through Logs

A Two-Level Lifelog Search Engine at the LSC 2019

An Interactive Video Search Platform for Multi-modal Retrieval with Advanced Concepts

Efficient Interactive Fuzzy Keyword Search.

Web Search Via an Efficient and Effective Brain-Machine Interface

LifeRec: A Mobile App for Lifelog Recording and Ubiquitous Recommendation

Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment

Lifelog Moment Retrieval With Interactive Watershed-Based Clustering and Hierarchical Similarity Search

An Interactive Query Generation Assistant using LLM-based Prompt Modification and User Feedback

Investigating Fine-Grained Usefulness Perception Process in Mobile Search.

Investigation Of User Search Behavior While Facing Heterogeneous Search Services

Optimization of interactive visual-similarity-based search

Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks

An Interactive Multi-modal Query Answering System with Retrieval-Augmented Large Language Models

Dynamic Analysis of Chinese Search Engine User Behavior

Interactive Social, Spatial and Temporal Querying for Multimedia Retrieval

Interactive Multimodal Visual Search on Mobile Device

Interactive and Fuzzy Search: a Dynamic Way to Explore MEDLINE

An Exploratory Study on a Reinforcement Learning Prototype for Multimodal Image Retrieval Using a Conversational Search Interface

LoyalTracker: Visualizing Loyalty Dynamics in Search Engines.