Recognition of map activities using eye tracking and EEG data
Tong QinWim FiasNico Van de WegheHaosheng Huanga Research Group CartoGIS,Department of Geography,Ghent University,Ghent,Belgiumb Department of Experimental Psychology,Ghent University,Ghent,BelgiumTong Qin is a PhD Candidate in the Cartography and GIS research group,department of Geography at Ghent University,Belgium. His research interests include map usability,spatial cognition and urban perception using eye tracking and EEG.Wim Fias full professor at the department of Experimental Psychology at Ghent University. He investigates the neurocognitive basis of diverse cognitive functions using complementary neuroscientific techniques.Prof. Dr. Nico Van de Weghe is a GIScience expert,blending computer,social,and natural sciences. Since his 2004 PhD,he's focused on spatiotemporal reasoning in AI,and now explores hybrid GeoAI. His work,applied in areas like criminology and sports,is pivotal in understanding geospatial data.Haosheng Huang starts a tenure track professorship in GIScience and Cartography at Ghent University,Belgium since February 2020. His research interests include location based services (LBS),spatial cognition,GeoAI,and urban informatics.
DOI: https://doi.org/10.1080/13658816.2024.2309188
2024-01-31
International Journal of Geographical Information Science
Abstract:Recognizing the activities being performed on a map is crucial for adaptive map design based on user context. Despite eye tracking (ET) demonstrating potential in recognizing map activities and electroencephalography (EEG) measuring map users' cognitive load, no studies have yet combined ET and EEG for recognition of the user's activity on maps. Our study collected participants' ET and EEG data during four types of map activities. After feature extraction and selection, we trained LightGBM (light Gradient-Boosting Machine) to classify these activities, and achieved 88.0% accuracy when combining ET and EEG features in the entire map usage trial, which is higher than using ET (85.9%) or EEG (53.9%) alone. Acceptable recognition accuracy could also be achieved with the early time windows (73.1% when using the first 3 seconds). Saccade features of ET were the most important for differentiating map activities, indicating selective map content for different tasks. Our findings demonstrate the feasibility and advantages of combining ET and EEG for activity recognition in map use. The results not only improve our understanding of visual patterns and cognitive processes in map use, but also enable the design of adaptive maps that can automatically adapt to the activities a map user is performing.
geography, physical,computer science, information systems,information science & library science