The Cognitive Map Mechanism in Digital Reading: An Experimental Study on the Influence of Textual Representation on Cognitive Effects

Yeping Liu,Liang Zhao,Qing Fang,Mofan Song

DOI: https://doi.org/10.1002/pra2.1062

2024-10-16

Proceedings of the American Society for Information Science and Technology

Abstract:Proceedings of the Association for Information Science and Technology, Volume 61, Issue 1, Page 581-585, October 2024.

What problem does this paper attempt to address?

The Cognitive Lag Effect in Chinese Sentences Reading

Liu Zhifang,Shi Yiping,Zhang Zhijun,Pan Yun

DOI: https://doi.org/10.3969/j.issn.1003-5184.2012.01.005

2012-01-01

Abstract:An experiment was conducted to explore the leg effects on Chinese readers' eye movements.Readers' eye movements were monitored with the device of EyelinkⅡ.There were there conditions in first experiment.As the word was fixated,(1)word n-1 and its left texts were masked;(2)word n-2 and its left texts were masked;(3)normal sentences conditions.The results showed that the condition of word n-1 and its left texts were masked interrupted total reading seriously,but not the condition of word n-2 and its left texts were masked.In a word,we have found a reliable leg effect onto word n-1 which fit better with the theoretical assumptions of parallel processing models of eye movements control in reading.
Construction of Cognitive Maps to Improve Reading Performance by Text Signaling: Reading Text on Paper Compared to on Screen

Zifu Shi,Ting Tang,Lin Yin

DOI: https://doi.org/10.3389/fpsyg.2020.571957

IF: 3.8

2020-09-30

Frontiers in Psychology

Abstract:Reading text from a screen has been shown to be less effective compared with reading text from paper. Various signals may provide both background information and navigational cues, and may promote the construction of cognitive maps during on-screen reading, thus improving reading performance. This study randomly divided 75 college students into a paper reading group and an on-screen reading group. Both groups were tested for navigation and reading comprehension in response to three different forms of signaling (plain text, physical signaling, and verbal signaling). The results showed that when plain text was presented, the navigation and comprehension scores of the paper reading group were significantly higher than those of the on-screen reading group. However, no significant difference was found between both groups under signaling conditions. The navigation and comprehension scores of both groups were significantly higher under signaling conditions than under plain text. Moreover, the comprehension score of the on-screen reading group under physical signaling was significantly higher than that under verbal signaling. This research suggested that signals help to construct cognitive maps and effectively improve reading performance. Besides, physical signaling, such as underlining and bold formatting, is more effective for on-screen reading. The present study provides a practical and effective approach for improving on-screen reading based on cognitive map theory.

psychology, multidisciplinary
Perceptual Experience As a Bridge Between the Retina and a Bicoded Cognitive Map.

Frank H Durgin,Zhi Li

2013-01-01

Abstract:The bicoded cognitive maps described by Jeffery et al. are compared to metric perceptual representations. Systematic biases in perceptual experience of egocentric distance, height, and surface orientation may reflect information processing choices to retain information critical for immediate action (Durgin et al. 2010a). Different information processing goals (route planning vs. immediate action) require different metric information.
Effect of Interaction Characteristics of Virtual Environments on Spatial Representation

Zuo Wuheng,Xu Baihua,Feng Zhilin,Yuan He

DOI: https://doi.org/10.1109/CINC.2009.244

2009-01-01

Abstract:The effect of interaction characteristics such as display size and active/passive navigation on spatial representation was investigated when participants repeatedly navigated complex three-dimensional virtual maze. The study was divided into two main phases: learning and test. Participants navigated respectively under active or passive navigation style and two display sizes condition during learning phase. Spatial representation was examined by testing estimation of directions in the environment. Participants judged more accurately in active navigation and large projection display condition than in passive navigation and desktop monitor condition. Findings further show that the effects of active or passive navigation style and display size on spatial representation are dependent.
A Novel Mathematic Entorhinal-Hippocampal System Building Cognitive Map

Jiawei Peng,Suogui Dang,Rui Yan,Huajin Tang

DOI: https://doi.org/10.1007/978-3-030-63833-7_1

2020-01-01

Abstract:Place cells and grid cells are crucial parts of the cognitive map, which shows a presentation of the real-world observation. However, the previous architecture, which uses CAN for simulating the activities of grid cells, is redundant. And it could not generate natural activities of place cells while it needs many computing resources and storage. In this paper, we proposed a simple novel mathematic entorhinal-hippocampal system to build an accurate cognitive map by combining the activities of head direction cells, grid cells, place cells, and visual cues. It has fewer parameters and could generate a natural pattern of place cells. Moreover, we could also perform a cognitive map building system with generated weight without training.
Variabletypography: artificial intelligence augmented reading experience

Shuhui Shi,Weitao You,Kaixin Han,Jinyu Song,Lingyun Sun

2023-01-01

Abstract:Nowadays, digital information has overloaded and reading time has been fragmented due to the significant development of digital devices, such as phones, computers, etc. Optimizing the reading experience has become a challenge. Prior studies on Chinese digital reading have primarily focused on uniform and consistent typography settings. Nevertheless, this standard typography is not applicable to real-world scenarios. Usually, people leverage different typographical variables to emphasize part of a sentence to highlight key information. Inspired by this, we propose a novel screen reading method, dubbed VariableTypography (VT), that highlights key information in various typographic ways by utilizes artificial intelligence tool ChatGPT to identify key information in the text, aiming to enhance the reading experience. In the field of artificial intelligence, significant progress has been made in natural language processing, resulting in innovative tools like ChatGPT. With its low operating threshold and the ability to use natural language for prompt engineering, ChatGPT has attracted widespread attention. In this study, we incorporated ChatGPT into a real-world reading scenario and integrated it with VT to examine its potential for assisted reading. To evaluate the effectiveness of VT, objective and subjective experiments were conducted in naturalistic remote settings with 70 participants using their smartphones in daily Interlude Reading scenarios. The results show that our proposed VT effectively improved readers' subjective information acquisition while significantly reducing cognitive load during reading, without affecting the original reading efficiency. Additionally, VT is evidenced with good subjective acceptance. We hope that our findings will shed light on the field of digital Chinese readability.
An Informatics System for Exploringeye Movements in Reading

Siliang Tang

2011-01-01

Abstract:Eye tracking techniques have been widely used in many research areas including cognitive science, psychology, human-computer interaction, marketing research, medical research etc. Many computer programs have emerged to help these researchers to design experiments, present visual stimuli and process the large quantity of numerical data produced by the eye tracker. However, most applications, especially commercial products, are designed for a particular tracking device and tend to be general purpose. Few of them are designed specifically for reading research. This can be inconvenient when dealing with complex experimental design, multi-source data collection, and text based data analysis, including almost every aspect of a reading study lifecycle. A flexible and powerful system that manages the lifecycle of different reading studies is required to fulfill these demands. Therefore, we created an informatics system with two major software suites: Experiment Executor and EyeMap. It is a system designed specifically for reading research. Experiment Executor helps reading researchers build complex experimental environments, which can rapidly present display changes and support the co-registration of eye tracking information with other data collection devices such as EEG (electroencephalography) amplifiers. The EyeMap component helps researchers visualize and analysis a wide range of writing systems including spaced and unspaced scripts, which can be presented in proportional or non-proportional font types. The aim of the system is to accelerate the life cycle of a reading experiment from design through analysis. Several experiments were conducted on this system. These experiments confirmed the effectiveness and the capability of the system with several new reading research findings from the visual information processing stages of reading.
Reading in print versus digital media uses different cognitive strategies: evidence from eye movements during science-text reading

Yu-Cin Jian

DOI: https://doi.org/10.1007/s11145-021-10246-2

2022-01-27

Reading and Writing

Abstract:Comparing comprehension outcomes in print and digital reading is an active area of research but little is known about the reading processes that these media entail. This study involved an eye-tracking experiment with 50 undergraduate students to investigate the differences in reading processes in print and digital media. The participants were randomly assigned to read the same six-page popular science article that included several diagrams either in print or on a tablet computer and then answer reading comprehension questions. The results showed that comprehension was better when reading in print. Eye-movement data indicated that the print and digital groups spent about the same amount of time processing the article, texts, diagrams, and diagram statements, but the time was not divided evenly between the first pass and the rereading stages. The digital group spent more time reading the article at the first-pass reading stage and seldom reread it. In contrast, the print group first skimmed the article and then reread the important parts, exhibiting both longer total fixation durations in the rereading stage and a higher number of rereading instances across pages. In sum, the findings indicate that reading in print versus digital media employs different cognitive strategies with those reading in print showing more selective and intentional reading behavior.

education & educational research,psychology, educational
Effects of Spatial Reference Frames, Map Dimensionality, and Navigation Modes on Spatial Orientation Efficiency

Hongyun Guo,Nai Yang,Zhong Wang,Hao Fang

DOI: https://doi.org/10.3390/ijgi12120476

IF: 3.4

2023-11-24

ISPRS International Journal of Geo-Information

Abstract:How can the interactive mode of a map be optimized to facilitate efficient positioning and improve cognitive efficiency? This paper addresses this crucial aspect of map design. It explores the impact of spatial reference frames, map dimensionality, and navigation modes on spatial orientation efficiency, as well as their interactions, through empirical eye-movement experiments. The results demonstrate the following: (1) When using a 2D fixed map in an allocentric reference frame, participants exhibit a high correct rate, a low cognitive load, and a short reaction time. In contrast, when operating within an egocentric reference frame using a 2D rotating map, participants demonstrate a higher correct rate, a reduced cognitive load, and a quicker reaction time. (2) The simplicity of 2D maps, despite their reduced authenticity compared to 3D maps, diminishes users' cognitive load and enhances positioning efficiency. (3) The fixed map aligns more closely with the cognitive habits of participants in the allocentric reference frame, while the rotating map corresponds better to the cognitive habits of participants in the egocentric reference frame, thereby improving their cognitive efficiency. This study offers insights that can inform the optimization design of spatial orientation efficiency.

geography, physical,remote sensing,computer science, information systems
Mind Mapping Training's Effects on Reading Ability: Detection Based on Eye Tracking Sensors

Ting Liu,Takaya Yuizono

DOI: https://doi.org/10.3390/s20164422

2020-08-07

Abstract:As a reading comprehension strategy, mind mapping has a positive influence on the development of students' reading ability. However, how mind mapping affects reading ability has not been well documented. In this study, we used eye tracking sensors to explore mind mapping's effects on reading ability. The participants were foreign language learning university students in Dalian city, China. One group received foreign language reading teaching integrated with mind mapping training (experimental group), and the other group received regular foreign language reading teaching (control group). We analyzed eye movement indicators, including fixation-related indicators (number of fixations, fixation frequency, and mean fixation duration), regression count, saccade amplitude, and pupil diameter. In addition, the analysis of heat maps and fixation trajectory maps, which are specific tool for visualization of eye movement data and intuitive analysis of reading process, were explained. The results show that the number of fixations, fixation frequency, mean fixation duration, and regression count in the experimental group were all lower than in the control group, and the pupil diameter was larger than in the control group. The heat map and fixation trajectory map show convergence, mostly focusing on the position of keywords and key sentences, with relatively large saccade amplitude and more information obtained by one gaze. Moreover, they had a higher skipping reading rate, which enhanced reading speed to obtain information accurately and quickly. These empirical results indicate that mind mapping training was an effective method for improving students' reading ability.
Cognitive Memory and Mapping in a Brain-Like System for Robotic Navigation

Huajin Tang,Weiwei Huang,Aditya Narayanamoorthy,Rui Yan

DOI: https://doi.org/10.1016/j.neunet.2016.08.015

IF: 7.8

2016-01-01

Neural Networks

Abstract:Electrophysiological studies in animals may provide a great insight into developing brain-like models of spatial cognition for robots. These studies suggest that the spatial ability of animals requires proper functioning of the hippocampus and the entorhinal cortex (EC). The involvement of the hippocampus in spatial cognition has been extensively studied, both in animal as well as in theoretical studies, such as in the brain-based models by Edelman and colleagues. In this work, we extend these earlier models, with a particular focus on the spatial coding properties of the EC and how it functions as an interface between the hippocampus and the neocortex, as proposed by previous work. By realizing the cognitive memory and mapping functions of the hippocampus and the EC, respectively, we develop a neurobiologically-inspired system to enable a mobile robot to perform task-based navigation in a maze environment.
The modality effect on reading literacy: perspectives from students’ online reading habits, cognitive and metacognitive strategies, and web navigation skills across regions

Jiun Yu Wu,Ya-Chun Peng

DOI: https://doi.org/10.1080/10494820.2016.1224251

2016-09-08

Interactive Learning Environments

Abstract:This study tested the effects of the modality of reading formats (electronic vs. print), online reading habits (engagement in different online reading activities), use of cognitive strategies, metacognitive knowledge, and navigation skills on printed and electronic reading literacy across regions. Participants were 31,784 fifteen-year-old students (50.78% female) from 19 countries and economies in the 2009 Programme for International Student Assessment database. Results showed that students exhibited better reading literacy in the print environment. Moreover, information-seeking activities, control strategies, knowledge of metacognitive strategies, and navigation skills positively predicted reading literacy in both print and electronic formats for all regions, whereas social reading activities negatively predicted reading literacy in print and were most harmful for the Asian region in both formats. Memorization strategies were negatively associated with reading literacy in both formats for Australasian, Western and Eastern EU, and South American regions, but not for the Asian region. Online reading habits, regardless of types, had no impact on reading literacy in both formats for the South American region. The study findings provided suggestions for literacy instruction in the e-learning era across different regions.

education & educational research
Effects of computer-based mind mapping on students' reflection, cognitive presence, and learning outcomes in an online course

Zhi Liu,Xi Kong,Sannyuya Liu,Zongkai Yang

DOI: https://doi.org/10.1080/01587919.2023.2226615

2023-06-26

Distance Education

Abstract:Reflection plays a very important role in the learning process, contributing to improved learning performance and potentially influencing cognitive process. Few studies, however, have used computer-based mind mapping to enhance student reflective activities and examine the relationship between reflection, cognitive presence, and learning outcomes. Therefore, a quasi-experiment was implemented by recruiting students from a big data class at a normal university in central China. The collected data was analyzed by jointly using analysis of covariance, cognitive network analysis, linear regression, and moderating effect analysis. The results were as follows: (a) Students who used computer-based mind mapping performed better on reflection, higher-order cognitive presence, and learning outcomes. (b) The epistemic network analysis showed that students who used computer-based mind mapping had strong connections in higher levels of cognitive presence. (c) Reflection had a positive predictive effect on cognitive presence and learning outcomes, with mind mapping positively moderating the relationship between reflection, cognitive presence, and learning outcomes.

education & educational research
Configurational Path to Chinese Reading Stickiness of Digital Library

Yongliang Deng,Hua Zhang

DOI: https://doi.org/10.1145/3459092

2021-09-30

Abstract:Attracting and retaining readers in an increasingly competitive environment is an urgent problem for digital libraries of original literature. However, few empirical studies address online reading stickiness, particularly the factors affecting the promotion of online reading stickiness, in what combinations or paths these effects exist, and whether there are complementary, alternative, and inhibitory relationships among the factors. To solve the practical problems and fill the theoretical gap, we use a fuzzy-set qualitative comparative analysis to study the interaction effects of the flow experience (feeling of immersion and perceived pleasure), technology acceptance model (perceived usefulness and perceived ease of use), and customer participation (information sharing and interpersonal interaction) to identify the critical configurations leading to a high level of stickiness in online reading and to verify the complementarity, substitution, and inhibition relationships among these variables. The findings provide implications for further research on complexity theory in digital libraries of original literature, and for managers to view and redesign online reading stickiness as configurations of IT and psychological capabilities. This study enriches and develops the existing theories and expands the application of the qualitative comparative analysis method in the field of digital libraries.

computer science, artificial intelligence
A theoretical model and empirical analysis of university library readers' spatial cognition

Yiping Jiang,Yanhua Chen,Xiaobo Chi

DOI: https://doi.org/10.1108/lht-05-2022-0242

2022-08-02

Library Hi Tech

Abstract:Purpose The practice of renovation and construction of university libraries is flourishing, but how to attract readers to use the library is an issue that urgently needs to be explored. Spatial cognition is a subjective judgment of a person's tendency to take action in the future and implies behavioral intention. Based on the sensory–image–cognition relationship, a theoretical model of university library readers' spatial cognition is conducted, and the influencing factors and mechanisms of spatial cognition are explored based on empirical data to provide theoretical references for spatial practices in university libraries. Design/methodology/approach A visual and art-based mental map approach is introduced based on a questionnaire survey. The questionnaire is mainly used for the specific evaluation of spatial use and the breakdown of the detailed elements, while the mental map method is mainly used for the evaluation of readers' spatial cognition. Relevant empirical data are collected from the library of the Zhejiang University of Technology. Findings The results indicate that readers' spatial sensory experience and mental imagery have positive effects on readers' behavior via the mediator spatial cognition, readers' spatial sensory experience and mental imagery have a positive effect on readers' spatial cognition and spatial cognition has a significant effect on readers' behavior. Originality/value The main contribution of this study is to construct a theoretical model of readers' spatial cognition and to explore the factors that have an impact on spatial cognition and the influence of cognition on behavior. This provides a more rational and in-depth thinking paradigm for the study of university library space and provides theoretical references for library practice.

information science & library science
Attention switching through text dissimilarity: a cognition research on fragmented reading behavior

Jingjing Cao,Jingtao Luo,Jia Zhou,Yunshan Jiang

DOI: https://doi.org/10.3389/fnhum.2024.1402746

IF: 3.473

2024-06-25

Frontiers in Human Neuroscience

Abstract:People tend to obtain information through fragmented reading. However, this behavior itself might lead to distraction and affect cognitive ability. To address it, it is necessary to understand how fragmented reading behavior influences readers' attention switching. In this study, the researchers first collected online news that had 6 theme words and 60 sentences to compose the experimental material, then defined the degree of text dissimilarity, used to measure the degree of attention switching based on the differences in text content, and conducted an EEG experiment based on P200. The results showed that even after reading the fragmented text content with the same overall content, people in subsequent cognitive tasks had more working memory capacity, lower working memory load, and less negative impact on cognitive ability with the text content with lower text dissimilarity. Additionally, attention switching caused by differences in concept or working memory representation of text content might be the key factor affecting cognitive ability in fragmented reading behavior. The findings disclosed the relation between cognitive ability and fragmented reading and attention switching, opening a new perspective on the method of text dissimilarity. This study provides some references on how to reduce the negative impact of fragmented reading on cognitive ability on new media platforms.

psychology,neurosciences
Across Textual Landscapes: The Role of Affect During Digital Reading Encounters

Carina Hermansson,Christina Olin-Scheller

DOI: https://doi.org/10.1007/s10583-022-09502-y

2022-08-24

Evolutionary Psychology

Abstract:This article addresses questions related to how the change in the textual landscape, from paper-based books to electronic books, has an effect on the teaching of reading in early childhood classrooms as well as how the digital devices relate to different aspects of reading instruction. Drawing on the theoretical concept of affect, the purpose is to expand knowledge about processes of experiencing literary digital texts that are enacted and produced in a Swedish classroom when the teacher and the six-year-old students encounter digital narrative texts. The study draws on ethnographical methods to collect empirical material using video recording, field notes, and small interviews with children. The documentation includes both individual and collaborative reading of digital narratives. Discussed in the intersection between envisionment and affect, the results show that e-book activities create multiple and differing processes of reading. The metacognitive processes initiated by the teacher's instruction of reading strategies create a distance between the student and the text, while processes of embodied sense-making create a closeness to the text that seems to be vital when the students encounter digital narratives and text worlds. These findings may contribute to educational as well as edu-political discussions about pedagogical rationales for e-book activities in which the dynamic and essential relation between body, space, and reading is made prominent.

psychology, experimental
Towards a model of eye-movement control in Chinese reading

Yanping Liu,Lili Yu,Erik D Reichle

DOI: https://doi.org/10.3758/s13423-024-02570-9

2024-09-06

Abstract:The Chinese writing system has several features that make it markedly different from the alphabetic systems that have most often been examined in reading research, including the fact that individual words consist of various uniformly sized, box-shaped characters whose boundaries are not clearly demarcated (e.g., by blank spaces). These features raise the question: How do readers of Chinese "know" where to move their eyes for the purpose of efficiently segmenting and/or identifying words? To answer this question, we used the E-Z Reader model of eye-movement control in reading to run an 'experiment' involving a series of simulations in which two saccade-targeting assumptions (i.e., directing the eyes towards default targets vs. adjusting saccade length as a function of parafoveal processing difficulty) were factorially manipulated with three word-segmentation heuristics (i.e., ideal-observer knowledge of word boundaries vs. probabilistic guessing vs. familiarity-based segmentation) to examine which combination of assumptions provide the best quantitative account of eye-movement control during the reading of Chinese. Based on these simulations, we conclude the best account is one in which readers use relative differences in the familiarity of groups of parafoveal characters to dynamically adjust the lengths of saccades in a manner that affords efficient word identification. We discuss the broader theoretical implications of these conclusions for models of Chinese reading and for models of reading more generally.
An analysis on the effects of the factors of cognitive psychology in Chinese reading

王天星

DOI: https://doi.org/10.3969/j.issn.1672-1306.2003.05.008

2003-01-01

Abstract:This paper focuses on cognitive psychology in Chinese reading. We propose an information process model, chunks reading method. On the basis of learning background and experience, and with the effects of different reading materials, whether or not to be familiar with Chinese regulation, we propose kinds of reading materials and enhance to learning of Chinese regulation to set a solid Chinese foundation. We give attention to the advantage of the first impression fast reading so as to get the general picture. We propose to control attention for accomplishing the learning task effectively.
Experiencing literature on the e-reader: the effects of reading narrative texts on screen

Annika Schwabe,Lukas Brandl,Hajo G Boomgaarden,Günther Stocker

DOI: https://doi.org/10.1111/1467-9817.12337

Abstract:Background: The digitalisation of literature is proliferating, and the increasing spread of digital reading devices and the availability of digital texts is likely to make books on screen a lasting phenomenon, but little attention has been paid to the consequences of digitalisation for the experience of narrative fiction. While on the one hand, reading literature on a digital reading device might trigger a superficial processing of the text, and problems regarding orientation within the narrative, the awareness of reading a literary text might, on the other hand, lead to more in-depth and complex processing, independent of reading medium. This study examines whether the reading performance and the emotional and cognitive experiences of the reception of a literary text vary between reading a printed book or an e-reader. Methods: Using a between-subjects experimental design, 207 participants read the beginning of a novel either in a printed book or on an e-reader. They then completed a reading comprehension test and questionnaires about their cognitive and emotional experiences. Results: Overall, the results do not suggest the clear superiority of either of the two reading media. Neither reading speed nor reading comprehension differed significantly between the two groups. Even though a broad range of reading experiences was measured, neither cognitive nor emotional reading experiences differed significantly between the groups. Conclusion: An e-reader does not affect either reading performance or cognitive and emotional experience of reading a narrative text, compared with a printed book.

The Cognitive Map Mechanism in Digital Reading: An Experimental Study on the Influence of Textual Representation on Cognitive Effects

The Cognitive Lag Effect in Chinese Sentences Reading

Construction of Cognitive Maps to Improve Reading Performance by Text Signaling: Reading Text on Paper Compared to on Screen

Perceptual Experience As a Bridge Between the Retina and a Bicoded Cognitive Map.

Effect of Interaction Characteristics of Virtual Environments on Spatial Representation

A Novel Mathematic Entorhinal-Hippocampal System Building Cognitive Map

Variabletypography: artificial intelligence augmented reading experience

An Informatics System for Exploringeye Movements in Reading

Reading in print versus digital media uses different cognitive strategies: evidence from eye movements during science-text reading

Effects of Spatial Reference Frames, Map Dimensionality, and Navigation Modes on Spatial Orientation Efficiency

Mind Mapping Training's Effects on Reading Ability: Detection Based on Eye Tracking Sensors

Cognitive Memory and Mapping in a Brain-Like System for Robotic Navigation

The modality effect on reading literacy: perspectives from students’ online reading habits, cognitive and metacognitive strategies, and web navigation skills across regions

Effects of computer-based mind mapping on students' reflection, cognitive presence, and learning outcomes in an online course

Configurational Path to Chinese Reading Stickiness of Digital Library

A theoretical model and empirical analysis of university library readers' spatial cognition

Attention switching through text dissimilarity: a cognition research on fragmented reading behavior

Across Textual Landscapes: The Role of Affect During Digital Reading Encounters

Towards a model of eye-movement control in Chinese reading

An analysis on the effects of the factors of cognitive psychology in Chinese reading

Experiencing literature on the e-reader: the effects of reading narrative texts on screen