Abstract:Purpose: Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. Method: Nine adults with aphasia had their eye movements tracked while processing TTS passages at a preselected default rate of 150 words per minute. Modality synchronization occurred whenever fixation on a written word occurred during the time span beginning 300 ms before auditory presentation and ending at the next word's initiation. Correlations between standardized test scores, unsupported reading rate, and modality synchronization percentages were informative about the association of aphasia and reading impairment severity with achievement of synchronicity. Results: Three participants demonstrated consistent modality synchronization; average synchronicity ranged from 67% to 76% of passage words. One participant displayed inconsistent synchronization within passages and achieved an average of 58%. The remaining five participants rarely achieved synchronization, with fixations typically lagging substantially behind the auditory presentation. A significant positive correlation occurred between paragraph reading comprehension test scores and modality synchronization percentages. Conclusions: A default TTS presentation rate does not result in dual modality synchronization for most people with aphasia. This lack of synchronization may contribute to inconsistencies in the benefit people with aphasia experience when provided with TTS support.

Eye movements of persons with aphasia during connected-text reading

A preliminary examination of regressive eye movements to content and function words when people with aphasia and neurotypical adults read narratives

The Cognitive Lag Effect in Chinese Sentences Reading

Clinical availability of eye movement during reading

Eye Movement Control in Reading Thai and Chinese

Eye movements in reading and information processing: 20 years of research.

Eye Movement Evidence for Simultaneous Cognitive Processing in Reading

Eye movements in developing readers: From basic research to classroom application. Parts of symposium 7 at the 20th European Conference on Eye Movements in Alicante, September 21, 2019

The neural substrates of natural reading: a comparison of normal and nonword text using eyetracking and fMRI

Modality Synchronization When People With Aphasia Read With Text-to-Speech Support

Language Experience Predicts Eye Movements During Online Auditory Comprehension

Using Eye Movements to Study Reading Processes

Ongoing Cognitive Processing Influences Precise Eye-Movement Targets in Reading

What Can Eye Movements Tell Us about Higher Level Comprehension?

Eye-movements in reading easy and difficult texts

EyeMap: a Software System for Visualizing and Analyzing Eye Movement Data in Reading

Eye movements and parafoveal processing during reading in Korean

Accounting for Visual Field Abnormalities when Using Eye-tracking to Diagnose Reading Problems in Neurological Degeneration

Online Eye Tracking for Aphasia: A Feasibility Study Comparing Web and Lab Tracking and Implications for Clinical Use

Reading eye movements among homonymous hemianopia

Eye Movements in Silent Visual Speech track Unheard Acoustic Signals and Relate to Hearing Experience