Are schematic diagrams valid visual representations of concepts? Evidence from mental imagery in online processing of English prepositions

Menghan Wang,Helen Zhao

DOI: https://doi.org/10.1017/langcog.2024.18

2024-04-03

Language and Cognition

Abstract:Embodied imagery hypothesis proposes the activation of perceptual-motor systems during language processing. Previous studies primarily used concrete visual stimuli to investigate mental imagery in language processing by native speakers (NSs) and second language (L2) learners, but few studies employed schematic diagrams. The study aims to investigate mental imagery in processing prepositional phrases by English NSs and L2 learners. Using image-schematic diagrams as primes, we examine whether any mental imagery effect is modulated by target preposition (over, in), the abstractness of meaning (spatial, extended), and stimulus onset asynchrony (SOA; 1,040 ms, 2,040 ms). A total of 79 adult L2 learners and 100 NSs of English completed diagram–picture matching and semantic priming phrasal decision tasks. Results revealed interference effects on L2 processing of over phrases and under 2,040 ms SOA, but no such effects were observed in the NS group. The selective interference effects in L2 suggest different mental imagery patterns between L1 and L2 processing, and processing schematic diagram primes requires high cognitive demands, potentially leading to difficulties in integrating visual and linguistic information and making grammaticality judgments. The findings partially validate schematic diagrams as visual representations of concepts and suggest the need for further examination of schematic diagrams with varying degrees of complexity.

psychology, experimental,linguistics

What problem does this paper attempt to address?

The problem this paper attempts to address is: to explore whether schematic diagrams can serve as effective visual representations to represent concepts, particularly in the context of the mental imagery effects during the online processing of prepositional phrases by native speakers of English (NSs) and second language learners (L2 learners). Specifically, the study aims to examine whether the mental imagery effects are influenced by the target prepositions (e.g., "over" and "in"), the level of abstractness of meaning (spatial meaning vs. extended meaning), and the stimulus onset asynchrony (SOA; 1,040 milliseconds and 2,040 milliseconds) by using schematic diagrams as priming materials.

### Research Background
- **Mental Imagery Hypothesis**: Suggests that the perceptual-motor system is activated during language processing.
- **Existing Research**: Most studies use concrete visual stimuli to explore the mental imagery effects in native speakers, but few studies use schematic diagrams. Additionally, research on the mental imagery of second language learners is relatively scarce.
- **Application of Schematic Diagrams**: Schematic diagrams are widely used in cognitive linguistics to illustrate abstract conceptual schemas, but their application in mental imagery research is still insufficient.

### Research Objectives
- **Validate the Effectiveness of Schematic Diagrams**: To explore whether schematic diagrams can serve as visual representations of concepts and examine their potential application in language teaching.
- **Compare L1 and L2 Processing Differences**: To investigate whether there are differences in the mental imagery effects of schematic diagrams on native speakers and second language learners when processing prepositional phrases.
- **Explore Influencing Factors**: To examine the influence of target prepositions, the level of abstractness of meaning, and stimulus onset asynchrony (SOA) on the mental imagery effects.

### Research Methods
- **Participants**: 79 adult Chinese native speakers who are English second language learners and 100 adult native English speakers.
- **Experimental Design**: A priming paradigm was used, with schematic diagrams as priming materials to examine participants' responses to prepositional phrases.
- **Tasks**: Included a schematic diagram-picture matching task and a semantic priming phrase judgment task.

### Research Questions
1. Will schematic diagrams produce mental imagery effects during the online processing of English prepositional phrases by adult native English speakers and second language learners?
2. To what extent are the observed mental imagery effects moderated by the target prepositions, the level of abstractness of meaning, and the stimulus onset asynchrony (SOA)?

Through these research questions, the authors hope to fill the gaps in existing research and provide empirical support for the application of schematic diagrams in language teaching.