Abstract:Introduction: Perceptual representations in language comprehension were examined using sentence-picture verification tasks. However, concerns have been raised regarding the suitability of concrete pictures for representing abstract concepts compared to image-schematic diagrams. To assess the perceptual representations of spatial and abstract domains in both first language (L1) and second language (L2) processing, the study tests bilingual speakers' mental imagery on the basis of the simulation-based L1 comprehension model and proposes a simulation-based L2 comprehension model, supported by empirical evidence from an innovative sentence-diagram verification paradigm. Methods: 41 adult L1 Mandarin Chinese speakers participated in the study. 21 participants completed the Chinese sentence-diagram verification task (Experiment 1), while 20 participants completed the translation-equivalent version in L2 English (Experiment 2). Participants read a sentence [e.g., A diligent worker walked into the office (spatial sense); A strong team headed into the final (abstract sense)] at their self-paced speed, followed by a congruent (e.g., into diagram ) or incongruent diagram (e.g., out-of diagram ), and made binary judgments to verify spatial configurations between the sentence and diagram. Semantic rating tasks in both Chinese and English were also conducted to validate congruency between diagrams and sentences in both languages. Results and discussion: Results from Experiment 1 indicate overall compatibility effects on L1 Chinese processing, unaffected by directional verbs or abstractness of sense. Results from Experiment 2 reveal interference effects on L2 English processing, with interference observed only after reading sentences encoding spatial senses, not abstract senses. Aligning with previous findings using sentence-picture verification tasks, the current findings confirm the weaker mental simulation effects in L2 processing compared to L1 processing. These findings extend the existing simulation-based L1 comprehension model, provide empirical support for the proposed simulation-based L2 comprehension model, and validate the innovative sentence-diagram verification paradigm for examining image-schematic representations in spatial and abstract language processing among Chinese-English bilinguals. The paradigm holds significant potential for research on perceptual representations in processing a broader range of grammatical and semantic properties during both online and offline L1 and L2 comprehension.

Learning to Map Chinese Sentences to Logical Forms.

Dual Collaborative Visual-Semantic Mapping for Multi-Label Zero-Shot Image Recognition

Lattice LSTM for Chinese Sentence Representation

Parsing the Logical Embedded Complex Sentences in Chinese

Language to Logical Form with Neural Attention

Implicit Learning of Mappings Between Forms and Metaphorical Meanings

LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training.

Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification.

Structural Correspondence Learning for Cross-lingual Sentiment Classification with One-to-many Mappings

Perceptual representations in L1 and L2 spatial and abstract language processing: applying an innovative sentence-diagram verification paradigm

Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism

Learning with Logical Constraints but without Shortcut Satisfaction

Do Large Language Models Understand Logic or Just Mimick Context?

Learning topic emotion and logical semantic for video paragraph captioning

Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogism

Study On The Annotation Framework Of Chinese Logic Complement Semantics

Universal Sentence Representation Learning with Conditional Masked Language Model

Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation

Learning Domain Representation for Multi-Domain Sentiment Classification.

Improving Large Language Models in Event Relation Logical Prediction

Knowledge representation of non-literal meanings of Chinese words and its applications