Abstract:Six subjects were asked to read and try to understand the first part of Einstein's 1905 paper on special relativity. On the basis of the diagrams drawn by the subjects while they read the text, their thinking aloud protocols, their responses to questions, and other observations, we have inferred the processes they used to understand the paper, and the role that mental images (mental representations) and their paper-and-pencil drawings played in achieving the understanding. In particular, we discuss the characteristics of the representations the subjects formed and the processes they used to form them, as well as the ways in which they derived or reached an understanding of the equations of relativity, using the mental images to assist them. From our analysis we infer that subjects translating the natural-language text into images are able to manipulate, control, and observe these representations to run simple "mental experiments," and by these means draw out the qualitative and quantitative implications of the text. The mental representations and drawings appear to mediate between the initial natural language text and the final equations. In no case did any subject achieve an understanding of the equations without using this kind of intermediate representation. For some decades, imagery has been an active research area in cognitive science (c.f., Paivio 1971 ; Shepard and Metzler 1971; Simon 1972; Pylyshyn 1973; Kosslyn 1980, 1983; Shepard and Copper 1982; Pinker 1985; Finke 1989). Research on imagery's neuro psychological base is also progressing (Farah 1985; Kosslyn 1987; Kosslyn, SokoIv and Chen 1989; etc.). And the role of imagery in education has been examine (e.g., Marte11991). However, there are only a few publications of experimental work concerned mainly with imagery in problem solving (e.g., Simon and Barenfeld 1969; Hayes 1973; Novak 1976; and some aspects in Larkin and Simon 1987). Our study, in which subjects were asked to read and try to understand the first part of Einstein's 1905 paper on special relativity, focuses on imagery in understanding and problem solving, in mental modeling (c.f. Gentner and Stevens 1983; Johnson-Laird 1983; Norman 1988) and in qualitative reasoning (c.f. Iwasaki 1989; Weld and de Kleer 1990). In Qin and Simon (1990, 1991), we discussed some results of our project relating to problem solving success. In this paper, we summarize very briefly our major findings about imagery and mental models.

Neural Mechanism of Mental Imagery in Problem Solving

The Neural Correlates of Computational Thinking: Collaboration of Distinct Cognitive Components Revealed by Fmri.

Simulating Human Heuristic Problem Solving: A Study By Combining Act-R And Fmri Brain Image

A skill learning during heuristic problem solving: an fMRI study

Neural Bases for Basic Processes in Heuristic Problem Solving: Take Solving Sudoku Puzzles As an Example

The Role of Posterior Parietal Cortex in Problem Representation

Imagery and Mental Models in Problem Solving

Rule acquisition in the proceeding of heuristic sudoku solving

The optimal balance of controlled and spontaneous processing in insight problem solving: fMRI evidence from Chinese idiom guessing

Neural Correlates of the “aha” Experiences: Evidence from an Fmri Study of Insight Problem Solving

Zeigarnik effect in Insight problem solving: Hemi-spheric difference in brain activities following problem solving and during hint presentation

The Relationship of Three Cortical Regions to an Information-Processing Model

Neural Mechanisms of Creative Problem Solving: From Representational Change to Memory Formation

Causal Cortical Network for Arithmetic Problem-Solving Represents Brain's Planning Rather than Reasoning

Brain mechanisms underlying visual perception and visual mental imagery of Chinese pseudo-characters: an event-related potential study.

Brain Activations and Functional Connectivity Patterns Associated with Insight-Based and Analytical Anagram Solving

Inter-Brain Network Underlying Turn-Based Cooperation and Competition: A Hyperscanning Study Using Near-Infrared Spectroscopy

Possible Approaches on Imagery Thinking Simulation

Using Svm to Predict High-Level Cognition from Fmri Data: A Case Study of 4*4 Sudoku Solving

Fmri Study in Posterior Cingulate and Adjacent Precuneus Cortex in Healthy Elderly Adults Using Problem Solving Task.

Hippocampus and amygdala: An insight-related network involved in metaphorical solution to mental distress problem