Abstract:Multiple external representations (MERs) are central to the practice and learning of science, mathematics and engineering, as the phenomena and entities investigated and controlled in these domains are often not available for perception and action. MERs therefore play a twofold constitutive role in reasoning in these domains. Firstly, MERs stand in for the phenomena and entities that are imagined, and thus make possible scientific investigations. Secondly, related to the above, sensorimotor and imagination-based interactions with the MERs make possible focused cognitive operations involving these phenomena and entities, such as mental rotation and analogical transformations. These two constitutive roles suggest that acquiring expertise in science, mathematics and engineering requires developing the ability to transform and integrate the MERs in that field, in tandem with running operations in imagination on the phenomena and entities the MERs stand for. This core ability to integrate external and internal representations and operations on them – termed representational competence (RC) – is therefore critical to learning in science, mathematics and engineering. However, no general account of this core process is currently available. We argue that, given the above two constitutive roles played by MERs, a theoretical account of representational competence requires an explicit model of how the cognitive system interacts with external representations, and how imagination abilities develop through this process. At the applied level, this account is required to develop design guidelines for new media interventions for learning science and mathematics, particularly emerging ones that are based on embodied interactions. As a first step to developing such a theoretical account, we review the literature on learning with MERs, as well as acquiring RC, in chemistry, biology, physics, mathematics and engineering, from two perspectives. First, we focus on the important theoretical accounts and related empirical studies, and examine what is common about them. Second, we summarise the major trends in each discipline, and then bring together these trends. The results show that most models and empirical studies of RC are framed within the classical information processing approach, and do not take a constitutive view of external representations. To develop an account compatible with the constitutive view of external representations, we outline an interaction-based theoretical account of RC, extending recent advances in distributed and embodied cognition.

External and mental referencing of multiple representations

Dual-task Costs in Memory Recall Precision Reflect Shared Representational Space

Generating Distant Analogies Facilitates Relational Integration: Intermediary Role of Relational Mindset and Cognitive Load

Storing information in-the-world: Metacognition and cognitive offloading in a short-term memory task

Integrated Encoding of Relations and Objects in Visual Working Memory.

Is the Inter-Item Association in Working Memory Resource Demanding? Rejecting a Dual-Route Model

Spatial memory and frames of reference: How deeply do we rely on the body and the environment?

Self-Repair Increases Referential Coordination

Can self-referential information improve directed forgetting? Evidence from a multinomial processing tree model

The More the Better? A Systematic Review and Meta-Analysis of the Benefits of More than Two External Representations in STEM Education

The origin and function of external representations

Learning and expertise with scientific external representations: an embodied and extended cognition model

Sensory Input Matching Visual Working Memory Guides Internal Prioritization

Implicit Theories, Working Memory, and Cognitive Load: Impacts on Creative Thinking

Representational competence: towards a distributed and embodied cognition account

Integration of memory content in adults and children: Developmental differences in task conditions and functional consequences.

How Does Cognitive Load Interact with Self-Regulated Learning? A Dynamic and Integrative Model

DeFT: A conceptual framework for considering learning with multiple representations

Simulation-Based Mentalizing Generates a “proxy” Self-Reference Effect in Memory

A conceptual framework for externally-influenced agents: an assisted reinforcement learning review

The influence of attentional focus on the development of skill representation in a complex action