To Draw or Not to Draw? Examining the Necessity of Problem Diagrams Using Massive Open Online Course Experiments

Zhongzhou Chen,Neşet Demirci,Youn‐Jeng Choi,David E. Pritchard

2017-01-01

Abstract:Instructors are generally wasting their time when they create diagrams to illustrate homework and exam problems.

What problem does this paper attempt to address?

To use or no to use diagrams: The effect of drawing a diagram in solving introductory physics problems

Alexandru Maries,Chandralekha Singh

DOI: https://doi.org/10.48550/arXiv.1601.05467

2016-01-20

Physics Education

Abstract:Drawing appropriate diagrams is a useful problem solving heuristic that can transform a give problem into a representation that is easier to exploit for solving it. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing a diagram facilitates problem solution. We conducted an investigation in which 111 students in an algebra-based introductory physics course were subjected to two different interventions during recitation quizzes throughout the semester. They were either (1) asked to solve problems in which the diagrams were drawn for them or (2) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed a rubric to score the problem-solving performance of students in different intervention groups. We investigated two problems involving electric field and electric force and found that students who draw expert-like diagrams are more successful problem solvers and that a higher level of detail in a student's diagram corresponds to a better score.
Do students benefit from drawing productive diagrams themselves while solving introductory physics problems? The case of two electrostatic problems

Alexandru Maries,Chandralekha Singh

DOI: https://doi.org/10.48550/arXiv.2007.00481

2020-06-26

Physics Education

Abstract:An appropriate diagram is a required element of a solution building process in physics problem solving and it can transform a given problem into a representation that is easier to exploit for solving the problem. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solving. We conducted an investigation in which two different interventions were implemented during recitation quizzes throughout the semester in a large enrollment, algebra-based introductory physics course. Students were either (1) asked to solve problems in which the diagrams were drawn for them or (2) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed a rubric to score the problem solving performance of students in different intervention groups. We investigated two problems involving electric field and electric force and found that students who drew productive diagrams were more successful problem solvers and that a higher level of relevant detail in a student's diagram corresponded to a better score. We also conducted think-aloud interviews with nine students who were at the time taking an equivalent introductory algebra-based physics course in order to gain insight into how drawing diagrams affects the problem solving process. These interviews supported some of the interpretations of the quantitative results. We end by discussing instructional implications of the findings.
Learning by drawing: When is it worth the time and effort?

Qian Zhang,Logan Fiorella

DOI: https://doi.org/10.1016/j.cedpsych.2021.101990

IF: 6.922

2021-07-01

Contemporary Educational Psychology

Abstract:Two experiments compared the effects of learning by drawing to studying instructor-provided visuals on learning outcomes, learning time, and cognitive load. College students studied a text on the human circulatory system and completed comprehension and transfer tests. In Experiment 1 (N = 107), students studied the text with provided visuals (provided visuals) or generated their own drawings from a text with text-based support (verbally-supported drawing) or without support (unsupported drawing). Results showed that while the verbally-supported drawing condition spent significantly more time and experienced significantly higher cognitive load than the provided visuals condition, there were no differences across the three conditions in learning outcomes. In Experiment 2 (N = 85), students studied the text with provided visuals (provided visuals) or generated drawings from the text with provided visuals as feedback (visually-supported drawing). Results showed that the visually-supported drawing condition spent significantly more time and experienced significantly higher cognitive load than the studying provided visuals condition but also performed significantly better than the provided visuals condition on the comprehension test. These findings suggest generating drawings prior to studying provided visuals is worth the time and effort.

psychology, educational
Exploring College Students’ Depth and Processing Patterns of Critical Thinking Skills and Their Perception in Argument Map(am)-Supported Online Group Debate Activities

Xinya Chen,Huichen Zhao,Haoyue Jin,Yan Li

DOI: https://doi.org/10.1016/j.tsc.2024.101467

IF: 3.652

2024-01-01

Thinking Skills and Creativity

Abstract:Although argument maps (AM) have been proven to be an effective tool for visually presenting arguments and enhancing students' critical thinking skills, the time available for argumentation in traditional face -to -face environments is often limited. Additionally, AMs are typically created by group members from the same side, with few conflicting views. In this study, 17 sophomores majoring in education were divided into four groups, with each group consisting of pros and cons. These groups participated in debates centred around analysing scientific papers. Using a collaborative online platform called 'ZJUYuQue', all the groups engaged in six online group debate activities, anonymously and simultaneously creating AMs. To examine the depth and processing patterns of college students' critical thinking skills in these activities, both content analysis and lag sequence analysis (LSA) were employed to analyse the quality of the debates. Additionally, interviews were conducted with eight participants to explore their perceptions of this instructional design. Thematic analysis was used to analyse the interview data. Results indicated that: first, students' depth of critical thinking skills increased gradually across the six activities, and second that three processing patterns of critical thinking skills emerged: Recognise -> Understand, Evaluate -> Recognise and Create -> Understand. This suggests that students typically identified certain issues with supporting facts and criticised opposing arguments, while also proposing creative ideas during the debates. Lastly, the interviews showed the AM-supported online group debates were appreciated. The online environment provided ample time for students to express their thoughts, while the AMs encouraged clear articulation of arguments. Several implications were highlighted based on these findings. Instructors should provide timely feedback during students' debate, the number of debate topics should be appropriate, and the value of professional knowledge and debating skills should be emphasized.
Investigating Unprompted and Prompted Diagrams Generated by Physics MajorsDuring Problem Solving

Michael Vignal,Bethany R. Wilcox

DOI: https://doi.org/10.48550/arXiv.2106.07765

2021-06-14

Physics Education

Abstract:Diagrams are ubiquitous in physics, especially in physics education and physics problem solving. Problem solvers may generate diagrams to orient to a scenario, to organize information, to directly extract an answer, or as a tool of communication. In this study, we interviewed 19 undergraduate and graduate physics majors, asking them to solve 18 multiple-choice physics problems -- with no prompting regarding diagrams -- and then six diagramming tasks of situations similar to six of the multiple-choice problems. By comparing spontaneously generated and prompted diagrams, we identify different diagramming elements and features used by physics majors acting towards different ends (\textit{i.e.,} in different epistemic frames). We found that different physical contexts impact how critical it is to draw an accurate diagram, and that the differences in diagramming between cohorts (\textit{e.g.}, between lower-division undergraduate and graduate students) seem to be smaller than the differences within a cohort. We also explore implications for teaching and research.
An Open-source WYSIWYG Web Application for Drawing Path Diagrams of Structural Equation Models

Yujiao Mai,Ziqian Xu,Zhiyong Zhang,Ke-Hai Yuan

DOI: https://doi.org/10.1080/10705511.2022.2101460

2022-08-19

Structural Equation Modeling

Abstract:Structural equation modeling (SEM) is widely used in behavioral, social, and education research. Drawing publication-ready path diagrams for SEM is not a pleasant task with the existing software. The article introduces an open-source web-based graphical application, semdiag , for drawing WYSIWYG SEM path diagrams interactively. The application is an on-going project developed by the authors using JavaScript, and it can be used in major web browsers, both online and offline. Several examples are provided to demonstrate how to use the application.
Systematic teaching of UML and behavioral diagrams

Anja Metzner

DOI: https://doi.org/10.1109/CSEET62301.2024.10663036

2024-10-23

Abstract:When studying software engineering, learning to create UML diagrams is crucial. Similar to how an architect would never build a house without a building plan, designing software architectures is important for developing high-quality software. UML diagrams are a standardized notation for the visualization of software architectures and software behavior. The research question that inspired this work was how to effectively evaluate hand-drawn diagrams without relying on model parsers. The findings of this investigation are presented in this paper. This article discusses the systematic acquisition of skills required for creating UML diagrams. Especially well-formed activity diagrams are one highlight. Additionally, the paper provides a variety of exercises. The exercises use recommended question types. The more unusual question types are related to images, such as questions about image annotation, finding hotspots on an image and positioning a target on an image. All the demonstrated exercises are suitable for both digital and handwritten training or exams.

Software Engineering
Gamification of In-Classroom Diagram Design for Science Students

Andreas Mallas,Michalis Xenos

DOI: https://doi.org/10.48550/arXiv.1910.05327

IF: 6.4588

2019-10-11

Human-Computer Interaction

Abstract:Merging the content of learning with the motivation of games can be a successful combination, if done properly and supported by the appropriate tool. Towards this goal, we developed Diagramatic an environment used to gamify the in-classroom activity of designing diagrams during a lecture. Using Diagramatic the professor, instead of lecturing about diagrams or showing examples of such diagrams, can design short games where the students could play by competing during the lecture. Diagramatic is a complete environment offering to the professor a design application to create games and a management application. The management application is used for monitoring the games while students play, as well as to present the results to the students after the end of each game, or to evaluate these results after classroom time. The students may use the mobile application on their mobiles to practice by designing diagrams outside of the classroom, as well as to play a game during classroom time, but only after the professor starts this game. The environment handles the communication from students' mobiles to the professor's applications and vice versa, while the students submit their diagrams or receive the correct ones, so to proceed to follow up games. The current version of Diagramatic is tailored for designing flow graphs used for path testing into a higher education software engineering course, but the environment can be used in any similar case requiring the design of diagrams (e.g. math, physics, chemistry).
Drawing to learn: How producing graphical representations enhances scientific thinking.

Judith E. Fan

DOI: https://doi.org/10.1037/tps0000037

2015-06-01

Translational Issues in Psychological Science

Abstract:When we understand something, we say that we “see” it. We arrive at the solution to a problem through “insight.” Such metaphors likening cognitive processes to visual experience suggest a close correspondence between how we think about and how we see the world. Accordingly, major theoretical advances in the sciences have been frequently accompanied by the development of novel visualization tools and graphical conventions (e.g., the periodic table). Today, knowing how to make a graph is a critical component of any practicing scientist’s repertoire, allowing her to gain insight when exploring a complex data set, and to communicate empirical findings to other scientists and the public. This paper reviews evidence from the cognitive science and educational research literatures that bears on the question of how drawing, the most basic visualization technique, interacts with cognitive functions that are core to scientific thinking, including: observation, problem-solving, explanation, and communication. Expanding the role of graphical literacy in science education may carry the potential to better reveal to students the dynamic and inquiry-based nature of scientific thinking, especially in contexts where visual representations have traditionally been subordinate to linguistic and numerical representations.
A Picture Is Worth a Thousand Words: Exploring Diagram and Video-Based OOP Exercises to Counter LLM Over-Reliance

Bruno Pereira Cipriano,Pedro Alves,Paul Denny

DOI: https://doi.org/10.48550/arXiv.2403.08396

2024-03-13

Software Engineering

Abstract:Much research has highlighted the impressive capabilities of large language models (LLMs), like GPT and Bard, for solving introductory programming exercises. Recent work has shown that LLMs can effectively solve a range of more complex object-oriented programming (OOP) exercises with text-based specifications. This raises concerns about academic integrity, as students might use these models to complete assignments unethically, neglecting the development of important skills such as program design, problem-solving, and computational thinking. To address this, we propose an innovative approach to formulating OOP tasks using diagrams and videos, as a way to foster problem-solving and deter students from a copy-and-prompt approach in OOP courses. We introduce a novel notation system for specifying OOP assignments, encompassing structural and behavioral requirements, and assess its use in a classroom setting over a semester. Student perceptions of this approach are explored through a survey (n=56). Generally, students responded positively to diagrams and videos, with video-based projects being better received than diagram-based exercises. This notation appears to have several benefits, with students investing more effort in understanding the diagrams and feeling more motivated to engage with the video-based projects. Furthermore, students reported being less inclined to rely on LLM-based code generation tools for these diagram and video-based exercises. Experiments with GPT-4 and Bard's vision abilities revealed that they currently fall short in interpreting these diagrams to generate accurate code solutions.
Drawing-to-Learn: A Framework for Using Drawings to Promote Model-Based Reasoning in Biology

Kim Quillin,Stephen Thomas

DOI: https://doi.org/10.1187/cbe.14-08-0128

2015-03-02

CBE—Life Sciences Education

Abstract:The drawing of visual representations is important for learners and scientists alike, such as the drawing of models to enable visual model-based reasoning. Yet few biology instructors recognize drawing as a teachable science process skill, as reflected by its absence in the Vision and Change report’s Modeling and Simulation core competency. Further, the diffuse research on drawing can be difficult to access, synthesize, and apply to classroom practice. We have created a framework of drawing-to-learn that defines drawing, categorizes the reasons for using drawing in the biology classroom, and outlines a number of interventions that can help instructors create an environment conducive to student drawing in general and visual model-based reasoning in particular. The suggested interventions are organized to address elements of affect, visual literacy, and visual model-based reasoning, with specific examples cited for each. Further, a Blooming tool for drawing exercises is provided, as are suggestions to help instructors address possible barriers to implementing and assessing drawing-to-learn in the classroom. Overall, the goal of the framework is to increase the visibility of drawing as a skill in biology and to promote the research and implementation of best practices.
Problem-appropriate diagram instruction for improving mathematical word problem solving

Hiroaki Ayabe,Emmanuel Manalo,Erica de Vries

DOI: https://doi.org/10.3389/fpsyg.2022.992625

2022-10-03

Abstract:The use of diagrams can be effective in solving mathematical word problems solving. However, students worldwide do not construct diagrams unprompted or have trouble using them. In the present study, the effects of problem-appropriate diagram use instruction were investigated with an adaptation of the multiple baseline design method. The instruction for using line diagrams, tables, and graphs was provided to 67 junior high school students in a staggered manner and the effects on problem solving of three different types of problems was examined. The results showed that use of problem-appropriate diagrams increased and persisted over time. More importantly, the instruction led to increases in problem solving performance and to decreases in perceived cognitive load. These findings support the argument that effective diagram use depends on the acquisition not only of declarative knowledge, but also sufficient procedural and conditional knowledge.
Drawing-to-Learn: Does Meta-Analysis Show Differences Between Technology-Based Drawing and Paper-and-Pencil Drawing?

Jennifer G. Cromley,Yang Du,Aygul Parpucu Dane

DOI: https://doi.org/10.1007/s10956-019-09807-6

2019-12-21

Journal of Science Education and Technology

Abstract:Drawing-to-learn is a specific learning/reading strategy studied across many domains. In response to gaps in our knowledge about drawing-to-learn, we conducted a systematic meta-analysis of the literature published since the influential 2005 Van Meter and Garner literature review. We analyzed the benefits of directed learner-generated visual representations such as sketching, drawing, or computer-assisted creation of a full or partial static image. Forty-one peer-reviewed articles were screened in, together with 9 dissertations and 2 other documents; published from 2005 to 2018, these included 53 studies and 166 effects based on 8111 participants. The overall effect of drawing-to-learn across all dependent variable types (factual, inferential, and transfer) and both types of effects—comparing different types of drawing and comparing drawing to non-drawing conditions—was a significant g = 0.69. The overall effect was significant but differed across outcomes (g = 0.85 for factual, g = 0.44 for inferential, and g = 0.22 for transfer). Analyses across 6 moderators are presented. Not only does the literature continue to show that drawing-to-learn is better than the status quo, but directed drawing improves factual as well as inferential and transfer learning. Finally, researchers have found ways to improve drawing-to-learn instruction so that it can be even more effective than the simple directive to make a drawing.

education & educational research,education, scientific disciplines
Hand-drawn Electric Circuit Diagram Understanding Using 2D Dynamic programming

Guihuan Feng,Zhengxing Sun,Christian Viard-Gaudin

2008-01-01

Abstract:A difficult task of a sketch understanding system is that it should always try to balance between the drawing freedom and the complexity of recognition. Most online existing works are based on the assumption that people will not start to draw a new symbol before the last one has been finished. As obviously it is not always the case, we propose in this paper a method which relaxes this constraint. The proposed methodology relies on a twodimensional dynamic programming technique (2D-DP) allowing symbol hypothesis generation, which can correctly locate symbols even when they are drawn temporally overlapped with each other. A neural network classifier, embedded in the 2D-DP, is used to label each hypothesis. Besides, tolerant connectivity constraints are introduced to help increasing the performance as well as the efficiency. Experiments show that this novel approach achieves an accuracy of more than 90 percent.
Effects of student-generated drawing and imagination on science text reading in a computer-based learning environment

Li Cheng,Carole R. Beal

DOI: https://doi.org/10.1007/s11423-019-09684-1

2019-06-27

Educational Technology Research and Development

Abstract:The purpose of this study was to examine the effects of student-generated drawing and imagination on learning recall, learning transfer, and cognitive load, and also students' attitudes towards the learning strategies when learning a computer-based science text, compared to learning with provided pictures. The study used three groups: drawing group, imagining group, and picture group (control). A total of 82 undergraduate students from a southeast university in the United States participated in this study. Results indicated there were no significant differences in the learning recall and transfer of the three groups overall; however, students' prior knowledge and spatial ability were positively and significantly correlated with their learning recall and transfer. When spatial ability was high, students in the drawing group had significantly higher learning recall than students in the imagining group; and students in the imagining group had significantly higher learning transfer than students in the picture group. The drawing group had significantly higher cognitive load than the picture group. Students perceived drawing, imagining, and reading with pictures for learning as useful and there were no significant differences in their perceived usefulness among the three groups, but students were more intended to learn with provided pictures than to generate drawings. Discussions and implications are provided.
Sketches and Diagrams in Practice

Sebastian Baltes,Stephan Diehl

DOI: https://doi.org/10.48550/arXiv.1706.09172

2017-06-28

Software Engineering

Abstract:Sketches and diagrams play an important role in the daily work of software developers. In this paper, we investigate the use of sketches and diagrams in software engineering practice. To this end, we used both quantitative and qualitative methods. We present the results of an exploratory study in three companies and an online survey with 394 participants. Our participants included software developers, software architects, project managers, consultants, as well as researchers. They worked in different countries and on projects from a wide range of application areas. Most questions in the survey were related to the last sketch or diagram that the participants had created. Contrary to our expectations and previous work, the majority of sketches and diagrams contained at least some UML elements. However, most of them were informal. The most common purposes for creating sketches and diagrams were designing, explaining, and understanding, but analyzing requirements was also named often. More than half of the sketches and diagrams were created on analog media like paper or whiteboards and have been revised after creation. Most of them were used for more than a week and were archived. We found that the majority of participants related their sketches to methods, classes, or packages, but not to source code artifacts with a lower level of abstraction.
Automated Diagram Generation to Build Understanding and Usability

William Schoenberg

DOI: https://doi.org/10.48550/arXiv.2006.08343

2020-05-28

Abstract:Causal loop and stock and flow diagrams are broadly used in System Dynamics because they help organize relationships and convey meaning. Using the analytical work of Schoenberg (2019) to select what to include in a compressed model, this paper demonstrates how that information can be clearly presented in an automatically generated causal loop diagram. The diagrams are generated using tools developed by people working in graph theory and the generated diagrams are clear and aesthetically pleasing. This approach can also be built upon to generate stock and flow diagrams. Automated stock and flow diagram generation opens the door to representing models developed using only equations, regardless or origin, in a clear and easy to understand way. Because models can be large, the application of grouping techniques, again developed for graph theory, can help structure the resulting diagrams in the most usable form. This paper describes the algorithms developed for automated diagram generation and shows a number of examples of their uses in large models. The application of these techniques to existing, but inaccessible, equation-based models can help broaden the knowledge base for System Dynamics modeling. The techniques can also be used to improve layout in all, or part, of existing models with diagrammatic informtion.

Artificial Intelligence
Teaching Interaction using State Diagrams

Padma Pasupathi,Christopher W. Schankula,Nicole DiVincenzo,Sarah Coker,Christopher Kumar Anand

DOI: https://doi.org/10.48550/arXiv.2207.12701

2022-07-26

Computers and Society

Abstract:To make computational thinking appealing to young learners, initial programming instruction looks very different now than a decade ago, with increasing use of graphics and robots both real and virtual. After the first steps, children want to create interactive programs, and they need a model for this. State diagrams provide such a model. This paper documents the design and implementation of a Model-Driven Engineering tool, SD Draw, that allows even primary-aged children to draw and understand state diagrams, and create modifiable app templates in the Elm programming language using the model-view-update pattern standard in Elm programs. We have tested this with grade 4 and 5 students. In our initial test, we discovered that children quickly understand the motivation and use of state diagrams using this tool, and will independently discover abstract states even if they are only taught to model using concrete states. To determine whether this approach is appropriate for children of this age we wanted to know: do children understand state diagrams, do they understand the role of reachability, and are they engaged by them? We found that they are able to translate between different representations of state diagrams, strongly indicating that they do understand them. We found with confidence p<0.001 that they do understand reachability by refuting the null hypothesis that they are creating diagrams randomly. And we found that they were engaged by the concept, with many students continuing to develop their diagrams on their own time after school and on the weekend.
Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies

Andrew Mason,Chandralekha Singh

DOI: https://doi.org/10.1063/1.3515243

2016-02-20

Abstract:We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

Physics Education

To Draw or Not to Draw? Examining the Necessity of Problem Diagrams Using Massive Open Online Course Experiments

To use or no to use diagrams: The effect of drawing a diagram in solving introductory physics problems

Do students benefit from drawing productive diagrams themselves while solving introductory physics problems? The case of two electrostatic problems

Learning by drawing: When is it worth the time and effort?

Exploring College Students’ Depth and Processing Patterns of Critical Thinking Skills and Their Perception in Argument Map(am)-Supported Online Group Debate Activities

Investigating Unprompted and Prompted Diagrams Generated by Physics MajorsDuring Problem Solving

An Open-source WYSIWYG Web Application for Drawing Path Diagrams of Structural Equation Models

Systematic teaching of UML and behavioral diagrams

Gamification of In-Classroom Diagram Design for Science Students

Drawing to learn: How producing graphical representations enhances scientific thinking.

A Picture Is Worth a Thousand Words: Exploring Diagram and Video-Based OOP Exercises to Counter LLM Over-Reliance

Drawing-to-Learn: A Framework for Using Drawings to Promote Model-Based Reasoning in Biology

Problem-appropriate diagram instruction for improving mathematical word problem solving

Drawing-to-Learn: Does Meta-Analysis Show Differences Between Technology-Based Drawing and Paper-and-Pencil Drawing?

Hand-drawn Electric Circuit Diagram Understanding Using 2D Dynamic programming

Effects of student-generated drawing and imagination on science text reading in a computer-based learning environment

Sketches and Diagrams in Practice

Automated Diagram Generation to Build Understanding and Usability

Teaching Interaction using State Diagrams

Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies