AI and Education: An Investigation into the Use of ChatGPT for Systems Thinking

Holger Arndt

2023-07-26

Abstract:This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy, helpfulness, and reliability of ChatGPT's responses across different versions of the tool. The results indicate that ChatGPT can provide largely correct and very helpful responses in various subjects, demonstrating its potential as a tool for enhancing ST skills. However, occasional inaccuracies highlight the need for users to remain critical of ChatGPT's responses. Despite some limitations, this study suggests that with careful use and attention to its idiosyncrasies, ChatGPT can be a valuable tool for teaching and learning ST.

Human-Computer Interaction,Artificial Intelligence,Computers and Society

What problem does this paper attempt to address?

The paper aims to explore the potential and application of ChatGPT as an artificial intelligence tool in supporting Systems Thinking (ST) education. Specifically, the study evaluates the effectiveness of ChatGPT in enhancing students' systems thinking abilities through a series of experiments and case analyses, with the assistance of different versions and plugins. The main focus areas include:

1. **Answer Misleadingness**: Assessing whether the answers provided by ChatGPT are prone to causing misunderstandings when learning systems thinking, ensuring their reliability and accuracy.
2. **Enhancing Systems Thinking Elements**: Investigating how and to what extent ChatGPT can enhance the eight systems thinking elements proposed by Arnold and Wade (2015), including identifying connections, understanding feedback mechanisms, etc.
3. **Learning and Creating Causal Loop Diagrams (CLD)**: Exploring whether ChatGPT can effectively help students understand and draw causal loop diagrams, which are an important tool in systems thinking.
4. **Learning and Modeling System Dynamics (SD)**: Examining ChatGPT's performance in teaching system dynamics and its modeling.
5. **Performance Differences Between Versions**: Comparing the differences between GPT 3.5, GPT 4, and GPT 4 with plugins to determine if there are significant improvements.
6. **Answer Reliability**: Testing whether ChatGPT's responses to the same question are consistent over multiple attempts, evaluating its stability as an educational tool.

The research results indicate that despite some limitations, such as occasional technical errors or fluctuations in answer quality, ChatGPT can generally provide accurate and useful information that helps students understand and apply systems thinking concepts. Additionally, the paper emphasizes the importance of critical thinking, reminding teachers and students to approach ChatGPT's answers with caution and encouraging the use of its interactive and personalized features to promote autonomous learning.