Luis Morales-Navarro,Deborah A. Fields,Yasmin B. Kafai,Deepali Barapatre
Abstract:Purpose: The purpose of this paper is to examine how a clinical interview protocol with failure artifact scenarios can capture changes in high school students' explanations of troubleshooting processes in physical computing activities. We focus on physical computing since finding and fixing hardware and software bugs is a highly contextual practice that involves multiple interconnected domains and skills. Approach: We developed and piloted a "failure artifact scenarios" clinical interview protocol. Youth were presented with buggy physical computing projects over video calls and asked for suggestions on how to fix them without having access to the actual project or its code. We applied this clinical interview protocol before and after an eight-week-long physical computing (more specifically, electronic textiles) unit. We analyzed matching pre- and post-interviews from 18 students at four different schools. Findings: Our findings demonstrate how the protocol can capture change in students' thinking about troubleshooting by eliciting students' explanations of specificity of domain knowledge of problems, multimodality of physical computing, iterative testing of failure artifact scenarios, and concreteness of troubleshooting and problem solving processes. Originality: Beyond tests and surveys used to assess debugging, which traditionally focus on correctness or student beliefs, our "failure artifact scenarios" clinical interview protocol reveals student troubleshooting-related thinking processes when encountering buggy projects. As an assessment tool, it may be useful to evaluate the change and development of students' abilities over time.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: How to evaluate the changes in high school students' understanding and thinking patterns in the troubleshooting process in physical computing (especially e - textiles).
Specifically, the authors developed and piloted a "fault artifact scenario" clinical interview protocol to capture the changes in students' thinking patterns when dealing with troubleshooting in physical computing. Through this protocol, researchers hope to understand how students interpret domain - specific knowledge, multi - modal physical computing, iterative test - fault scenarios, and specific troubleshooting and problem - solving processes when they encounter faulty items.
### Core issues of the paper
1. **Innovation of evaluation tools**: Traditional evaluation methods such as tests and surveys usually only focus on the correctness of debugging or students' beliefs. However, this paper proposes a new evaluation tool - the "fault artifact scenario" clinical interview protocol, which aims to reveal students' troubleshooting thinking processes when facing faulty items.
2. **Capturing changes in students' thinking**: The focus of the research is to capture the changes in students' troubleshooting thinking patterns before and after the physical computing course through the clinical interview protocol. This includes how students can more specifically describe possible faults, consider multiple potential causes, and troubleshoot between different domains (code and circuit).
3. **Multi - domain troubleshooting ability**: Physical computing involves the interaction between hardware and software, so troubleshooting is not limited to programming errors, but also involves electronics and other physical aspects. The paper explores the development of students' troubleshooting abilities in these multi - domains.
### Research background
- **Importance of troubleshooting**: Troubleshooting is a key skill in computing practice, especially in physical computing, where students need to consider both code and hardware problems.
- **Limitations of existing evaluation tools**: Existing evaluation tools are often limited to specific domains or situations and cannot comprehensively evaluate students' troubleshooting abilities in physical computing.
- **Complexity of multi - domain interaction**: Troubleshooting in physical computing involves knowledge and skills in multiple domains, such as coding, circuit design, etc., which places higher requirements on students.
### Methods and findings
- **Research method**: Researchers developed a clinical interview protocol, showed students physical computing projects with faults, and asked them to propose repair suggestions. By comparing students' performance before and after the course, they analyzed the changes in their thinking patterns.
- **Main findings**:
- After the course, students were able to better describe possible faults across domains (code and circuit).
- They considered more multiple potential causes instead of a single cause.
- When describing possible faults, they were more specific and provided more detailed solutions.
In conclusion, through the innovative evaluation tool, this paper reveals the development of students' troubleshooting abilities in physical computing, providing educators with an effective method to evaluate and promote students' troubleshooting thinking.