Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation

Wanli Xing,Hee-Sun Lee,Antonette Shibani

DOI: https://doi.org/10.1007/s11423-020-09761-w

2020-03-16

Educational Technology Research and Development

Abstract:Constructing scientific arguments is an important practice for students because it helps them to make sense of data using scientific knowledge and within the conceptual and experimental boundaries of an investigation. In this study, we used a text mining method called Latent Dirichlet Allocation (LDA) to identify underlying patterns in students written scientific arguments about a complex scientific phenomenon called Albedo Effect. We further examined how identified patterns compare to existing frameworks related to explaining evidence to support claims and attributing sources of uncertainty. LDA was applied to electronically stored arguments written by 2472 students and concerning how decreases in sea ice affect global temperatures. The results indicated that each content topic identified in the explanations by the LDA— "data only," "reasoning only," "data and reasoning combined," "wrong reasoning types," and "restatement of the claim"—could be interpreted using the claim–evidence–reasoning framework. Similarly, each topic identified in the students' uncertainty attributions— "self-evaluations," "personal sources related to knowledge and experience," and "scientific sources related to reasoning and data"—could be interpreted using the taxonomy of uncertainty attribution. These results indicate that LDA can serve as a tool for content analysis that can discover semantic patterns in students' scientific argumentation in particular science domains and facilitate teachers' providing help to students.