PapagAI:Automated Feedback for Reflective Essays

Veronika Solopova,Adrian Gruszczynski,Eiad Rostom,Fritz Cremer,Sascha Witte,Chengming Zhang,Fernando Ramos López Lea Plößl,Florian Hofmann,Ralf Romeike,Michaela Gläser-Zikuda,Christoph Benzmüller,Tim Landgraf

DOI: https://doi.org/10.48550/arXiv.2307.07523

2023-07-10

Abstract:Written reflective practice is a regular exercise pre-service teachers perform during their higher education. Usually, their lecturers are expected to provide individual feedback, which can be a challenging task to perform on a regular basis. In this paper, we present the first open-source automated feedback tool based on didactic theory and implemented as a hybrid AI system. We describe the components and discuss the advantages and disadvantages of our system compared to the state-of-art generative large language models. The main objective of our work is to enable better learning outcomes for students and to complement the teaching activities of lecturers.

Artificial Intelligence,Computation and Language

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: in the German education system, the high dropout rate of teacher trainees and the shortage of teachers. Part of the reason is that the current learning environment fails to fully support these future teachers in carrying out effective reflective exercises during their learning process. To alleviate this problem, the paper proposes an open - source automated feedback tool based on teaching theory - PapagAI. This tool aims to improve students' reflective writing by providing personalized automatic feedback, thereby enhancing students' learning outcomes and reducing the pressure on lecturers to provide regular individual feedback.

Specifically, the PapagAI platform allows students to write reflections and receive feedback from peers, lecturers, and a dedicated chatbot. The platform combines machine learning (ML) and symbolic components, adopting a hybrid artificial intelligence (hybrid AI) approach. It creates text and user profiles through multiple natural language understanding modules, and then, based on these profiles, the rule - based reasoner selects appropriate instructions.

In summary, the main goal of PapagAI is to help students better carry out reflective exercises through an automated feedback mechanism, while assisting lecturers' teaching activities, thereby improving the quality and efficiency of education.