Abstract:Objective: The human-machine feedback in a smart learning environment can influences learners' learning styles, ability enhancement, and affective interactions. However, whether it has stability in improving learning performance and learning processes, the findings of many empirical studies are controversial. This study aimed to analyze the effect of human-machine feedback on learning performance and the potential boundary conditions that produce the effect in a smart learning environment. Methods: Web of Science, EBSCO, PsycINFO, and Science Direct were searched for publications from 2010 to 2022. We included randomized controlled trials with learning performance as outcome. The random effects model was used in the meta-analysis. The main effect tests and the heterogeneity tests were used to evaluate the effect of human-machine feedback mechanism on learning performance, and the boundary conditions of the effect were tested by moderating effects. Moreover, the validity of the meta-analysis was proved by publication bias test. Results: Out of 35 articles identified, 2,222 participants were included in this study. Human-machine interaction feedback had significant effects on learners' learning process ( d = 0.594, k = 26) and learning outcomes ( d = 0.407, k = 42). Also, the positive effects of human-machine interaction feedback were regulated by the direction of feedback, the form of feedback, and the type of feedback technique. Conclusion: To enhance learning performance through human-machine interactive feedback, we should focus on using two-way and multi-subject feedback. The technology that can provide emotional feedback and feedback loops should be used as a priority. Also, pay attention to the feedback process and mechanism, avoid increasing students' dependence on machines, and strengthen learners' subjectivity from feedback mechanism.

Effects of Different AI-driven Chatbot Feedback on Learning Outcomes and Brain Activity

Can interaction with generative artificial intelligence enhance learning autonomy? A longitudinal study from comparative perspectives of virtual companionship and knowledge acquisition preferences

A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education

Effects of the use of a conversational artificial intelligence chatbot on medical students’ patient-centered communication skill development in a metaverse environment

Conversation Technology With Micro-Learning: The Impact of Chatbot-Based Learning on Students’ Learning Motivation and Performance

Teacher support and student motivation to learn with Artificial Intelligence (AI) based chatbot

A meta-analysis on the comparative effects of AI chatbot utilization in English education programs

Animated Pedagogical Agents Enhance Learning Outcomes and Brain Activity During Learning.

The promises and challenges of AI-based chatbots in language education through the lens of learner emotions

Effects of Explaining a Science Lesson to Others or to Oneself: A Cognitive Neuroscience Approach

An empirical study of the efficacy of AI chatbots for English as a foreign language learning in primary education

Can human-machine feedback in a smart learning environment enhance learners' learning performance? A meta-analysis

Using AI-driven chatbots to foster Chinese EFL students' academic engagement: An intervention study

Future English Learning: Chatbots and Artificial Intelligence

The Impact of Emotional Feedback and Elaborated Feedback of a Pedagogical Agent on Multimedia Learning

The Impact of AI-Assisted Teaching on Students' Learning and Psychology

AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education

Effects of Artificial Intelligence-Powered Virtual Agents on Learning Outcomes in Computer-Based Simulations: A Meta-Analysis

AI Intelligence Chatbot to Improve Students Learning in the Higher Education Platform

Enhancing Students' Metacognition via AI-Driven Educational Support Systems