Abstract:In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs) and chatbots into graduate engineering education. We begin by tracing historical and technological disruptions to provide context and then introduce key terms such as machine learning and deep learning and the underlying mechanisms of recent advancements, namely attention/transformer models and graphics processing units. The heart of our investigation lies in the application of an LLM-based chatbot in a graduate fluid mechanics course. We developed a question bank from the course material and assessed the chatbot's ability to provide accurate, insightful responses. The results are encouraging, demonstrating not only the bot's ability to effectively answer complex questions but also the potential advantages of chatbot usage in the classroom, such as the promotion of self-paced learning, the provision of instantaneous feedback, and the reduction of instructors' workload. The study also examines the transformative effect of intelligent prompting on enhancing the chatbot's performance. Furthermore, we demonstrate how powerful plugins like Wolfram Alpha for mathematical problem-solving and code interpretation can significantly extend the chatbot's capabilities, transforming it into a comprehensive educational tool. While acknowledging the challenges and ethical implications surrounding the use of such AI models in education, we advocate for a balanced approach. The use of LLMs and chatbots in graduate education can be greatly beneficial but requires ongoing evaluation and adaptation to ensure ethical and efficient use.

Research on the Application of Large Language Models in Automatic Question Generation: A Case Study of ChatGLM in the Context of High School Information Technology Curriculum

Application of Large Language Models in Automated Question Generation: A Case Study on ChatGLM's Structured Questions for National Teacher Certification Exams

Comparison of Large Language Models for Generating Contextually Relevant Questions

Dr.Academy: A Benchmark for Evaluating Questioning Capability in Education for Large Language Models

ChatGPT-Aided Education Teaching

Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students

How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzes

Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluation

The Future of Learning in the Age of Generative AI: Automated Question Generation and Assessment with Large Language Models

The Future of Learning: Large Language Models through the Lens of Students

How Useful are Educational Questions Generated by Large Language Models?

Investigating the Efficacy of ChatGPT-3.5 for Tutoring in Chinese Elementary Education Settings

Automatic Lesson Plan Generation Via Large Language Models with Self-critique Prompting

Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course

Large Language Model-Driven Classroom Flipping: Empowering Student-Centric Peer Questioning with Flipped Interaction

Can Large Language Models Make the Grade? An Empirical Study Evaluating LLMs Ability to Mark Short Answer Questions in K-12 Education

Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education

Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education

Large Language Models in Education: A Systematic Review

Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges

An Investigation of Applying Large Language Models to Spoken Language Learning