When Not to Use AI

Ketra Schmitt

DOI: https://doi.org/10.1109/mts.2024.3402708

2024-06-25

IEEE Technology and Society Magazine

Abstract:Large Language Models (LLMs) have emerged as a disruptive force. While artifical intelligence (AI)-generated responses can include text, images, code, and other materials, here, we largely focus on the challenges posed by text generation in educational settings and the workplace.

engineering, electrical & electronic

What problem does this paper attempt to address?

How Should College Education Respond to Large Language Models?

Charles La Shure,

DOI: https://doi.org/10.52723/jkl.48.007

2023-11-30

The Society Of Korean Literature

Abstract:The release of ChatGPT to the public at the end of last year had many in the field of education worried. In response, this paper explored the future of college education and artificial intelligence (AI). First, a proper understanding of how large language models (LLMs) “train” and “learn,” along with their abilities and limitations, was established. Simply put, while LLMs produce plausible linguistic output, they are “stochastic parrots” that have no actual understanding of language. Next, we examined the dangers of generative AI and discovered that they might help in the creation and dissemination of misinformation. Even if these AI are not used with malicious intent, the fact that their training data sets are drawn from the internet—which reflects majority thinking—means that they can perpetuate and amplify social inequality and hegemonic stereotypes and biases. On the other hand, if we consider what is missing from the training data, it is only natural that marginalized voices should be even more marginalized. In addition, leaving the issue of the socially vulnerable aside, LLMs can only be trained on digital data, meaning analog data is ignored. This is in line with the idea of “the destruction of history” put forth by Joseph Weizenbaum, an early critic who warned of the dangers of artificial intelligence. We then discussed the relationship between humans and machines and considered which relationships were problematic and which were desirable. Researchers in the aviation industry recognized the problem of automation bias from an early date, but this phenomenon can be seen in other areas of society as well. Put simply, if a human places too much trust in a machine, they abdicate their decision-making responsibility to that machine and thus fail to respond quickly to solve any problems that may arise should that machine malfunction. LLMs do not endanger lives in the same way that airplanes do, but a similar bias can be seen with them as well. A more important issue, though, is the fact that people are no longer seen as whole human beings but as computers. This tendency was evident long before the advent of computers, for example in the attempts to quantify human intelligence through IQ tests, but it is a problem we must be particularly wary of in the age of AI. Lastly, we considered means for college education to find its way in the present situation. Educators in the US in particular, while dealing with ChatGPT, have pinpointed not the LLMs themselves but the “transactional nature” of education as the problem. That is, they argue that education has long since become less a process of learning and more a transaction in which students receive grades and degrees. Given this transactional environment, it is no wonder that student would rely too much on ChatGPT. This over-reliance, however, comes with side effects: not learning how to think properly, a lack of sufficient academic information, and learning an AI-based writing style. In response, US educators have proposed both “stick” (strategies that make it difficult for students to use LLMs) and “carrot” (strategies that encourage students to learn like human beings, not algorithms) solutions, but the heart of the matter seems to be a sense of responsibility. Creating an educational environment in which students can develop a sense of responsibility for themselves is the path forward for education in the age of AI. If we do this, LLMs can become a useful tool rather than an enemy to fear.
AI Meets the Classroom: When Does ChatGPT Harm Learning?

Matthias Lehmann,Philipp B. Cornelius,Fabian J. Sting

2024-08-30

Abstract:In this paper, we study how generative AI and specifically large language models (LLMs) impact learning in coding classes. We show across three studies that LLM usage can have positive and negative effects on learning outcomes. Using observational data from university-level programming courses, we establish such effects in the field. We replicate these findings in subsequent experimental studies, which closely resemble typical learning scenarios, to show causality. We find evidence for two contrasting mechanisms that determine the overall effect of LLM usage on learning. Students who use LLMs as personal tutors by conversing about the topic and asking for explanations benefit from usage. However, learning is impaired for students who excessively rely on LLMs to solve practice exercises for them and thus do not invest sufficient own mental effort. Those who never used LLMs before are particularly prone to such adverse behavior. Students without prior domain knowledge gain more from having access to LLMs. Finally, we show that the self-perceived benefits of using LLMs for learning exceed the actual benefits, potentially resulting in an overestimation of one's own abilities. Overall, our findings show promising potential of LLMs as learning support, however also that students have to be very cautious of possible pitfalls.

Computers and Society,Artificial Intelligence,Human-Computer Interaction,Machine Learning
LARGE LANGUAGE MODEL-BASED ARTIFICIAL INTELLIGENCE IN THE LANGUAGE CLASSROOM: PRACTICAL IDEAS FOR TEACHING

Euan Bonner,Ryan Lege,Erin Frazier

DOI: https://doi.org/10.56297/bkam1691/wieo1749

Abstract:Large Language Models (LLMs) are a powerful type of Artificial Intelligence (AI) that simulates how humans organize language and are able to interpret, predict, and generate text. This allows for contextual understanding of natural human language which enables the LLM to understand conversational human input and respond in a natural manner. Recent examples of this, such as the Generative Pre-Trained Transformer (GPT) model, popularized by OpenAI’s web application, ChatGPT, are able to complete an astounding variety of tasks when provided with simple language input. For education, LLMs can alleviate teacher curriculum and grading workloads and even perform specific tasks such as generating creative ideas for activities. Specifically for language learning, LLMs can draw on their immense corpus of language content to generate learner-centric materials to aid teachers in delivering targeted, personalized language instruction. The aim of this paper is to provide the reader with examples of how LLMs can be utilized for materials development, classroom activities, and providing feedback. After giving specific examples and explanations, the paper will conclude with a discussion of how this technology can provide teachers with new innovative ways to streamline the teaching process to focus on learner needs.

Linguistics,Education,Computer Science
Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students

Tiffany Zhu,Kexun Zhang,William Yang Wang

2024-11-28

Abstract:The impressive essay writing and problem-solving capabilities of large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education. Our goal is to gain insights into the widespread use of LLMs among secondary students to inform their future development. Despite school restrictions, our survey of over 300 middle and high school students revealed that a remarkable 70% of students have utilized LLMs, higher than the usage percentage among young adults, and this percentage remains consistent across 7th to 12th grade. Students also reported using LLMs for multiple subjects, including language arts, history, and math assignments, but expressed mixed thoughts on their effectiveness due to occasional hallucinations in historical contexts and incorrect answers for lack of rigorous reasoning. The survey feedback called for LLMs better adapted for students, and also raised questions to developers and educators on how to help students from underserved communities leverage LLMs' capabilities for equal access to advanced education resources. We propose a few ideas to address such issues, including subject-specific models, personalized learning, and AI classrooms.

Human-Computer Interaction,Artificial Intelligence
The Future of Learning in the Age of Generative AI: Automated Question Generation and Assessment with Large Language Models

Subhankar Maity,Aniket Deroy

2024-10-12

Abstract:In recent years, large language models (LLMs) and generative AI have revolutionized natural language processing (NLP), offering unprecedented capabilities in education. This chapter explores the transformative potential of LLMs in automated question generation and answer assessment. It begins by examining the mechanisms behind LLMs, emphasizing their ability to comprehend and generate human-like text. The chapter then discusses methodologies for creating diverse, contextually relevant questions, enhancing learning through tailored, adaptive strategies. Key prompting techniques, such as zero-shot and chain-of-thought prompting, are evaluated for their effectiveness in generating high-quality questions, including open-ended and multiple-choice formats in various languages. Advanced NLP methods like fine-tuning and prompt-tuning are explored for their role in generating task-specific questions, despite associated costs. The chapter also covers the human evaluation of generated questions, highlighting quality variations across different methods and areas for improvement. Furthermore, it delves into automated answer assessment, demonstrating how LLMs can accurately evaluate responses, provide constructive feedback, and identify nuanced understanding or misconceptions. Examples illustrate both successful assessments and areas needing improvement. The discussion underscores the potential of LLMs to replace costly, time-consuming human assessments when appropriately guided, showcasing their advanced understanding and reasoning capabilities in streamlining educational processes.

Computation and Language,Artificial Intelligence
On the application of Large Language Models for language teaching and assessment technology

Andrew Caines,Luca Benedetto,Shiva Taslimipoor,Christopher Davis,Yuan Gao,Oeistein Andersen,Zheng Yuan,Mark Elliott,Russell Moore,Christopher Bryant,Marek Rei,Helen Yannakoudakis,Andrew Mullooly,Diane Nicholls,Paula Buttery

DOI: https://doi.org/10.48550/arXiv.2307.08393

2023-07-17

Computation and Language

Abstract:The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.
Prompting Higher Education Towards AI-Augmented Teaching and Learning Practice

Bronwyn Eager,Ryan Brunton,,

DOI: https://doi.org/10.53761/1.20.5.02

2023-05-29

Journal of University Teaching and Learning Practice

Abstract:Large Language Models (LLMs) and conversational-style generative artificial intelligence (AI) are causing major disruption to higher education pedagogy. The emergence of tools like ChatGPT has raised concerns about plagiarism detection but also presents opportunities for educators to leverage AI to build supportive learning environments. In this commentary, we explore the potential of AI-augmented teaching and learning practice in higher education, discussing both the productive affordances and challenges associated with these technologies. We offer instructional advice for writing instructional text to guide the generation of quality outputs from AI models, as well as a case study to illustrate using AI for assessment design. Ultimately, we suggest that AI should be seen as one tool among many that can be used to enhance teaching and learning outcomes in higher education.
Key Insights for the Ethical and Appropriate Use of Artificial Intelligence by Medical Learners

Brian Patrick Murray,Darshan S Thota,Carrie Baker,Joshua B Stierwalt

DOI: https://doi.org/10.1093/milmed/usae536

2024-11-28

Abstract:Introduction: The rapid advancement and adoption of large language models (LLMs) in various academic domains necessitate an examination of their role in scholarly works by medical learners.This paper seeks to discern the implications of LLM use by medical learners when preparing works for publication. While LLMs possess great potential to revolutionize the academic writing process, they can detract from the learning process when used by students and residents who are still learning how to research, formulate ideas, and write cohesive arguments. Materials and methods: An environmental scan of both traditional evidence-based sources and gray literature was performed to glean best practices of generative AI in medical education. Sources included peer-reviewed journals, open-source websites, and previous publications in this field ranging from 2015 to 2023. Results: We propose several strategies to detect AI involvement: direct inquiry to the learner, assessing the coherence level of the content in contrast to the learner's known capabilities, recognizing patterns of shallow insight or depth, utilizing plagiarism and AI-specific detection tools, and monitoring for fabricated citations-a known pitfall of LLMs. Conclusions: Although LLMs offer potential efficiencies in academic writing, unchecked use can jeopardize the development of essential critical thinking and analytical skills in medical learners. Ultimately, mentors and primary investigators are responsible for ensuring learners are advancing and appropriately utilizing new and emerging technology. This study provides a foundational framework for educators in both responsible use of generative AI and best practices.
Large Language Models and Generative AI, Oh My!

Peter J. Cobb

DOI: https://doi.org/10.1017/aap.2023.20

2023-09-23

Advances in Archaeological Practice

Abstract:Overview We have all read the headlines heralding, often hyperbolically, the latest advances in text- and image-based Artificial Intelligence (AI). What is perhaps most unique about these developments is that they now make relatively good AI accessible to the average Internet user. These new services respond to human prompts, written in natural language, with generated output that appears to satisfy the prompt. Consequently, they are categorized under the term "generative AI," whether they are generating text, images, or other media. They work by modeling human language statistically, to "learn" patterns from extremely large datasets of human-created content, with those that specifically focus on text therefore called Large Language Models (LLMs). As we have all tried products such as ChatGPT or Midjourney over the past year, we have undoubtedly begun to wonder how and when they might impact our archaeological work. Here, I review the state of this type of AI and the current challenges with using it meaningfully, and I consider its potential for archaeologists.
Generative Artificial Intelligence and the Education Sector

Norita Ahmad,San Murugesan,Nir Kshetri

DOI: https://doi.org/10.1109/mc.2023.3263576

2023-05-26

IEEE Computer

Abstract:Large language models (LLMs), such as ChatGPT and now GPT4, are considered a significant breakthrough in conversational artificial intelligence. Academic institutions have varying responses to LLMs in education, some banning LLMs and others encouraging them.
Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine

Stefan Harrer

DOI: https://doi.org/10.1016/j.ebiom.2023.104512

IF: 11.205

2023-04-01

EBioMedicine

Abstract:Large Language Models (LLMs) are a key component of generative artificial intelligence (AI) applications for creating new content including text, imagery, audio, code, and videos in response to textual instructions. Without human oversight, guidance and responsible design and operation, such generative AI applications will remain a party trick with substantial potential for creating and spreading misinformation or harmful and inaccurate content at unprecedented scale. However, if positioned and developed responsibly as companions to humans augmenting but not replacing their role in decision making, knowledge retrieval and other cognitive processes, they could evolve into highly efficient, trustworthy, assistive tools for information management. This perspective describes how such tools could transform data management workflows in healthcare and medicine, explains how the underlying technology works, provides an assessment of risks and limitations, and proposes an ethical, technical, and cultural framework for responsible design, development, and deployment. It seeks to incentivise users, developers, providers, and regulators of generative AI that utilises LLMs to collectively prepare for the transformational role this technology could play in evidence-based sectors.

medicine, research & experimental
The Importance of Understanding Language in Large Language Models

Alaa Youssef,Samantha Stein,Justin Clapp,David Magnus

DOI: https://doi.org/10.1080/15265161.2023.2256614

2023-10-11

The American Journal of Bioethics

Abstract:Recent advancements in large language models (LLMs) have ushered in a transformative phase in artificial intelligence (AI). Unlike conventional AI, LLMs excel in facilitating fluid human–computer dialogues. LLMs in chatbots and ChatGPT have proven capable of mimicking human-like interactions—meeting a demand for various services. These services span from answering electronic health inquiries to acting as mental health support chatbots. The potential for LLMs to transform how we perceive, write, communicate, and utilize AI is profound, emphasizing the importance of understanding the impact of LLMs on human communication.

ethics,medical ethics,social issues,social sciences, biomedical
Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text

Sara Abdali,Richard Anarfi,CJ Barberan,Jia He

DOI: https://doi.org/10.1145/3637528.3671463

2024-06-27

Abstract:Large Language Models (LLMs) have revolutionized the field of Natural Language Generation (NLG) by demonstrating an impressive ability to generate human-like text. However, their widespread usage introduces challenges that necessitate thoughtful examination, ethical scrutiny, and responsible practices. In this study, we delve into these challenges, explore existing strategies for mitigating them, with a particular emphasis on identifying AI-generated text as the ultimate solution. Additionally, we assess the feasibility of detection from a theoretical perspective and propose novel research directions to address the current limitations in this domain.

Computation and Language,Artificial Intelligence,Machine Learning
Generative artificial intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications

Michal Bobula

DOI: https://doi.org/10.47408/jldhe.vi30.1137

2024-03-27

Journal of Learning Development in Higher Education

Abstract:This paper explores recent advancements and implications of artificial intelligence (AI) technology, with a specific focus on Large Language Models (LLMs) like ChatGPT 3.5, within the realm of higher education. Through a review of the academic literature, this paper highlights the unprecedented growth of these models and their wide-reaching impact across various sectors. The discussion sheds light on the complex issues and potential benefits presented by LLMs, providing a overview of the field's current state. In the context of higher education, the paper explores the challenges and opportunities posed by LLMs. These include issues related to educational assessment, potential threats to academic integrity, privacy concerns, the propagation of misinformation, EDI aspects, copyright concerns and inherent biases within the models. While these challenges are multifaceted and significant, the paper emphasizes the availability of strategies to address them effectively and facilitate the successful adoption of LLMs in educational settings. Furthermore, the paper recognises the potential opportunities to transform higher education. It emphasises the need to update assessment policies, develop guidelines for staff and students, scaffold AI skills development, and find ways to leverage technology in the classroom. By proactively pursuing these steps, higher education institutions (HEIs) can harness the full potential of LLMs while managing their adoption responsibly. In conclusion, the paper urges HEIs to allocate resources to handle the adoption of LLMs effectively. This includes ensuring staff AI readiness and taking steps to modify their study programmes to align with the evolving educational landscape influenced by emerging technologies.
Towards Applying Powerful Large AI Models in Classroom Teaching: Opportunities, Challenges and Prospects

Kehui Tan,Tianqi Pang,Chenyou Fan,Song Yu

2023-06-12

Abstract:This perspective paper proposes a series of interactive scenarios that utilize Artificial Intelligence (AI) to enhance classroom teaching, such as dialogue auto-completion, knowledge and style transfer, and assessment of AI-generated content. By leveraging recent developments in Large Language Models (LLMs), we explore the potential of AI to augment and enrich teacher-student dialogues and improve the quality of teaching. Our goal is to produce innovative and meaningful conversations between teachers and students, create standards for evaluation, and improve the efficacy of AI-for-Education initiatives. In Section 3, we discuss the challenges of utilizing existing LLMs to effectively complete the educated tasks and present a unified framework for addressing diverse education dataset, processing lengthy conversations, and condensing information to better accomplish more downstream tasks. In Section 4, we summarize the pivoting tasks including Teacher-Student Dialogue Auto-Completion, Expert Teaching Knowledge and Style Transfer, and Assessment of AI-Generated Content (AIGC), providing a clear path for future research. In Section 5, we also explore the use of external and adjustable LLMs to improve the generated content through human-in-the-loop supervision and reinforcement learning. Ultimately, this paper seeks to highlight the potential for AI to aid the field of education and promote its further exploration.

Artificial Intelligence,Computers and Society
Transforming Assessment: The Impacts and Implications of Large Language Models and Generative AI

Jiangang Hao,Alina A. von Davier,Victoria Yaneva,Susan Lottridge,Matthias von Davier,Deborah J. Harris

DOI: https://doi.org/10.1111/emip.12602

2024-04-06

Educational Measurement Issues and Practice

Abstract:The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting‐edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely, these innovations raise significant concerns regarding validity, reliability, transparency, fairness, equity, and test security, necessitating careful thinking when applying them in assessments. In this article, we discuss the impacts and implications of LLMs and generative AI on critical dimensions of assessment with example use cases and call for a community effort to equip assessment professionals with the needed AI literacy to harness the potential effectively.

education & educational research,psychology, educational
Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review

Lixiang Yan,Lele Sha,Linxuan Zhao,Yuheng Li,Roberto Martinez-Maldonado,Guanliang Chen,Xinyu Li,Yueqiao Jin,Dragan Gašević

DOI: https://doi.org/10.1111/bjet.13370

2023-07-22

Abstract:Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a range of educational tasks (e.g., question generation, feedback provision, and essay grading), there are concerns regarding the practicality and ethicality of these innovations. Such concerns may hinder future research and the adoption of LLMs-based innovations in authentic educational contexts. To address this, we conducted a systematic scoping review of 118 peer-reviewed papers published since 2017 to pinpoint the current state of research on using LLMs to automate and support educational tasks. The findings revealed 53 use cases for LLMs in automating education tasks, categorised into nine main categories: profiling/labelling, detection, grading, teaching support, prediction, knowledge representation, feedback, content generation, and recommendation. Additionally, we also identified several practical and ethical challenges, including low technological readiness, lack of replicability and transparency, and insufficient privacy and beneficence considerations. The findings were summarised into three recommendations for future studies, including updating existing innovations with state-of-the-art models (e.g., GPT-3/4), embracing the initiative of open-sourcing models/systems, and adopting a human-centred approach throughout the developmental process. As the intersection of AI and education is continuously evolving, the findings of this study can serve as an essential reference point for researchers, allowing them to leverage the strengths, learn from the limitations, and uncover potential research opportunities enabled by ChatGPT and other generative AI models.

Computation and Language,Artificial Intelligence,Computers and Society
Towards a personalized AI assistant to learn machine learning

Pascal Wallisch,Ibrahim Sheikh

DOI: https://doi.org/10.1038/s42256-024-00953-0

IF: 23.8

2024-12-06

Nature Machine Intelligence

Abstract:The introduction and rapid public adoption of generative AI tools such as OpenAI's ChatGPT in late 2022 dramatically affected the educational landscape. Many students — perhaps the majority — now routinely use ChatGPT and similar models for coursework. In the classes we taught at New York University (NYU), over 90% of undergraduate and master's students reported using large language models (LLMs) in 2023, rising to over 95% in 2024. The widespread use of LLMs, for example, in personal assistants, promises to be a tremendous boon for learning. However, they could also prove detrimental. One concern is that these AI tools could supplant learning. For instance, a generative AI tool could write code or essays for a student, instead of the student learning how to write code or essays themself. If generative AI tools reduce diligence by decreasing the time students spend with learning materials, the resulting decrements in learning could be substantial 1 . Another critical problem with using LLM-based tools for learning is that they were trained on vast, sometimes unreliable text corpora and respond in a probabilistic manner. This makes 'hallucinations' — contradictory, inaccurate or false outputs — inevitable 2 . As students often accept these outputs at face value, probably influenced by the confident tone of LLMs, hallucinations pose a risk to the integrity of learning itself.

computer science, artificial intelligence, interdisciplinary applications
Generative AI and Simulation Modeling: How Should You (Not) Use Large Language Models Like ChatGPT

Ali Akhavan,Mohammad S. Jalali,Mohammad S. Jalali

DOI: https://doi.org/10.2139/ssrn.4675409

2023-01-01

SSRN Electronic Journal

Abstract:Generative Artificial Intelligence (AI) tools, such as Large Language Models (LLMs) and chatbots like ChatGPT, hold promise for advancing simulation modeling in various domains. Despite their growing prominence and associated debates, there remains a gap in comprehending the potential of generative AI in this field and a lack of guidelines for its effective deployment. This paper endeavors to bridge these gaps. We discuss the applications of ChatGPT through an example of modeling COVID-19’s impact on economic growth in the United States. Although we utilize ChatGPT, our guidelines are generic and can be applied to a broader range of generative AI tools and platforms. Our work presents a systematic approach for integrating generative AI across the simulation research continuum, from problem articulation to insight derivation and documentation, independent of the specific simulation modeling method chosen. We emphasize that while these tools offer enhancements in refining ideas and expediting processes, they should complement rather than replace critical thinking inherent to research.
Taking the Next Step with Generative Artificial Intelligence: The Transformative Role of Multimodal Large Language Models in Science Education

Arne Bewersdorff,Christian Hartmann,Marie Hornberger,Kathrin Seßler,Maria Bannert,Enkelejda Kasneci,Gjergji Kasneci,Xiaoming Zhai,Claudia Nerdel

2024-09-19

Abstract:The integration of Artificial Intelligence (AI), particularly Large Language Model (LLM)-based systems, in education has shown promise in enhancing teaching and learning experiences. However, the advent of Multimodal Large Language Models (MLLMs) like GPT-4 with vision (GPT-4V), capable of processing multimodal data including text, sound, and visual inputs, opens a new era of enriched, personalized, and interactive learning landscapes in education. Grounded in theory of multimedia learning, this paper explores the transformative role of MLLMs in central aspects of science education by presenting exemplary innovative learning scenarios. Possible applications for MLLMs could range from content creation to tailored support for learning, fostering competencies in scientific practices, and providing assessment and feedback. These scenarios are not limited to text-based and uni-modal formats but can be multimodal, increasing thus personalization, accessibility, and potential learning effectiveness. Besides many opportunities, challenges such as data protection and ethical considerations become more salient, calling for robust frameworks to ensure responsible integration. This paper underscores the necessity for a balanced approach in implementing MLLMs, where the technology complements rather than supplants the educator's role, ensuring thus an effective and ethical use of AI in science education. It calls for further research to explore the nuanced implications of MLLMs on the evolving role of educators and to extend the discourse beyond science education to other disciplines. Through the exploration of potentials, challenges, and future implications, we aim to contribute to a preliminary understanding of the transformative trajectory of MLLMs in science education and beyond.

Artificial Intelligence,Computers and Society

When Not to Use AI

How Should College Education Respond to Large Language Models?

AI Meets the Classroom: When Does ChatGPT Harm Learning?

LARGE LANGUAGE MODEL-BASED ARTIFICIAL INTELLIGENCE IN THE LANGUAGE CLASSROOM: PRACTICAL IDEAS FOR TEACHING

Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students

The Future of Learning in the Age of Generative AI: Automated Question Generation and Assessment with Large Language Models

On the application of Large Language Models for language teaching and assessment technology

Prompting Higher Education Towards AI-Augmented Teaching and Learning Practice

Key Insights for the Ethical and Appropriate Use of Artificial Intelligence by Medical Learners

Large Language Models and Generative AI, Oh My!

Generative Artificial Intelligence and the Education Sector

Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine

The Importance of Understanding Language in Large Language Models

Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text

Generative artificial intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications

Towards Applying Powerful Large AI Models in Classroom Teaching: Opportunities, Challenges and Prospects

Transforming Assessment: The Impacts and Implications of Large Language Models and Generative AI

Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review

Towards a personalized AI assistant to learn machine learning

Generative AI and Simulation Modeling: How Should You (Not) Use Large Language Models Like ChatGPT

Taking the Next Step with Generative Artificial Intelligence: The Transformative Role of Multimodal Large Language Models in Science Education