Abstract:The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.

Voices from the algorithm: Large language models in social research

Exploring the Application Potential of the Large Language Model in Sociological Research: A Case Study of ChatGPT

'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants

ChatGPT and Large Language Models: What are the Implications for Policy Makers?

Friend or Foe? Exploring the Implications of Large Language Models on the Science System

Algorithmic Ghost in the Research Shell: Large Language Models and Academic Knowledge Creation in Management Research

Vox Populi, Vox ChatGPT: Large Language Models, Education and Democracy

Perils and opportunities in using large language models in psychological research

From ChatGPT, DALL-E 3 to Sora: How has Generative AI Changed Digital Humanities Research and Services?

ChatGPT and large language models in academia: opportunities and challenges

Shaping the Emerging Norms of Using Large Language Models in Social Computing Research

On the application of Large Language Models for language teaching and assessment technology

Large Language Models and Generative AI, Oh My!

Leveraging GPT for the Generation of Multi-Platform Social Media Datasets for Research

The Persuasive Power of Large Language Models

ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health

Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

From human-centered to social-centered artificial intelligence: Assessing ChatGPT's impact through disruptive events

ChatGPT in society: emerging issues

LLMs Among Us: Generative AI Participating in Digital Discourse

Artificial intelligence, ChatGPT, and other large language models for social determinants of health: Current state and future directions