Abstract:The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.

Use of large language models might affect our cognitive skills

Turning large language models into cognitive models

Cognitive Effects in Large Language Models

Can Large Language Models Counter the Recent Decline in Literacy Levels? An Important Role for Cognitive Science

Perils and opportunities in using large language models in psychological research

Large language models as linguistic simulators and cognitive models in human research

Dissociating language and thought in large language models: a cognitive perspective

Science in the age of large language models

On pitfalls (and advantages) of sophisticated large language models

Using large language models in psychology

Large Language Models are Not Models of Natural Language: They are Corpus Models

The Importance of Understanding Language in Large Language Models

How should the advent of large language models affect the practice of science?

Large Language Models Demonstrate the Potential of Statistical Learning in Language

Amplifying Limitations, Harms and Risks of Large Language Models

On the application of Large Language Models for language teaching and assessment technology

Thinking Fast and Slow in Large Language Models

Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans

Larger and more instructable language models become less reliable

On the Unexpected Abilities of Large Language Models

A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Hum4n L4ngu4ge and the W0rld behind W0rds?