Abstract:The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.

How large language models can reshape collective intelligence

Collective Innovation in Groups of Large Language Models

Organizing a Society of Language Models: Structures and Mechanisms for Enhanced Collective Intelligence

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Large Language Model agents can coordinate beyond human scale

How should the advent of large language models affect the practice of science?

Quantifying the Impact of Large Language Models on Collective Opinion Dynamics

Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulation

The Importance of Understanding Language in Large Language Models

Using large language models in psychology

Science in the age of large language models

Shaping the Emerging Norms of Using Large Language Models in Social Computing Research

Large Language Models for Scientific Synthesis, Inference and Explanation

How to Measure the Intelligence of Large Language Models?

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

On the application of Large Language Models for language teaching and assessment technology

Generative Language Models Exhibit Social Identity Biases

Large Language Models Empowered Autonomous Edge AI for Connected Intelligence

Friend or Foe? Exploring the Implications of Large Language Models on the Science System

Can Large Language Models Transform Computational Social Science?