Abstract:The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.

Artificial intelligence literacy for the language industry – with particular emphasis on recent large language models such as GPT-4

Artificial intelligence in applied (linguistics): a content analysis and future prospects

The great Transformer: Examining the role of large language models in the political economy of AI

Artificial intelligence literacy for technology education

A Glimpse in ChatGPT Capabilities and its impact for AI research

Some Reflections on the Interface between Professional Machine Translation Literacy and Data Literacy

Conceptualizing AI literacy: An exploratory review

How to Measure the Intelligence of Large Language Models?

Artificial intelligence and the affective labour of understanding: The intimate moderation of a language model

Exploring the potential of large language models and generative artificial intelligence (GPT): Applications in Library and Information Science

AI literacy in geographic education and research: Capabilities, caveats, and criticality

On the application of Large Language Models for language teaching and assessment technology

Enhancing Generic Skills Development in Higher Education in the Era of Large Language Model Artificial Intelligence

Large language models are changing landscape of academic publications. A positive transformation?

Explicating AI Literacy of Employees at Digital Workplaces

Artificial Intelligence in Academic Translation: A Comparative Study of Large Language Models and Google Translate

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

A Large-Scale, Automated Study of Language Surrounding Artificial Intelligence

AI Literacy: Definition, Teaching, Evaluation and Ethical Issues