Abstract:Large pre-trained language models (PLMs) are at the forefront of advances in Natural Language Processing. One widespread use case of PLMs is "prompting" - or in-context learning - where a user provides a description of a task and some completed examples of the task to a PLM as context before prompting the PLM to perform the task on a new example. Only the largest, most capable PLMs are able to perform in-context learning effectively, and these models are typically trained with a predominantly English corpus, leaving all other languages behind. The data limitations in most languages preclude the training of language-specific PLMs capable of prompting. Albeit the surge in work of prompting settings, it is still unclear how PLMs should be adapted cross-lingually specifically for prompting. We evaluate the possible methods to adapt LLaMa, a 7B parameter open-source PLM mainly trained in English, for prompting in low-resource languages, namely for Kinyarwanda, Hausa, and Luganda. We consider three methods: few-shot prompting (prompt), language-adaptive fine-tuning (LAFT), and neural machine translation (translate), and evaluate on abstractive summarization, multi-class topic classification, and named-entity recognition. Although LAFT carries the greatest compute cost and intuitively should lead to the best results, our experiments exhibit that LAFT is only occasionally the optimal choice for adapting PLMs for prompting. Rather, the translate and prompt settings are a compute-efficient and cost-effective method of few-shot prompting for the selected low-resource languages. We find that the results are task and language dependent but find that the prompting method is the best on average across all tasks and languages. Results show that the prompt setting performs better than both translating and LAFT with statistical significance for all shots when aggregated across all tasks and languages.

Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation

Zero-Shot Goal-Directed Dialogue via RL on Imagined Conversations

Self-Prompting Large Language Models for Zero-Shot Open-Domain QA

Rewriting Conversational Utterances with Instructed Large Language Models

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

LLM Roleplay: Simulating Human-Chatbot Interaction

Automatic Prompt Selection for Large Language Models

Large Language Model based Situational Dialogues for Second Language Learning

Enabling Conversational Interaction with Mobile UI using Large Language Models

Few-Shot Cross-Lingual Transfer for Prompting Large Language Models in Low-Resource Languages

Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Tasks

Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM Interactions

Simulating User Agents for Embodied Conversational-AI

Extensible Prompts for Language Models on Zero-shot Language Style Customization

Reinforcement Learning Problem Solving with Large Language Models

Role play with large language models

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction

Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Style

Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Prompts

Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment