Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning

Rochelle Choenni,Ekaterina Shutova

2024-08-29

Abstract:Improving the alignment of Large Language Models (LLMs) with respect to the cultural values that they encode has become an increasingly important topic. In this work, we study whether we can exploit existing knowledge about cultural values at inference time to adjust model responses to cultural value probes. We present a simple and inexpensive method that uses a combination of in-context learning (ICL) and human survey data, and show that we can improve the alignment to cultural values across 5 models that include both English-centric and multilingual LLMs. Importantly, we show that our method could prove useful in test languages other than English and can improve alignment to the cultural values that correspond to a range of culturally diverse countries.

Computation and Language

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The paper aims to address the issue of bias in large language models (LLMs) when encoding cultural values. Specifically, the researchers seek to adjust the model's responses to cultural value probes by leveraging existing knowledge of cultural values during the inference process. They propose a simple and cost-effective method that combines in-context learning (ICL) with human survey data, demonstrating that this approach can improve the alignment of cultural values in five different LLMs (including English-centric and multilingual models). Additionally, the research shows that this method is not only applicable to English but also enhances the alignment of cultural values corresponding to other languages.

### Main Contributions
1. **In-Context Learning for Cultural Value Adjustment**: By adding examples that reflect specific cultural values to the prompts, LLMs can better adjust the cultural values in their outputs.
2. **Multilingual Applicability**: The method is shown to be applicable not only to English and American values but also to various languages and the cultural values of different countries.
3. **Experimental Validation**: Experiments were conducted on five different LLMs to validate the effectiveness of the method and to explore performance differences across different languages and cultural backgrounds.

### Summary
This paper aims to improve the alignment of LLMs with values from different cultural backgrounds through a context-based learning method, making these models more sensitive and adaptable to diverse cultural needs globally.