Abstract:Large language models (LLMs) have learned vast amounts of factual knowledge through self-supervised pre-training on large-scale corpora. Meanwhile, LLMs have also demonstrated excellent multilingual capabilities, which can express the learned knowledge in multiple languages. However, the knowledge storage mechanism in LLMs still remains mysterious. Some researchers attempt to demystify the factual knowledge in LLMs from the perspective of knowledge neurons, and subsequently discover language-agnostic knowledge neurons that store factual knowledge in a form that transcends language barriers. However, the preliminary finding suffers from two limitations: 1) High Uncertainty in Localization Results. Existing study only uses a prompt-based probe to localize knowledge neurons for each fact, while LLMs cannot provide consistent answers for semantically equivalent queries. Thus, it leads to inaccurate localization results with high uncertainty. 2) Lack of Analysis in More Languages. The study only analyzes language-agnostic knowledge neurons on English and Chinese data, without exploring more language families and languages. Naturally, it limits the generalizability of the findings. To address aforementioned problems, we first construct a new benchmark called Rephrased Multilingual LAMA (RML-LAMA), which contains high-quality cloze-style multilingual parallel queries for each fact. Then, we propose a novel method named Multilingual Integrated Gradients with Uncertainty Estimation (MATRICE), which quantifies the uncertainty across queries and languages during knowledge localization. Extensive experiments show that our method can accurately localize language-agnostic knowledge neurons. We also further investigate the role of language-agnostic knowledge neurons in cross-lingual knowledge editing, knowledge enhancement and new knowledge injection.

Revealing the Parallel Multilingual Learning within Large Language Models

How do Large Language Models Handle Multilingualism?

Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Models

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models

Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners

Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications

One Mind, Many Tongues: A Deep Dive into Language-Agnostic Knowledge Neurons in Large Language Models

Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models

Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

The Reasonableness Behind Unreasonable Translation Capability of Large Language Model

Supervised Knowledge Makes Large Language Models Better In-context Learners

Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition

Unveiling Linguistic Regions in Large Language Models

Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model

Lens: Rethinking Multilingual Enhancement for Large Language Models

Why Larger Language Models Do In-context Learning Differently?

Teaching Large Language Models an Unseen Language on the Fly

Large Multilingual Models Pivot Zero-Shot Multimodal Learning across Languages

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Probing the Emergence of Cross-lingual Alignment during LLM Training