Abstract:Empirical evidence suggests that LLMs exhibit spontaneous cross-lingual alignment. Our findings suggest that although LLMs also demonstrate promising cross-lingual alignment in Information Extraction, there remains significant imbalance across languages, revealing an underlying deficiency in the IE alignment. To address this issue, we propose AlignXIE, a powerful code-based LLM that significantly enhances cross-lingual IE alignment through two strategies. Firstly, AlignXIE formulates IE across different languages, especially non-English ones, as code generation tasks, standardizing the representation of various schemas using Python classes to ensure consistency of the same ontology in different languages and align the schema. Secondly, it incorporates an IE cross-lingual alignment phase through a translated instance prediction task proposed in this paper to align the extraction process, utilizing ParallelNER, an IE bilingual parallel dataset with 257,190 samples, generated by our proposed LLM-based automatic pipeline for IE parallel data construction, with manual annotation to ensure quality. Ultimately, we obtain AlignXIE through multilingual IE instruction tuning. Although without training in 9 unseen languages, AlignXIE surpasses ChatGPT by $30.17\%$ and SoTA by $20.03\%$, thereby demonstrating superior cross-lingual IE capabilities. Comprehensive evaluations on 63 IE benchmarks in Chinese and English under various settings, demonstrate that AlignXIE significantly enhances cross-lingual and multilingual IE through boosting the IE alignment.

Enhancing Ontology Translation Through Cross-Lingual Agreement

Guiding Ontology Translation with Hubness-Aware Translation Memory

Interactive Cross-Lingual Ontology Matching

Boosting to Build a Large-Scale Cross-Lingual Ontology.

Multilingual Agreement for Multilingual Neural Machine Translation

Translation as Cross-Domain Knowledge - Attention Augmentation for Unsupervised Cross-Domain Segmenting and Labeling Tasks.

Revisiting Indirect Ontology Alignment : New Challenging Issues in Cross-Lingual Context

Multilingual Collection Retrieving Via Ontology Alignment

Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment

Language and Domain Aware Lightweight Ontology Matching

Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment

AlignXIE: Improving Multilingual Information Extraction by Cross-Lingual Alignment

Multilingual ontology matching based on Wiktionary data accessible via SPARQL endpoint

Improve Service Interface Adaptation Using Sub-ontology Extraction

Explorer A multilingual ontology matcher

Aligning Translation-Specific Understanding to General Understanding in Large Language Models

Actively Learning Ontology Matching via User Interaction

Ontology Alignment by Combining Lexical Analysis with Consequences from Reasoners

Bridging the Domain Gap: Improve Informal Language Translation Via Counterfactual Domain Adaptation

Massively Parallel Cross-Lingual Learning in Low-Resource Target Language Translation

Cross-Lingual Adaptation using Structural Correspondence Learning