TsinghuaAligner: A Statistical Bilingual Word Alignment System

Yang Liu

2014-01-01

Abstract:Word alignment is a natural language task that aims to identify the correspondence between words in two languages.

What problem does this paper attempt to address?

BinaryAlign: Word Alignment as Binary Sequence Labeling

Gaetan Lopez Latouche,Marc-André Carbonneau,Ben Swanson

2024-07-16

Abstract:Real world deployments of word alignment are almost certain to cover both high and low resource languages. However, the state-of-the-art for this task recommends a different model class depending on the availability of gold alignment training data for a particular language pair. We propose BinaryAlign, a novel word alignment technique based on binary sequence labeling that outperforms existing approaches in both scenarios, offering a unifying approach to the task. Additionally, we vary the specific choice of multilingual foundation model, perform stratified error analysis over alignment error type, and explore the performance of BinaryAlign on non-English language pairs. We make our source code publicly available.

Computation and Language,Artificial Intelligence
Improving Statistical Word Alignment with Various Clues.

Dengjun Ren,Hua Wu,Haifeng Wang

2007-01-01

Abstract:This paper proposes a method to improve word alignment by combining various clues. Our method first trains a baseline statistical IBM word alignment model. Then we improve it with various clues, which are mainly based on features such as lemmatization, translation dictionary, named entities, and chunks. We incorporate these features into an unified framework. Experimental results show that our method improves word alignment quality by achieving a relative error rate reduction of 39.8%. We also conduct phrase-based machine translation based on the word alignment results. Using BLEU as an evaluation metric, our method achieves an absolute improvement of about 0.02 (about 18% relative) over a baseline method.
Discriminative Word Alignment by Linear Modeling

Yang Liu,Qun Liu,Shouxun Lin

DOI: https://doi.org/10.1162/coli_a_00001

IF: 7.778

2010-01-01

Computational Linguistics

Abstract:Word alignment plays an important role in many NLP tasks as it indicates the correspondence between words in a parallel text. Although widely used to align large bilingual corpora, generative models are hard to extend to incorporate arbitrary useful linguistic information. This article presents a discriminative framework for word alignment based on a linear model. Within this framework, all knowledge sources are treated as feature functions, which depend on a source language sentence, a target language sentence, and the alignment between them. We describe a number of features that could produce symmetric alignments. Our model is easy to extend and can be optimized with respect to evaluation metrics directly. The model achieves state-of-the-art alignment quality on three word alignment shared tasks for five language pairs with varying divergence and richness of resources. We further show that our approach improves translation performance for various statistical machine translation systems.
AlignBench: Benchmarking Chinese Alignment of Large Language Models

Xiao Liu,Xuanyu Lei,Shengyuan Wang,Yue Huang,Zhuoer Feng,Bosi Wen,Jiale Cheng,Pei Ke,Yifan Xu,Weng Lam Tam,Xiaohan Zhang,Lichao Sun,Xiaotao Gu,Hongning Wang,Jing Zhang,Minlie Huang,Yuxiao Dong,Jie Tang

2024-08-25

Abstract:Alignment has become a critical step for instruction-tuned Large Language Models (LLMs) to become helpful assistants. However, the effective evaluation of alignment for emerging Chinese LLMs is still largely unexplored. To fill in this gap, we introduce AlignBench, a comprehensive multi-dimensional benchmark for evaluating LLMs' alignment in Chinese. We design a human-in-the-loop data curation pipeline, containing eight main categories, 683 real-scenario rooted queries and corresponding human verified references. To ensure the correctness of references, each knowledge-intensive query is accompanied with evidences collected from reliable web sources (including URLs and quotations) by our annotators. For automatic evaluation, our benchmark employs a rule-calibrated multi-dimensional LLM-as-Judge~\cite{zheng2023judging} approach with Chain-of-Thought to generate explanations and final ratings, ensuring high reliability and interpretability. All evaluation code, data, and LLM generations are available at \url{<a class="link-external link-https" href="https://github.com/THUDM/AlignBench" rel="external noopener nofollow">this https URL</a>}. Since its release, AlignBench has been adopted by top (Chinese) LLMs for evaluating their alignment capabilities in Chinese, including ChatGLM, Qwen, DeepSeek, Yi, Baichuan, and Abab.

Computation and Language,Artificial Intelligence,Machine Learning
Collocation Extraction Using Monolingual Word Alignment Method.

Zhanyi Liu,Haifeng Wang,Hua Wu,Sheng Li

DOI: https://doi.org/10.1145/2036264.2036280

IF: 5

2011-01-01

ACM Transactions on Intelligent Systems and Technology

Abstract:Statistical bilingual word alignment has been well studied in the context of machine translation. This paper adapts the bilingual word alignment algorithm to monolingual scenario to extract collocations from monolingual corpus. The monolingual corpus is first replicated to generate a parallel corpus, where each sentence pair consists of two identical sentences in the same language. Then the monolingual word alignment algorithm is employed to align the potentially collocated words in the monolingual sentences. Finally the aligned word pairs are ranked according to refined alignment probabilities and those with higher scores are extracted as collocations. We conducted experiments using Chinese and English corpora individually. Compared with previous approaches, which use association measures to extract collocations from the co-occurring word pairs within a given window, our method achieves higher precision and recall. According to human evaluation in terms of precision, our method achieves absolute improvements of 27.9% on the Chinese corpus and 23.6% on the English corpus, respectively. Especially, we can extract collocations with longer spans, achieving a high precision of 69% on the long-span (>6) Chinese collocations.
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment

Siyu Lai,Zhen Yang,Fandong Meng,Yufeng Chen,Jinan Xu,Jie Zhou

DOI: https://doi.org/10.48550/arxiv.2210.04141

2022-01-01

Abstract:Word alignment which aims to extract lexicon translation equivalents between source and target sentences, serves as a fundamental tool for natural language processing. Recent studies in this area have yielded substantial improvements by generating alignments from contextualized embeddings of the pre-trained multilingual language models. However, we find that the existing approaches capture few interactions between the input sentence pairs, which degrades the word alignment quality severely, especially for the ambiguous words in the monolingual context. To remedy this problem, we propose Cross-Align to model deep interactions between the input sentence pairs, in which the source and target sentences are encoded separately with the shared self-attention modules in the shallow layers, while cross-lingual interactions are explicitly constructed by the cross-attention modules in the upper layers. Besides, to train our model effectively, we propose a two-stage training framework, where the model is trained with a simple Translation Language Modeling (TLM) objective in the first stage and then finetuned with a self-supervised alignment objective in the second stage. Experiments show that the proposed Cross-Align achieves the state-of-the-art (SOTA) performance on four out of five language pairs.
A Beam Search Algorithm for ITG Word Alignment.

Peng Li,Yang Liu,Maosong Sun

2012-01-01

Abstract:Inversion transduction grammar (ITG) provides a syntactically motivated solution to modeling the distortion of words between two languages. Although the Viterbi ITG alignments can be found in polynomial time using a bilingual parsing algorithm, the computational complexity is still too high to handle real-world data, especially for long sentences. Alternatively, we propose a simple and effective beam search algorithm. The algorithm starts with an empty alignment and keeps adding single promising links as early as possible until the model probability does not increase. Experiments on Chinese-English data show that our algorithm is one order of magnitude faster than the bilingual parsing algorithm with bitext cell pruning without loss in alignment and translation quality.
Word alignment for languages with scarce resources using bilingual corpora of other language pairs

Haifeng Wang,Hua Wu,Zhanyi Liu

DOI: https://doi.org/10.3115/1273073.1273185

2006-01-01

Abstract:This paper proposes an approach to improve word alignment for languages with scarce resources using bilingual corpora of other language pairs. To perform word alignment between languages L1 and L2, we introduce a third language L3. Although only small amounts of bilingual data are available for the desired language pair L1-L2, large-scale bilingual corpora in L1-L3 and L2-L3 are available. Based on these two additional corpora and with L3 as the pivot language, we build a word alignment model for L1 and L2. This approach can build a word alignment model for two languages even if no bilingual corpus is available in this language pair. In addition, we build another word alignment model for L1 and L2 using the small L1-L2 bilingual corpus. Then we interpolate the above two models to further improve word alignment between L1 and L2. Experimental results indicate a relative error rate reduction of 21.30% as compared with the method only using the small bilingual corpus in L1 and L2.
Improving statistical word alignment with a rule-based machine translation system

Wu Hua,Wang Haifeng

DOI: https://doi.org/10.3115/1220355.1220360

2004-01-01

Abstract:The main problems of statistical word alignment lie in the facts that source words can only be aligned to one target word, and that the inappropriate target word is selected because of data sparseness problem. This paper proposes an approach to improve statistical word alignment with a rule-based translation system. This approach first uses IBM statistical translation model to perform alignment in both directions (source to target and target to source), and then uses the translation information in the rule-based machine translation system to improve the statistical word alignment. The improved alignments allow the word(s) in the source language to be aligned to one or more words in the target language. Experimental results show a significant improvement in precision and recall of word alignment.
Research of English-Chinese Alignment at Word Granularity on Parallel Corpora

Xu Yang,Wang Hou-feng,Lue Xue-qiang

DOI: https://doi.org/10.1109/icis.2008.28

2008-01-01

Abstract:Bilingual alignment is a crucial problem in the research of natural language processing, and word alignment is a nodus among all granularities of alignment. This paper describes an English-Chinese word alignment model based on a bilingual lexicon and some language knowledge, which works on bilingual corpora. The model is built on the theory of formal optimal partition of the bilingual sentence pairs, and is ubiquitous to sentences pairs of any natural language. Particularly, we obtain some alignment strategies which are independent to alignment direction by denoting some definitions and proving a theorem. The model deals with part-matching cases, solves multi-appear-word problems and remedies the deficiency of bilingual lexicon. The experimental results show that the model can align bilingual corpora at word level effectively with a high accuracy, and maintain the grammar structure of the original sentences at the same time.
Improving domain-specific word alignment for computer assisted translation

WU Hua,WANG Haifeng

DOI: https://doi.org/10.3115/1219044.1219046

2004-01-01

Abstract:This paper proposes an approach to improve word alignment in a specific domain, in which only a small-scale domain-specific corpus is available, by adapting the word alignment information in the general domain to the specific domain. This approach first trains two statistical word alignment models with the large-scale corpus in the general domain and the small-scale corpus in the specific domain respectively, and then improves the domain-specific word alignment with these two models. Experimental results show a significant improvement in terms of both alignment precision and recall. And the alignment results are applied in a computer assisted translation system to improve human translation efficiency.
Discriminative Word Alignment over Multiple Word Segmentations

Xi Ning,Dai Xinyu,Huang Shujian,Chen Jiajun

2014-01-01

Abstract:Conventional bilingual word alignment is conducted on sentence pairs with single word segmentation for languages such as Chinese, viz. Single-segmentationbased word alignment（SSWA）. However, SSWA may run the risk of losing optimal word segmentation granularities or causing data sparseness in word alignment. This paper proposes Multiple-segmentation-based word alignment（MSWA）. In MSWA, diverse and complementary knowledge in multiple word segmentations can be employed to lower the above risks in word alignment. Given k word segmentations of a Chinese sentence, a skeleton segmentation is firstly constructed. The alignment between the skeleton segmentation and the parallel English sentence is loglinearly modeled, where various features defined over multiple word segmentations are incorporated. The Viterbi alignment, the alignment with the highest score, is mapped back to k word alignments based on k segmentations respectively. Experimentally, MSWA outperformed SSWA on all k segmentations in both alignment quality and translation performance.
Log-linear models for word alignment

Yang Liu,Qun Liu,Shouxun Lin

DOI: https://doi.org/10.3115/1219840.1219897

2005-01-01

Abstract:We present a framework for word alignment based on log-linear models. All knowledge sources are treated as feature functions, which depend on the source language sentence, the target language sentence and possible additional variables. Log-linear models allow statistical alignment models to be easily extended by incorporating syntactic information. In this paper, we use IBM Model 3 alignment probabilities, POS correspondence, and bilingual dictionary coverage as features. Our experiments show that log-linear models significantly outperform IBM translation models.
Enhancing Statistical Machine Translation with Character Alignment

Ning Xi,Guangchao Tang,Xinyu Dai,Shujian Huang,Jiajun Chen

2012-01-01

Abstract:The dominant practice of statistical machine translation (SMT) uses the same Chinese word segmentation specification in both alignment and translation rule induction steps in building Chinese-English SMT system, which may suffer from a suboptimal problem that word segmentation better for alignment is not necessarily better for translation. To tackle this, we propose a framework that uses two different segmentation specifications for alignment and translation respectively: we use Chinese character as the basic unit for alignment, and then convert this alignment to conventional word alignment for translation rule induction. Experimentally, our approach outperformed two baselines: fully word-based system (using word for both alignment and translation) and fully character-based system, in terms of alignment quality and translation performance.
Search for Discriminative Word Alignment via Dual Decomposition

Shiqi Shen,Yang Liu,Maosong Sun

2013-01-01

Abstract:Shiqi Shen, Yang Liu and Maosong Sun (Department of Computer Science and Technology, State Key Lab on Intelligent Technology and Systems, Tsinghua University, Beijing 100084, China) Abstract: Word alignment aims to calculate the corresponding relationship between the words in parallel texts. It has important influence on machine translation, bilingual dictionary construction and many other natural language processing tasks. Although in recent years the word alignment has made significant progress in modeling and training algorithm, its search algorithm often uses simply greedy strategies and faces the problem of large search errors. This paper proposed a word alignment search algorithm based on dual decomposition, making a complex problem into two relatively simple sub-problems and iteratively solving it until convergence to the optimal solution. For the dual decomposition can ensure the convergence and optimality of solutions, this algorithm significantly exceeds GUZA++ and discriminant word alignment system on alignment error rates when testing on the 863 Projects word alignment evaluation data set of 2005. Alignment error rate is decreased by 4.2% and 1.1% respectively.
Aligning a Parallel English-Chinese Corpus Statistically with Lexical Criteria

Dekai Wu

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9406007

1994-06-02

Computation and Language

Abstract:We describe our experience with automatic alignment of sentences in parallel English-Chinese texts. Our report concerns three related topics: (1) progress on the HKUST English-Chinese Parallel Bilingual Corpus; (2) experiments addressing the applicability of Gale & Church's length-based statistical method to the task of alignment involving a non-Indo-European language; and (3) an improved statistical method that also incorporates domain-specific lexical cues.
Weighted Alignment Matrices for Statistical Machine Translation.

Yang Liu,Tian Xia,Xinyan Xiao,Qun Liu

DOI: https://doi.org/10.3115/1699571.1699645

2009-01-01

Abstract:Current statistical machine translation systems usually extract rules from bilingual corpora annotated with 1-best alignments. They are prone to learn noisy rules due to alignment mistakes. We propose a new structure called weighted alignment matrix to encode all possible alignments for a parallel text compactly. The key idea is to assign a probability to each word pair to indicate how well they are aligned. We design new algorithms for extracting phrase pairs from weighted alignment matrices and estimating their probabilities. Our experiments on multiple language pairs show that using weighted matrices achieves consistent improvements over using n -best lists in significant less extraction time.
Adaptative Bilingual Aligning Using Multilingual Sentence Embedding

Olivier Kraif

2024-03-19

Abstract:In this paper, we present an adaptive bitextual alignment system called AIlign. This aligner relies on sentence embeddings to extract reliable anchor points that can guide the alignment path, even for texts whose parallelism is fragmentary and not strictly monotonic. In an experiment on several datasets, we show that AIlign achieves results equivalent to the state of the art, with quasi-linear complexity. In addition, AIlign is able to handle texts whose parallelism and monotonicity properties are only satisfied locally, unlike recent systems such as Vecalign or Bertalign.

Computation and Language
mammothwill be a jiang shi yixiang juda gongcheng job ( a )

Nan Yang,Shujie Liu,Mu Li,Ming Zhou,Nenghai Yu

2013-01-01

Abstract:In this paper, we explore a novel bilingual word alignment approach based on DNN (Deep Neural Network), which has been proven to be very effective in various machine learning tasks (Collobert et al., 2011). We describe in detail how we adapt and extend the CD-DNNHMM (Dahl et al., 2012) method introduced in speech recognition to the HMMbased word alignment model, in which bilingual word embedding is discriminatively learnt to capture lexical translation information, and surrounding words are leveraged to model context information in bilingual sentences. While being capable to model the rich bilingual correspondence, our method generates a very compact model with much fewer parameters. Experiments on a large scale EnglishChinese word alignment task show that the proposed method outperforms the HMM and IBM model 4 baselines by 2 points in F-score.
Word Alignment Combination over Multiple Word Segmentation

Ning Xi,Guangchao Tang,Boyuan Li,Yinggong Zhao

2011-01-01

Abstract:In this paper, we present a new word alignment combination approach on language pairs where one language has no explicit word boundaries. Instead of combining word alignments of different models (Xiang et al., 2010), we try to combine word alignments over multiple monolingually motivated word segmentation. Our approach is based on link confidence score defined over multiple segmentations, thus the combined alignment is more robust to inappropriate word segmentation. Our combination algorithm is simple, efficient, and easy to implement. In the Chinese-English experiment, our approach effectively improved word alignment quality as well as translation performance on all segmentations simultaneously, which showed that word alignment can benefit from complementary knowledge due to the diversity of multiple and monolingually motivated segmentations.

TsinghuaAligner: A Statistical Bilingual Word Alignment System

BinaryAlign: Word Alignment as Binary Sequence Labeling

Improving Statistical Word Alignment with Various Clues.

Discriminative Word Alignment by Linear Modeling

AlignBench: Benchmarking Chinese Alignment of Large Language Models

Collocation Extraction Using Monolingual Word Alignment Method.

Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment

A Beam Search Algorithm for ITG Word Alignment.

Word alignment for languages with scarce resources using bilingual corpora of other language pairs

Improving statistical word alignment with a rule-based machine translation system

Research of English-Chinese Alignment at Word Granularity on Parallel Corpora

Improving domain-specific word alignment for computer assisted translation

Discriminative Word Alignment over Multiple Word Segmentations

Log-linear models for word alignment

Enhancing Statistical Machine Translation with Character Alignment

Search for Discriminative Word Alignment via Dual Decomposition

Aligning a Parallel English-Chinese Corpus Statistically with Lexical Criteria

Weighted Alignment Matrices for Statistical Machine Translation.

Adaptative Bilingual Aligning Using Multilingual Sentence Embedding

mammothwill be a jiang shi yixiang juda gongcheng job ( a )

Word Alignment Combination over Multiple Word Segmentation