Abstract:Bilingual word embedding has been shown to be helpful for Statistical Machine Translation (SMT). However, most existing methods suffer from two obvious drawbacks. First, they only focus on simple contexts such as an entire document or a fixed-sized sliding window to build word embedding and ignore latent useful information from the selected context. Second, the word sense but not the word should be the minimal semantic unit; however, most existing methods still use word representation. To overcome these drawbacks, this article presents a novel Graph-Based Bilingual Word Embedding (GBWE) method that projects bilingual word senses into a multidimensional semantic space. First, a bilingual word co-occurrence graph is constructed using the co-occurrence and pointwise mutual information between the words. Then, maximum complete subgraphs (cliques), which play the role of a minimal unit for bilingual sense representation, are dynamically extracted according to the contextual information. Consequently, correspondence analysis, principal component analyses, and neural networks are used to summarize the clique-word matrix into lower dimensions to build the embedding model. Without contextual information, the proposed GBWE can be applied to lexical translation. In addition, given contextual information, GBWE is able to give a dynamic solution for bilingual word representations, which can be applied to phrase translation and generation. Empirical results show that GBWE can enhance the performance of lexical translation, as well as Chinese/French-to-English and Chinese-to-Japanese phrase-based SMT tasks (IWSLT, NTCIR, NIST, and WAT).

Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation.

Improve Word Embedding Using Both Writing and Pronunciation.

Building Earth Mover'S Distance on Bilingual Word Embeddings for Machine Translation

Cross-Lingual Word Embedding Refinement by $\ell_{1}$ Norm Optimisation

Learning Tibetan-Chinese Cross-Lingual Word Embeddings

Are Girls Neko or Shōjo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization

Visual Exploration and Comparison of Word Embeddings.

Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditions

Unsupervised Hyperalignment for Multilingual Word Embeddings

Graph-Based Bilingual Word Embedding for Statistical Machine Translation

Offline bilingual word vectors, orthogonal transformations and the inverted softmax

Post-Processing of Word Representations via Variance Normalization and Dynamic Embedding

Shared-Private Bilingual Word Embeddings for Neural Machine Translation

Quantized Wasserstein Procrustes Alignment of Word Embedding Spaces

Improving Vector Space Word Representations Via Kernel Canonical Correlation Analysis

Improving Automatic Speech Recognition and Speech Translation Via Word Embedding Prediction

Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation

Re-ranking for Bilingual Lexicon Extraction with Bi-directional Linear Transformation from Comparable Corpora.

Jointly Learning Bilingual Word Embeddings and Alignments

Learning Unsupervised Word Mapping by Maximizing Mean Discrepancy

Linking Tweets with Monolingual and Cross-Lingual News using Transformed Word Embeddings