Abstract:Compared to subword based Neural Machine Translation (NMT), character based NMT eschews linguistic-motivated segmentation which performs directly on the raw character sequence, following a more absolute end-to-end manner. This property is more fascinating for machine translation (MT) between Japanese and Chinese, both of which use consecutive logographic characters without explicit word boundaries. However, there is still one disadvantage which should be addressed, that is, character is a less meaning-bearing unit than the subword, which requires the character models to be capable of sense discrimination. Specifically, there are two types of sense ambiguities existing in the source and target language, separately. With the former, it has been partially solved by the deep encoder and several existing works. But with the later, interestingly, the ambiguity in the target side is rarely discussed. To address this problem, we propose two simple yet effective methods, including a non-parametric pre-clustering for sense induction and a joint model to perform sense discrimination and NMT training simultaneously. Extensive experiments on Japanese↔Chinese MT show that our proposed methods consistently outperform the strong baselines, and verify the effectiveness of using sense-discriminated representation for character based NMT.

A Method for Selecting Noun Sense using Co-occurrence Relation in English-Korean Translation

Computational Method for Word Sense Evolution

Learning How to Translate North Korean through South Korean

Morpheme-based Korean text cohesion analyzer

Robust Guidance for Unsupervised Data Selection: Capturing Perplexing Named Entities for Domain-Specific Machine Translation

Empirical Analysis of Korean Public AI Hub Parallel Corpora and in-depth Analysis using LIWC

Translating Multi Word Terms Into Korean From Chinese Documents

Coarse-Grained Sense Inventories Based on Semantic Matching between English Dictionaries

A Sense-Based Translation Model For Statistical Machine Translation

Ancient Korean Archive Translation: Comparison Analysis on Statistical phrase alignment, LLM in-context learning, and inter-methodological approach

One Sense Per Translation

Compound Noun Analysis for Process of Korean Unregistered Word

Context-Aware LLM Translation System Using Conversation Summarization and Dialogue History

Structure Characteristic Analysisand Automatic Extraction for Korean Noun Phrase

Towards Accurate Translation via Semantically Appropriate Application of Lexical Constraints

Context-Dependent Translation Selection Using Convolutional Neural Network

Sense-Aware Decoder for Character Based Japanese-Chinese NMT

Korean Document Indexing and Evaluating Based on N-GRAM

Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction

Korean to English Translation Using Synchronous TAGs

A resource-based Korean morphological annotation system