Improving HowNet-Based Chinese WSD with Translations

Xiang Zhang,Grzegorz Kondrak,B. Hauer

Abstract:,

Computer Science,Linguistics

What problem does this paper attempt to address?

Exploring the traditional NMT model and Large Language Model for chat translation

Jinlong Yang,Hengchao Shang,Daimeng Wei,Jiaxin Guo,Zongyao Li,Zhanglin Wu,Zhiqiang Rao,Shaojun Li,Yuhao Xie,Yuanchang Luo,Jiawei Zheng,Bin Wei,Hao Yang

2024-09-24

Abstract:This paper describes the submissions of Huawei Translation Services Center(HW-TSC) to WMT24 chat translation shared task on English$\leftrightarrow$Germany (en-de) bidirection. The experiments involved fine-tuning models using chat data and exploring various strategies, including Minimum Bayesian Risk (MBR) decoding and self-training. The results show significant performance improvements in certain directions, with the MBR self-training method achieving the best results. The Large Language Model also discusses the challenges and potential avenues for further research in the field of chat translation.

Computation and Language,Artificial Intelligence
Corpus-based Research on English-Chinese Translation Teaching Combining Vocabulary Learning and Practice

Nan Zhang

DOI: https://doi.org/10.52783/jes.3187

2024-04-04

Abstract:As the global economy is developing, real time translation among major influential languages such as English, Chinese has become a necessity. Translation from English to Chinese is difficult since Chinese has a different grammar and ambiguous word boundaries. Furthermore, there are issues with the current Chinese-English machine translation, including difficult-to-understand extended sentences and inaccurate word translation. To address this drawback, the methodology for more precisely categorizing vocabulary in both English and Chinese is described in this research. The data are collected from UM-Corpus news dataset. Then, using SEGBOT: Neural Text Segmentation method, English words are segmented from the sentences available on the dataset. Afterward, the data are fed to pre-processing. In pre-processing segment; words missing in translation from the news dataset are eliminated and enhances the input data utilizing Iterated Square-Root Cubature Kalman Filter. The outcome from the pre-processing data is transferred to the Pyramidal Convolution Shuffle Attention Neural Network (PCSANN). The word order, grammatical structure, consistent style and smooth flow for English to Chinese translation are successfully classified by using PCSANN. The Waterwheel Plant Algorithm (WWPA) is used to optimize the weight parameter of PCSANN. The proposed PCSANN-WWPA is applied in python working platform. Performance metrics, like accuracy, precision, F1-score, and recall are examined to compute proposed method. The gained results of the proposed PCSANN-WWPA method attains higher accuracy of 16.65%, 18.85%, and 17.89%, higher sensitivity of 16.34%, 12.23%, and 18.54% and higher precision of 14.89%, 16.89%, and 18.23%. The proposed ECTT-PCSANN-WWPA method is compared with the existing methods such as ECTT-RNN, ECTT-DNN, and ECTT-MLPNN models respectively.
Generalized W-Net: Arbitrary-style Chinese Character Synthesization

Haochuan Jiang,Guanyu Yang,Fei Cheng,Kaizhu Huang

2024-06-11

Abstract:Synthesizing Chinese characters with consistent style using few stylized examples is challenging. Existing models struggle to generate arbitrary style characters with limited examples. In this paper, we propose the Generalized W-Net, a novel class of W-shaped architectures that addresses this. By incorporating Adaptive Instance Normalization and introducing multi-content, our approach can synthesize Chinese characters in any desired style, even with limited examples. It handles seen and unseen styles during training and can generate new character contents. Experimental results demonstrate the effectiveness of our approach.

Computer Vision and Pattern Recognition
Improving the Robustness of Speech Translation

Xiang Li,Haiyang Xue,Wei Chen,Yang Liu,Yang Feng,Qun Liu

DOI: https://doi.org/10.48550/arXiv.1811.00728

2018-11-02

Abstract:Although neural machine translation (NMT) has achieved impressive progress recently, it is usually trained on the clean parallel data set and hence cannot work well when the input sentence is the production of the automatic speech recognition (ASR) system due to the enormous errors in the source. To solve this problem, we propose a simple but effective method to improve the robustness of NMT in the case of speech translation. We simulate the noise existing in the realistic output of the ASR system and inject them into the clean parallel data so that NMT can work under similar word distributions during training and testing. Besides, we also incorporate the Chinese Pinyin feature which is easy to get in speech translation to further improve the translation performance. Experiment results show that our method has a more stable performance and outperforms the baseline by an average of 3.12 BLEU on multiple noisy test sets, even while achieves a generalization improvement on the WMT'17 Chinese-English test set.

Computation and Language
kua yu yan ji suan ji wang luo zhong de yu yan tong xun zhang ai ji jie jue ban fa

Liu Haitao

IF: 8.1

1994-01-01

Information Sciences

Abstract:This paper reviews various human inconvience induced by the phenomenon of multi-language, this old problem is made more prominent by the appear of computer network . In order to solute it , this paper introduces briefly a .distributed system of machine translation based upon network . Considering,the complexity of this system , and FAHQ being difficult to carry out in recent time , this author suggests a communication method of network language based upon the concept of universal grammar in the international language.
Better Simultaneous Translation with Monotonic Knowledge Distillation.

Shushu Wang,Jing Wu,Kai Fan,Wei Luo,Jun Xiao,Zhongqiang Huang

DOI: https://doi.org/10.18653/v1/2023.acl-long.131

2023-01-01

Abstract:Simultaneous machine translation (SiMT) presents a unique challenge as it requires generating target tokens before the source sentence is fully consumed. This can lead to the hallucination problem, where target tokens are generated without support from the source sentence. The prefix-to-prefix training data used to train SiMT models are not always parallel, due to divergent word order between the source and target languages, and can contribute to the problem. In this paper, we propose a novel approach that leverages traditional translation models as teachers and employs a two-stage beam search algorithm to generate monotonic yet accurate reference translations for sequence-level knowledge distillation. Experimental results demonstrate the significant improvements achieved by our approach over multiple strong SiMT baselines, leading to new state-of-the-art performance across various language pairs. Notably, when evaluated on a monotonic version of the WMT15 De -> En test set, which includes references generated in a more monotonic style by professional translators, our approach achieves even more substantial improvement over the baselines. The source code and data are publicly available for further exploration(1).
WeChat Neural Machine Translation Systems for WMT20

Fandong Meng,Jianhao Yan,Yijin Liu,Yuan Gao,Xianfeng Zeng,Qinsong Zeng,Peng Li,Ming Chen,Jie Zhou,Sifan Liu,Hao Zhou

DOI: https://doi.org/10.48550/arXiv.2010.00247

2020-10-01

Computation and Language

Abstract:We participate in the WMT 2020 shared news translation task on Chinese to English. Our system is based on the Transformer (Vaswani et al., 2017a) with effective variants and the DTMT (Meng and Zhang, 2019) architecture. In our experiments, we employ data selection, several synthetic data generation approaches (i.e., back-translation, knowledge distillation, and iterative in-domain knowledge transfer), advanced finetuning approaches and self-bleu based model ensemble. Our constrained Chinese to English system achieves 36.9 case-sensitive BLEU score, which is the highest among all submissions.
Improved Neural Machine Translation With Smt Features

Wei He,Zhongjun He,Hua Wu,Haifeng Wang

DOI: https://doi.org/10.1609/aaai.v30i1.9983

2016-01-01

Abstract:Neural machine translation (NMT) conducts end-to-end translation with a source language encoder and a target language decoder, making promising translation performance. However, as a newly emerged approach, the method has some limitations. An NMT system usually has to apply a vocabulary of certain size to avoid the time-consuming training and decoding, thus it causes a serious out-of-vocabulary problem. Furthermore, the decoder lacks a mechanism to guarantee all the source words to be translated and usually favors short translations, resulting in fluent but inadequate translations. In order to solve the above problems, we incorporate statistical machine translation (SMT) features, such as a translation model and an n-gram language model, with the NMT model under the log-linear framework. Our experiments show that the proposed method significantly improves the translation quality of the state-of-the-art NMT system on Chinese-to-English translation tasks. Our method produces a gain of up to 2.33 BLEU score on NIST open test sets.
Try to Substitute: an Unsupervised Chinese Word Sense Disambiguation Method Based on HowNet.

Bairu Hou,Fanchao Qi,Yuan Zang,Xurui Zhang,Zhiyuan Liu,Maosong Sun

DOI: https://doi.org/10.18653/v1/2020.coling-main.155

2020-01-01

Abstract:Word sense disambiguation (WSD) is a fundamental natural language processing task. Unsupervised knowledge-based WSD only relies on a lexical knowledge base as the sense inventory and has wider practical use than supervised WSD that requires a mass of sense-annotated data. HowNet is the most widely used lexical knowledge base in Chinese WSD. Because of its uniqueness, however, most of existing unsupervised WSD methods cannot work for HowNet-based WSD, and the tailor-made methods have not obtained satisfying results. In this paper, we propose a new unsupervised method for HowNet-based Chinese WSD, which exploits the masked language model task of pre-trained language models. In experiments, considering existing evaluation dataset is small and out-of-date, we build a new and larger HowNet-based WSD dataset. Experimental results demonstrate that our model achieves significantly better performance than all the baseline methods. All the code and data of this paper are available at https://github.com/thunlp/SememeWSD.
WeChat Neural Machine Translation Systems for WMT21

Xianfeng Zeng,Yijin Liu,Ernan Li,Qiu Ran,Fandong Meng,Peng Li,Jinan Xu,Jie Zhou

DOI: https://doi.org/10.48550/arXiv.2108.02401

2021-09-13

Abstract:This paper introduces WeChat AI's participation in WMT 2021 shared news translation task on English->Chinese, English->Japanese, Japanese->English and English->German. Our systems are based on the Transformer (Vaswani et al., 2017) with several novel and effective variants. In our experiments, we employ data filtering, large-scale synthetic data generation (i.e., back-translation, knowledge distillation, forward-translation, iterative in-domain knowledge transfer), advanced finetuning approaches, and boosted Self-BLEU based model ensemble. Our constrained systems achieve 36.9, 46.9, 27.8 and 31.3 case-sensitive BLEU scores on English->Chinese, English->Japanese, Japanese->English and English->German, respectively. The BLEU scores of English->Chinese, English->Japanese and Japanese->English are the highest among all submissions, and that of English->German is the highest among all constrained submissions.

Computation and Language,Artificial Intelligence
Resolving error accumulation of automatically acquiring bilingual lexical knowledge by semantic similarity

LIU Peng-yuan,ZHAO Tie-jun,LI Sheng,YANG Mu-yun

DOI: https://doi.org/10.3969/j.issn.1006-7043.2006.z1.122

2006-01-01

Abstract:While using a large-scale bilingual English-Chinese corpus to build translation dictionary, after some statistics and analysis, it is found that there are some unconquerable error accumulation problems while acquiring bilingual lexical knowledge by using large-scale bilingual corpus. Furthermore, a method is raised to solve this problem using semantic dictionary and its similarity measurement. Primary experiment has indicated that this method is effective and feasible. The application-oriented comparison between HowNet and WordNet has been made in this paper, and a conclusion is drawn: HowNet has higher recall while WordNet has higher precision for their difference of semantic granularity.
SubCharacter Chinese-English Neural Machine Translation with Wubi encoding

Wei Zhang,Feifei Lin,Xiaodong Wang,Zhenshuang Liang,Zhen Huang

DOI: https://doi.org/10.48550/arXiv.1911.02737

2019-11-07

Computation and Language

Abstract:Neural machine translation (NMT) is one of the best methods for understanding the differences in semantic rules between two languages. Especially for Indo-European languages, subword-level models have achieved impressive results. However, when the translation task involves Chinese, semantic granularity remains at the word and character level, so there is still need more fine-grained translation model of Chinese. In this paper, we introduce a simple and effective method for Chinese translation at the sub-character level. Our approach uses the Wubi method to translate Chinese into English; byte-pair encoding (BPE) is then applied. Our method for Chinese-English translation eliminates the need for a complicated word segmentation algorithm during preprocessing. Furthermore, our method allows for sub-character-level neural translation based on recurrent neural network (RNN) architecture, without preprocessing. The empirical results show that for Chinese-English translation tasks, our sub-character-level model has a comparable BLEU score to the subword model, despite having a much smaller vocabulary. Additionally, the small vocabulary is highly advantageous for NMT model compression.
WYWEB: A NLP Evaluation Benchmark For Classical Chinese

Bo Zhou,Qianglong Chen,Tianyu Wang,Xiaomi Zhong,Yin Zhang

DOI: https://doi.org/10.48550/arXiv.2305.14150

2023-05-23

Computation and Language

Abstract:To fully evaluate the overall performance of different NLP models in a given domain, many evaluation benchmarks are proposed, such as GLUE, SuperGLUE and CLUE. The fi eld of natural language understanding has traditionally focused on benchmarks for various tasks in languages such as Chinese, English, and multilingua, however, there has been a lack of attention given to the area of classical Chinese, also known as "wen yan wen", which has a rich history spanning thousands of years and holds signifi cant cultural and academic value. For the prosperity of the NLP community, in this paper, we introduce the WYWEB evaluation benchmark, which consists of nine NLP tasks in classical Chinese, implementing sentence classifi cation, sequence labeling, reading comprehension, and machine translation. We evaluate the existing pre-trained language models, which are all struggling with this benchmark. We also introduce a number of supplementary datasets and additional tools to help facilitate further progress on classical Chinese NLU. The github repository is https://github.com/baudzhou/WYWEB.
Improving the Syllable-Synchronous Network Search Algorithm for Word Decoding in Continuous Chinese Speech Recognition

Zheng Fang,Wu Jian,Song Zhanjiang

DOI: https://doi.org/10.1007/bf02950410

IF: 1.871

2000-01-01

Journal of Computer Science and Technology

Abstract:The Chinese language is syllabic in nature with frequent homonym phenomena and severe word boundary uncertainty problem. This makes the Chinese continuous speech recognition (CSR) slightly difficult. In order to solve these problems, a Chinese syllable-synchronous network search (SSNS) algorithm is proposed. Together with the vocabulary word search tree and the N-gram based language model, the syllable-synchronous network search algorithm gives a good solution to the Chinese syllable-to-word conversion. In addition, this algorithm is a good method for the accent Chinese speech recognition. The experimental results have showed that the SSNS algorithm can achieve a good overall continuous Chinese speech recognition system performance.
Neural Chinese Word Segmentation as Sequence to Sequence Translation

Xuewen Shi,Heyan Huang,Ping Jian,Yuhang Guo,Xiaochi Wei,Yi-Kun Tang

DOI: https://doi.org/10.48550/arXiv.1911.12982

2019-11-29

Computation and Language

Abstract:Recently, Chinese word segmentation (CWS) methods using neural networks have made impressive progress. Most of them regard the CWS as a sequence labeling problem which construct models based on local features rather than considering global information of input sequence. In this paper, we cast the CWS as a sequence translation problem and propose a novel sequence-to-sequence CWS model with an attention-based encoder-decoder framework. The model captures the global information from the input and directly outputs the segmented sequence. It can also tackle other NLP tasks with CWS jointly in an end-to-end mode. Experiments on Weibo, PKU and MSRA benchmark datasets show that our approach has achieved competitive performances compared with state-of-the-art methods. Meanwhile, we successfully applied our proposed model to jointly learning CWS and Chinese spelling correction, which demonstrates its applicability of multi-task fusion.
Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

Ju-Xiao Zhang,Hai-Feng Chen,Bing Chen,Bei-Qin Chen,Jing-Hua Zhong,Xiao-Qin Zeng

DOI: https://doi.org/10.1155/2022/8934241

2022-05-17

Abstract:An important sign of the accessibility of Braille information is the realization of the mutual translation between Chinese and the Braille. Due to the irregularity and uncertainty of the Prevailing Mandarin Braille, coupled with the lack of a large-scale Braille corpus, the quality of Chinese-Braille translation seems to be poor. In July 2018, the National Language Commission released the "Chinese Common Braille Scheme" and advocated replacing the "Prevailing Mandarin Braille." Aimed at improving translation accuracy, this research, which is based on the self-built Chinese Common Braille corpus and combined with the HanLP (Han Language Processing) dictionary and the Chinese-Braille word corpus (a Braille word segmentation and concatenation dictionary for generating a unigram language model), uses the n-gram language model to design and implement a Chinese-Braille intertranslation system that integrates Chinese and Braille Word Segmentation and Concatenation Rules. More importantly, this research proposes an experimental plan for improving the Braille Word Segmentation and Concatenation Rules using a Chinese-Braille word corpus. Experiments show that in the field of educational literature, the accuracy rate of translation from Chinese to Chinese Common Braille has reached 95.01%, and the accuracy of Chinese Common Braille to Chinese translation has reached 90.15%.
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling

Zhijun Wang,Xuebo Liu,Min Zhang

DOI: https://doi.org/10.48550/arXiv.2211.12781

2022-11-23

Abstract:Existing research generally treats Chinese character as a minimum unit for representation. However, such Chinese character representation will suffer two bottlenecks: 1) Learning bottleneck, the learning cannot benefit from its rich internal features (e.g., radicals and strokes); and 2) Parameter bottleneck, each individual character has to be represented by a unique vector. In this paper, we introduce a novel representation method for Chinese characters to break the bottlenecks, namely StrokeNet, which represents a Chinese character by a Latinized stroke sequence (e.g., "ao1 (concave)" to "ajaie" and "tu1 (convex)" to "aeaqe"). Specifically, StrokeNet maps each stroke to a specific Latin character, thus allowing similar Chinese characters to have similar Latin representations. With the introduction of StrokeNet to neural machine translation (NMT), many powerful but not applicable techniques to non-Latin languages (e.g., shared subword vocabulary learning and ciphertext-based data augmentation) can now be perfectly implemented. Experiments on the widely-used NIST Chinese-English, WMT17 Chinese-English and IWSLT17 Japanese-English NMT tasks show that StrokeNet can provide a significant performance boost over the strong baselines with fewer model parameters, achieving 26.5 BLEU on the WMT17 Chinese-English task which is better than any previously reported results without using monolingual data. Code and scripts are freely available at <a class="link-external link-https" href="https://github.com/zjwang21/StrokeNet" rel="external noopener nofollow">this https URL</a>.

Computation and Language,Artificial Intelligence
LIT Team's System Description for Japanese-Chinese Machine Translation Task in IWSLT 2020.

Yimeng Zhuang,Yuan Zhang,Lijie Wang

DOI: https://doi.org/10.18653/v1/2020.iwslt-1.12

2020-01-01

Abstract:This paper describes the LIT Team's submission to the IWSLT2020 open domain translation task, focusing primarily on Japanese-to-Chinese translation direction. Our system is based on the organizers' baseline system, but we do more works on improving the Transformer baseline system by elaborate data preprocessing. We manage to obtain significant improvements, and this paper aims to share some data processing experiences in this translation task. Large-scale back-translation on monolingual corpus is also investigated. In addition, we also try shared and exclusive word embeddings, compare different granularity of tokens like sub-word level. Our Japanese-to-Chinese translation system achieves a performance of BLEU=34.0 and ranks 2nd among all participating systems.
Modern Information Network Technology and the Translation of Foreign Literature

Wanfang Zhang

DOI: https://doi.org/10.1088/1742-6596/1881/3/032036

2021-04-01

Journal of Physics: Conference Series

Abstract:Abstract The rapid development of computer and network technology has provided convenient conditions for translation work. It should be admitted that modern information network technology possesses some advantages in assisting foreign literature translation. Based on this, this paper focuses on how to translate foreign literature by means of modern foreign literature tools and puts forward some suggestions.
Web-based Machine Translation

Haifeng Wang

2011-01-01

Abstract:Machine translation (MT) has been studied for more than 60 years. World-Wide-Web offers more opportunities to MT. We could try to crawl more web data to train the MT system. But we have to filter the very noisy web data. There are many potential web-based applications for MT, such as translation of web-page, translation of instant message, translation of SNS, translation of ecommerce, mobile translation, etc. To make better use of the web data, and to produce better webbased MT applications, we should also adapt the MT methods to the web scenario. In this talk, I will introduce our work on web-based machine translation.

Improving HowNet-Based Chinese WSD with Translations

Exploring the traditional NMT model and Large Language Model for chat translation

Corpus-based Research on English-Chinese Translation Teaching Combining Vocabulary Learning and Practice

Generalized W-Net: Arbitrary-style Chinese Character Synthesization

Improving the Robustness of Speech Translation

kua yu yan ji suan ji wang luo zhong de yu yan tong xun zhang ai ji jie jue ban fa

Better Simultaneous Translation with Monotonic Knowledge Distillation.

WeChat Neural Machine Translation Systems for WMT20

Improved Neural Machine Translation With Smt Features

Try to Substitute: an Unsupervised Chinese Word Sense Disambiguation Method Based on HowNet.

WeChat Neural Machine Translation Systems for WMT21

Resolving error accumulation of automatically acquiring bilingual lexical knowledge by semantic similarity

SubCharacter Chinese-English Neural Machine Translation with Wubi encoding

WYWEB: A NLP Evaluation Benchmark For Classical Chinese

Improving the Syllable-Synchronous Network Search Algorithm for Word Decoding in Continuous Chinese Speech Recognition

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling

LIT Team's System Description for Japanese-Chinese Machine Translation Task in IWSLT 2020.

Modern Information Network Technology and the Translation of Foreign Literature

Web-based Machine Translation