Abstract:Natural language processing is an important direction in the field of computer science and artificial intelligence. It can realize various theories and methods of effective communication between humans and computers using natural language. Machine learning is a branch of natural language processing research, which is based on a large-scale English-Chinese database. Due to the relatively poor alignment corpus of English and Chinese bilingual sentences containing unknown words, machine translation is unprofessional and unbalanced, which is the problem studied in this paper. The purpose of this paper is to design and implement a length-based system for sentence alignment between English and Chinese bilingual texts. The research content of this paper is mainly divided into the following parts. First, the evaluation function of bilingual sentence alignment is designed, and on this basis, the bilingual sentence alignment algorithm based on the length and the optimal sentence pair sequence search algorithm is designed. In this paper, China National Knowledge Infrastructure (CNKI) is selected as an English-Chinese bilingual candidate website and English-Chinese bilingual web pages are downloaded. After analyzing the downloaded pages, nontext content such as page tags is removed, and bilingual text information is stored so as to establish an English-Chinese bilingual corpus based on segment alignment and retain English-Chinese bilingual keywords in the web pages. Second, extract the dictionary from the software StarDict, analyze the original dictionary format, and turn it into a custom dictionary format, which is convenient and better to use the double-sentence sentence alignment system, which is conducive to expanding the number of dictionaries and increasing the professionalism of vocabulary. Finally, we extract the stems of English words from the established corpus to simplify the complexity of English word processing, reduce the noise caused by the conversion of word parts of speech, and improve the operation efficiency. A bilingual sentence alignment system based on length is implemented. Finally, the system parameters are adjusted for comparative experiments to test the system performance.

Resolving error accumulation of automatically acquiring bilingual lexical knowledge by semantic similarity

Constructing a WordNet-Based Multilingual Lexical-semantic Net:A Semi-automatic Method

Some Issues In The Construction Of A Multi-Lingual Lexical-Semantic Net

Application-Oriented Comparison and Evaluation of Six Semantic Similarity Measures Based on Wordnet

Merge Information in HowNet and TongYiCi CiLin

Construction of a Chinese Semantic Dictionary by Integrating Two Heterogeneous Dictionaries: TongYiCi Cilin and HowNet

Research on Hownet-Based Chinese Word Lexical Semantic Similarity Measurement

On Construction of a Chinese Corpus Bused on Semantic Dependency Relations

Building a bilingual WordNet-like lexicon: the new approach and algorithms

Sememe Tree Prediction for English-Chinese Word Pairs.

Multi-Fusion Chinese WordNet (MCW) : Compound of Machine Learning and Manual Correction

Unsupervised Word Sense Discrimination Improves Construction of the Wordnets.

Try to Substitute: an Unsupervised Chinese Word Sense Disambiguation Method Based on HowNet.

Wordnet Based Comparison Of Language Variation: A Study Based On Ccd And Cwn

Design of New Word Retrieval Algorithm for Chinese-English Bilingual Parallel Corpus

Development of Translation Database based on Chinese-English parallel corpora

Research on the Modeling of Semantic-Based Web Resources Feature.

A Local Information Perception Enhancement–Based Method for Chinese NER

Valency Dictionaries and Chinese Vocabulary Acquisition for Foreign Learners

Improving Chinese Dependency Parsing with Lexical Semantic Features

Sddb: A Self-Dependent And Data-Based Method For Constructing Bilingual Dictionary From The Web