Abstract:Data selection has shown significant improvements in effective use of training data by extracting sentences from large general-domain corpora to adapt statistical machine translation (SMT) systems to in-domain data. This paper performs an in-depth analysis of three different sentence selection techniques. The first one is cosine tf-idf, which comes from the realm of information retrieval (IR). The second is perplexity-based approach, which can be found in the field of language modeling. These two data selection techniques applied to SMT have been already presented in the literature. However, edit distance for this task is proposed in this paper for the first time. After investigating the individual model, a combination of all three techniques is proposed at both corpus level and model level. Comparative experiments are conducted on Hong Kong law Chinese-English corpus and the results indicate the following: (i) the constraint degree of similarity measuring is not monotonically related to domain-specific translation quality; (ii) the individual selection models fail to perform effectively and robustly; but (iii) bilingual resources and combination methods are helpful to balance out-of-vocabulary (OOV) and irrelevant data; (iv) finally, our method achieves the goal to consistently boost the overall translation performance that can ensure optimal quality of a real-life SMT system.

Improving English Subcategorization Acquisition with Diathesis Alternations As Heuristic Information.

A CRF-based Method for Automatic Construction of Chinese Symptom Lexicon

Chinese Verb's Subcategorization Frame Acquisition from Unreliably Parsed Corpus

The Acquisition of Chinese Verb's Subcategorization Frame Types Based on Linguistic Theory and Statistical Algorithm

Valency Dictionaries and Chinese Vocabulary Acquisition for Foreign Learners

VALENCY AND ENGLISH LEARNERS' THESAURI

A New Corpus of Lexical Substitution and Word Blend Errors: Probing the Semantic Structure of Lemma Access Failures

Research on Chinese Selectional Preferences Acquisition

Researches on Word Sense Discrimination of Chinese Adjective

Human-Computer Interactive Chinese Word Segmentation: an Adaptive Dirichlet Process Mixture Model Approach.

CityU-DAC: Disambiguating Sentiment-Ambiguous Adjectives Within Context.

Resolving error accumulation of automatically acquiring bilingual lexical knowledge by semantic similarity

Acquisition d'informations lexicales à partir de corpus Cédric Messiant et Thierry Poibeau

Automatic Correction of Definite Article Redundancy Error in the English Compositions of College Students

An Interactive Method for Lexicalized Parsing and Subcategorization Frame Acquisition

Learning Grammar With Explicit Annotations For Subordinating Conjunctions

Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization

Semantic Augmentation in Chinese Adversarial Corpus for Discourse Relation Recognition Based on Internal Semantic Elements

A Kalman Filter Based Human-Computer Interactive Word Segmentation System For Ancient Chinese Texts

A Systematic Comparison of Data Selection Criteria for SMT Domain Adaptation

Disambiguation of morpho-syntactic features of African American English -- the case of habitual be