Abstract:Collocation is a lexical phenomenon in which two or more words are habitually combined together as some conventional way of saying things. Collocation information is essential to many natural language processing tasks such as word sense disambiguation, machine translation, and information extraction. Most of current works on collocation extraction are statistical based with limited precision and recall because they cannot well distinguish word co-occurrences, which are statistically significant, from true collocations, which are of habitual use and are thus either syntactically or semantically significant. The objective of this study is to investigate methods to improve the performance of collocation extraction algorithms. Different types of collocations are identified. Collocation extraction algorithms are then designed to target on different types of collocations using different features and criteria associated with these different types. In addition to improve statistical based collocation extraction algorithms, additional syntactic and semantic information are also incorporated into the algorithm to further improve the performance of collocation extraction. On the study of the statistical based algorithms, a new algorithm based on bi-directional word bi-grams is designed to help identify collocations with low co-occurrence frequency and are of fixed use. A large scale collocation answer set is established so that collocation extraction algorithms can be evaluated and compared objectively by using the same training corpus and corresponding answer set. Collocations are then categorized into four types based on their compositionality, substitutability, and modifiability. Based on the characteristics of each type of collocations, a multi-stage window-based collocation extraction is built where the n-gram collocations and different types of bi-gram collocations are separately extracted in different stages using different strategies and different discriminative features. A shallow Treebank, referred to as the PolyU Treebank, is annotated manually to provide syntactic and semantic knowledge to further help collocation extraction. This treebank is also used to train a chunker based on lexicalized Hidden Markov Model (HMM). The chunker provides ways to process running text for collocation extraction. By using the support collocation patterns and reject collocation patterns extracted from the annotated treebank and parsed running text, syntactic features are employed to further improve the performance of the window-based collocation extraction system. Experimental results show that the use of syntactic patterns can significantly improve the performance of collocation extraction, especially for filtering pseudo collocations. The extracted collocations were applied in the post-processing of a handwritten Chinese character recognition system. Experiments indicate that collocation information can be used in real application to improve the performance of these natural language related applications. It should be pointed out that this work focuses on collocation extraction of Chinese text. However, the techniques developed are applicable to other languages although separate annotations and understanding to different syntactical and semantics knowledge are needed. Keyword: Natural language processing, collocation extraction, Treebank, Chunking and parsing.

Testing the Use of a Collocation Retrieval Tool Without Prior Training by Learners of Spanish

Collocation Use in EFL Learners’ Writing Across Multiple Language Proficiencies: A Corpus-Driven Study

A Mixed-Methods Investigation of the Effectiveness and Perceptions of Learning English Collocations Using the Keyword Method and the Rote Learning Method

The use of previously known languages and target language (English) during task-based interaction: A pseudolongitudinal study of primary-school CLIL learners

From one language to the other: Examining the role of code-switching on vocabulary learning in adult second-language learners

Language Transfer in Chinese EFL Learners’ Receptive Vocabulary Knowledge of Delexical and Lexical Verb+Noun Collocations

TESTING CONTROLLED PRODUCTIVE KNOWLEDGE OF ADVERB-VERB COLLOCATIONS IN JUNIOR RESEARCHERS USING ENGLISH AS A FOREIGN LANGUAGE

EFL Learners' Collocation Acquisition and Learning in Corpus-Based Instruction: A Systematic Review

The impact of textual enhancement and frequency manipulation on incidental learning of collocations from reading

Are collocations worth teaching in adult learner English as a foreign language (EFL) classes?

Automatic Cloze Generation for English Proficiency Testing

An experimental study on grammatical sensitivity and production competence in Chinese and Spanish EFL learners and its implications on EFL teaching methods

Learner's Corpus-based Study on the Learners' Verb-object-noun Collocation

CAT Tools Usability Test with Eye-Tracking and Key-Logging: Where Translation Studies Meets Natural Language Processing

More evidence that a usage-based, applied cognitive linguistics approach is effective for teaching the Spanish prepositions por and para

THE JOURNAL OF TEACHING ENGLISH FOR SPECIFIC AND ACADEMIC PURPOSES

Spanish as a resource in the acquisition of English as a second language

The Study on Automatic Chinese Collocation Extraction

The effect of corpus-assisted language teaching on academic collocation acquisition by Iranian advanced EFL learners

Productive vocabulary learning in pre-primary education through soft CLIL

The Role of Visual Cues in the Keyword Method: Assessing Variations of the Mnemonic Approach in L2 Vocabulary Learning