Abstract:As the demand for global information increases significantly, multilingual corpora has become a valuable linguistic resource for applications to cross‐lingual information retrieval and natural language processing. In order to cross the boundaries that exist between different languages, dictionaries are the most typical tools. However, the general‐purpose dictionary is less sensitive in both genre and domain. It is also impractical to manually construct tailored bilingual dictionaries or sophisticated multilingual thesauri for large applications. Corpus‐based approaches, which do not have the limitation of dictionaries, provide a statistical translation model with which to cross the language boundary. There are many domain‐specific parallel or comparable corpora that are employed in machine translation and cross‐lingual information retrieval. Most of these are corpora between Indo‐European languages, such as English/French and English/Spanish. The Asian/Indo‐European corpus, especially English/Chinese corpus, is relatively sparse. The objective of the present research is to construct English/Chinese parallel corpus automatically from the World Wide Web. In this paper, an alignment method is presented which is based on dynamic programming to identify the one‐to‐one Chinese and English title pairs. The method includes alignment at title level, word level and character level. The longest common subsequence (LCS) is applied to find the most reliable Chinese translation of an English word. As one word for a language may translate into two or more words repetitively in another language, the edit operation, deletion, is used to resolve redundancy. A score function is then proposed to determine the optimal title pairs. Experiments have been conducted to investigate the performance of the proposed method using the daily press release articles by the Hong Kong SAR government as the test bed. The precision of the result is 0.998 while the recall is 0.806. The release articles and speech articles, published by Hongkong & Shanghai Banking Corporation Limited, are also used to test our method, the precision is 1.00, and the recall is 0.948.

Automatic Collecting of Text Data for Cantonese Language Modeling

Advances in Cantonese Speech Recognition: A Language-Specific Pretraining Model and RNN-T Loss

Cantonese neural speech synthesis from found newscasting video data and its speaker adaptation

A CANTONESE ACCENT CHINESE SPEECH CORPUS

CANTONMT: Investigating Back-Translation and Model-Switch Mechanisms for Cantonese-English Neural Machine Translation

Cantonese natural language processing in the transformers era: a survey and current challenges

How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models

ATCSpeech: A Multilingual Pilot-Controller Speech Corpus from Real Air Traffic Control Environment

Statistically-based Model for Computer-Aided Transcription Application

Automatic Conversion from Phonetic to Textual Representation of Cantonese : the Case of Hong Kong Court Proceedings.

Designing and implementing a corpus-based online pronunciation learning platform for Cantonese learners of Mandarin

Automatic construction of English/Chinese parallel corpora

From Synchronous Corpus To Monitoring Corpus, Livac: The Chinese Case

Data Augmentation for Code-Switch Language Modeling by Fusing Multiple Text Generation Methods.

Cantonese Automatic Speech Recognition Using Transfer Learning from Mandarin

Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien

A Manually Annotated Chinese Corpus for Non-task-oriented Dialogue Systems

The Construction of Chinese Multi-dimensional Learner Corpus:YACLC

Co-training for Cross-Lingual Sentiment Classification

MC$^2$: Towards Transparent and Culturally-Aware NLP for Minority Languages in China

Lightly supervised acoustic model training for mandarin continuous speech recognition