Abstract:We present MARS (Multilingual Automatic tRanslation System), a research prototype speech-to-speech translation system. MARS is aimed at two-way conversational spoken language translation between English and Mandarin Chinese for limited domains, such as air travel reservations. In MARS, machine translation is embedded within a complex speech processing task, and the translation performance is highly effected by the performance of other components, such as the recognizer and semantic parser, etc. All components in the proposed system are statistically trained using an appropriate training corpus. The speech signal is first recognized by an automatic speech recognizer (ASR). Next, the ASR-transcribed text is analyzed by a semantic parser, which uses a statistical decision-tree model that does not require hand-crafted grammars or rules. Furthermore, the parser provides semantic information that helps further re-scoring of the speech recognition hypotheses. The semantic content extracted by the parser is formatted into a language-independent tree structure, which is used for an interlingua based translation. A Maximum Entropy based sentence-level natural language generation (NLG) approach is used to generate sentences in the target language from the semantic tree representations. Finally, the generated target sentence is synthesized into speech by a speech synthesizer. Many new features and innovations have been incorporated into MARS: the translation is based on understanding the meaning of the sentence; the semantic parser uses a statistical model and is trained from a semantically annotated corpus; the output of the semantic parser is used to select a more specific language model to refine the speech recognition performance; the NLG component uses a statistical model and is also trained from the same annotated corpus. These features give MARS the advantages of robustness to speech disfluencies and recognition errors, tighter integration of semantic information into speech recognition, and portability to new languages and domains. These advantages are verified by our experimental results.

On the Nature of "Language of Mars"

On the Reasons for the Emergence and Prevalence of ＂language of Mars＂ from the Eco-linguistic Viewpoint

"Mars" Character of the Composition Analysis

On Language Characteristics Of Movie Translation And Translation Approaches

Language Is a Complex Network

On Network Language

Multilingual Creativity on China's Internet

Language Without Words: A Pointillist Model for Natural Language Processing

How Does Language Change As a Lexical Network? an Investigation Based on Written Chinese Word Co-Occurrence Networks

Unveiling dynamics of language visibility and vitality in café menus near Labrang Monastery

EMPIRICAL CHARACTERIZATION OF MODERN CHINESE AS A MULTI-LEVEL SYSTEM FROM THE COMPLEX NETWORK APPROACH

The Linguistic Art Style of “The Communist Manifesto”

An Analysis on the Typicality of Language Landscape in North China Electric Power University

An In-Depth Study of the Impact of Internet Terms on People's Language

A Discussion on Chinese Translation of the Word "Landscape" and Its Derivatives

Signifier of Chinese Language and Its Effect on Chinese Literature and Culture

Enacting Chinese-ness on Arab Land: A Case Study of the Linguistic Landscape of an (Emerging) Chinatown in Multilingual and Multicultural Dubai

Sociolinguistics Analysis of Internet Language under the Background of New Media

A linguistic landscape study of shop signs on Barkhor Street in Lhasa

Study on Space Design Based on Local Culture Words

MARS: A Statistical Semantic Parsing and Generation-Based Multilingual Automatic Translation System