Cross-domain Chinese Sentence Pattern Parsing

Jingsi Yu,Cunliang Kong,Liner Yang,Meishan Zhang,Lin Zhu,Yujie Wang,Haozhe Lin,Maosong Sun,Erhong Yang

2024-04-08

Abstract:Sentence Pattern Structure (SPS) parsing is a syntactic analysis method primarily employed in language teaching.Existing SPS parsers rely heavily on textbook corpora for training, lacking cross-domain

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

Chinese Question Answering System-Oriented Chinese Parsing

ZHANG Liang,WANG Shu-mei,HUANG He-yan,ZHANG Xiao-fei

DOI: https://doi.org/10.3969/j.issn.1671-9352.2006.03.008

2006-01-01

Abstract:Chinese syntactic parsing is a key of Chinese study and Chinese information processing,as well as a difficulty.The characteristics of Chinese question sentence are discussed.In Chinese question answering system-oriented Chinese parsing,cor-pus-based syntactic processes are applied.Chinese question sentence short,question word,question structure etc are employed.The preliminary experiment result shows that its performance can achieve design goal.
Formalized Chinese Sentence Pattern Structure and Its Hierarchical Analysis

Weiming Peng,Zuntian Wei,Jihua Song,Shiwen Yu,Zhifang Sui

DOI: https://doi.org/10.1007/978-3-031-06703-7_22

2022-01-01

Abstract:Sentence Patterns (sic) have always been important in Chinese grammar teaching, but they lack the corresponding formal representation that fits with information processing. Sentence pattern analysis in Chinese grammar teaching generally adopts Sentence Component Analysis (sic), while the dichotomy idea of the Hierarchical Analysis of Phrase Structure (sic) is dominant in the construction of mainstream Chinese Treebank. This situation impedes the exchange and resource sharing between these two application areas. This paper reviews the formalized schema of Sentence Pattern Structure which is subject to the Diagrammatic Syntactic Analysis (sic) of Sentence-based Grammar (sic), and expounds its hierarchical characteristics and application value in teaching Chinese as a foreign language.
Researches on Large Scale Corpus-Based Syntactic Pattern Matching

ZHANG Liang,CHEN Jia-jun

DOI: https://doi.org/10.3969/j.issn.1003-0077.2007.05.006

2007-01-01

Abstract:Based on a large amount of rightly parsed examples with which both parsing procedures and parsing results are recorded,syntactic parsing can be carried out by searching similar example or fragment,and matching similar language structure and analysis in the examples.This embodies the assumption that human language perception and production work with representations of concrete language experiences,rather than with abstract grammar rules.In this paper,we propose a new parsing technique based on syntactic pattern matching.We extract syntactic patterns from a large-scale tree bank,and establish a library of syntactic patterns/sub-patterns and corresponding reduction procedures beforehand.Parsing tasks are fulfilled by pattern matching and partial pattern transforming.The experiments show that the parsing results are satisfying and the program execution speed is very high,achieving 0.46s/per sentence on average(CPU: Intel Core Duo 2.8G,Memory:1G).
Exploiting Lexicalized Statistical Patterns in Chinese Linguistic Analysis

Yu Zhao,Maosong Sun

DOI: https://doi.org/10.1007/978-3-642-41491-6_22

2013-01-01

Abstract:The web corpus has been used for linguistic analysis with the help of search engines. In this paper, we describe the concept of lexicalized patterns, which we exploit to obtain statistical information using the simple string matching strategy via search engines. We discuss the usage of lexicalized statistical patterns at three linguistic levels of Chinese analysis: lexical, syntactic and semantic. We develop a specialized search engine to get frequency counts for these patterns on SogouT corpus. Experimental results show that lexicalized statistical patterns are effective on analyzing the cohesion of phrases, determining the phrasal category and discovering patient objects.
X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing

Zihan Liu,Genta Indra Winata,Peng Xu,Pascale Fung

DOI: https://doi.org/10.48550/arXiv.2106.03777

2021-06-08

Abstract:Task-oriented compositional semantic parsing (TCSP) handles complex nested user queries and serves as an essential component of virtual assistants. Current TCSP models rely on numerous training data to achieve decent performance but fail to generalize to low-resource target languages or domains. In this paper, we present X2Parser, a transferable Cross-lingual and Cross-domain Parser for TCSP. Unlike previous models that learn to generate the hierarchical representations for nested intents and slots, we propose to predict flattened intents and slots representations separately and cast both prediction tasks into sequence labeling problems. After that, we further propose a fertility-based slot predictor that first learns to dynamically detect the number of labels for each token, and then predicts the slot types. Experimental results illustrate that our model can significantly outperform existing strong baselines in cross-lingual and cross-domain settings, and our model can also achieve a good generalization ability on target languages of target domains. Furthermore, our model tackles the problem in an efficient non-autoregressive way that reduces the latency by up to 66% compared to the generative model.

Computation and Language,Artificial Intelligence
Quantitative Research on Chinese Sentences Structure Based on Pattern Grammar

Jie Song,Congcong Yang,Yichu Sun,Yunhua Qu,Kuizi Ma,Huiying Cai

DOI: https://doi.org/10.1177/21582440241268641

IF: 2.032

2024-01-01

SAGE Open

Abstract:With the proliferation of corpora, various syntactic analysis methodologies have been developed. However, syntactic analysis of Chinese sentences demands a theory that focuses more on word order and the interaction between content and function words, which is satisfied by pattern grammar theory. This study investigates the effectiveness of pattern grammar theory in the analysis of Chinese sentence structure and explores the linguistic characteristics of official documents by establishing a description system for structural complexity in Chinese. Statistical methods such as skewness, kurtosis, and correlation analyses were employed to evaluate the system’s performance. The findings confirm the effectiveness of pattern grammar in analyzing Chinese sentence structure by showing that it can accurately reflect the unique properties of Chinese official documents, such as the preference for fixed collocations, declarative sentences, and flat structures. Based on the above findings, this study provides a semantically compatible and innovative theoretical system for analyzing Chinese sentence structures.
Chinese Parsing Exploiting Characters.

Meishan Zhang,Yue Zhang,Wanxiang Che,Ting Liu

2013-01-01

Abstract:Characters play an important role in the Chinese language, yet computational processing of Chinese has been dominated by word-based approaches, with leaves in syntax trees being words. We investigate Chinese parsing from the character-level, extending the notion of phrase-structure trees by annotating internal structures of words. We demonstrate the importance of character-level information to Chinese processing by building a joint segmentation, part-of-speech (POS) tagging and phrase-structure parsing system that integrates character-structure features. Our joint system significantly outperforms a state-of-the-art word-based baseline on the standard CTB5 test, and gives the best published results for Chinese parsing.
Semantic Dependency Analysis of Special Sentence Patterns in Ancient Chinese.

Xuan Chen,Yanqiu Shao

DOI: https://doi.org/10.1007/978-3-031-28953-8_26

2023-01-01

Abstract:With the development of natural language processing, automatic semantic analysis has attracted more and more attention. This research delineates the semantic dependency labeling rules of several kinds of special sentence patterns in ancient Chinese. And we compare the result of manual annotation with automatic semantic parser and put forward improvement methods to those poor results. This research can help to improve the semantic understanding of ancient Chinese, the translation of ancient Chinese and the perfomance of parser to a certain extent.
Cross-Lingual Universal Dependency Parsing Only from One Monolingual Treebank

Kailai Sun,Zuchao Li,Hai Zhao

DOI: https://doi.org/10.1109/tpami.2023.3291388

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Syntactic parsing is a highly linguistic processing task whose parser requires training on treebanks from the expensive human annotation. As it is unlikely to obtain a treebank for every human language, in this work, we propose an effective cross-lingual UD parsing framework for transferring parser from only one source monolingual treebank to any other target languages without treebank available. To reach satisfactory parsing accuracy among quite different languages, we introduce two language modeling tasks into the training process of dependency parsing as multi-tasking. Assuming only unlabeled data from target languages plus the source treebank can be exploited together, we adopt a self-training strategy for further performance improvement in terms of our multi-task framework. Our proposed cross-lingual parsers are implemented for English, Chinese, and 29 UD treebanks. The empirical study shows that our cross-lingual parsers yield promising results for all target languages, approaching the parser performance which is trained in its own target treebank.
Zero-shot Chinese Discourse Dependency Parsing via Cross-lingual Mapping

Yi Cheng,Sujian Li

DOI: https://doi.org/10.48550/arXiv.1911.12014

2019-11-27

Computation and Language

Abstract:Due to the absence of labeled data, discourse parsing still remains challenging in some languages. In this paper, we present a simple and efficient method to conduct zero-shot Chinese text-level dependency parsing by leveraging English discourse labeled data and parsing techniques. We first construct the Chinese-English mapping from the level of sentence and elementary discourse unit (EDU), and then exploit the parsing results of the corresponding English translations to obtain the discourse trees for the Chinese text. This method can automatically conduct Chinese discourse parsing, with no need of a large scale of Chinese labeled data.
Lexical Issues in Chinese Information Processing:in the Background of Sentence-based Diagram Treebank Construction

Weiming PENG,Jihua SONG,Shiwen YU

DOI: https://doi.org/10.3969/j.issn.1003-0077.2014.02.001

2014-01-01

Abstract:This paper compares the Sentence-based DiagramTreebank with existing lexical specification in the aspect of word segmentation unit and POStagging,revealing the disjunction between automatic lexical analysis and parsing in the current Chinese information processing.It describes the parsing strategy of some special structures such as nonce formation and idiomsin the Diagram Treebank as well as their linguistics rationale.It also explores the implementation of the Chinese word classtheories such asFor All Words,the Word-class Is Based on the Sentenceand Referentialityin Chinese information processing.
Discourse Representation Structure Parsing for Chinese

Chunliu Wang,Xiao Zhang,Johan Bos

2023-06-16

Abstract:Previous work has predominantly focused on monolingual English semantic parsing. We, instead, explore the feasibility of Chinese semantic parsing in the absence of labeled data for Chinese meaning representations. We describe the pipeline of automatically collecting the linearized Chinese meaning representation data for sequential-to sequential neural networks. We further propose a test suite designed explicitly for Chinese semantic parsing, which provides fine-grained evaluation for parsing performance, where we aim to study Chinese parsing difficulties. Our experimental results show that the difficulty of Chinese semantic parsing is mainly caused by adverbs. Realizing Chinese parsing through machine translation and an English parser yields slightly lower performance than training a model directly on Chinese data.

Computation and Language
Study on Question Parsing of Restricted-Domain Chinese Question Answering System

蒋昌金,彭宏,马千里,林正春,王成

DOI: https://doi.org/10.16208/j.issn1000-7024.2010.11.041

2010-01-01

Abstract:Question parsing is a very important part of a question answering system and it has significant effect on the following searching module and answer extracting module.First profound research and analysis has been made for the question parsing module of a Chinese question answering system,and then the construction of the domain dictionary which used to Chinese named entity recognition is described.In order to identify the type of a question,a question type list is constructed.After parsing and segmenting a question,the nouns,verbs and adjectives in it are extracted.These words extracted from the question formed an initial query vector.This initial query vector is extended to an extended query vector by adding synonyms of the nouns and verbs in it and associate words of its type.The experimental results show that the query using query vector has a higher precision than the query using original question.
A New Robust and Domain-Oriented Algorithm of Text Parsing

TAO Xianjun,WU Xiaojun,WANG Xiaodong,ZHENG Fang

DOI: https://doi.org/10.3969/j.issn.1003-0077.2010.04.006

2010-01-01

Abstract:In applications of natural language processing,especially in processing of spoken or web text,errors in word spelling and/or sentence structures are common to be found in the text to be processed.This paper describes a robust parsing algorithm based on the chart parsing method,which can identify the mistakes in the strings unrecognized by the domain vocabulary based word segmentation,and fix them into the correct forms according to the terminal information extracted from the current active arcs and the rule set.The experimental results showed that with error detection and correction by homonymous matching of pinyin syllables,this algorithm improvs the acception rate by 14.78% at the cost of an increase in the average number of loops by 9.363% compared with the robust parsing method of Yan.
Spontaneous Speech Parsing in Travel Information Inquiring and Booking Systems

Yan Pengju,Zheng Fang,Sun Hui,Xu Mingxing

DOI: https://doi.org/10.1007/bf02960785

2002-01-01

Abstract:Grammar-based parsing is a prevalent method for natural language understanding (NLU) and has been introduced into dialogue systems for spoken language processing (SLP). A robust parsing scheme is proposed in this paper to overcome the notorious phenomena, such as garbage, ellipsis, word disordering, fragment, and ill-form, which frequently occur in spoken utterances. Keyword categories are used as terminal symbols, and the definition of grammar is extended by introducing three new rule types, by-passing, up-messing and overcrossing, in addition to the general rules called up-tying in this paper, and the use of semantic items simplifies the semantics extraction. The corresponding parser marionette, which is essentially a partial chart parser, is enhanced to parse the semantic grammar. The robust parsing scheme integrating the above methods has been adopted in an air traveling information service system called EasyFlight, and has achieved a high performance when used for parsing spontaneous speeches.
“Subject-predicate predicate sentences” in modern Mandarin Chinese: A Cardiff Grammar approach

Wei He

DOI: https://doi.org/10.1515/ling-2017-0015

2017-01-01

Linguistics

Abstract:Abstract This study investigates “subject-predicate predicate sentences” (“S-P P sentences”) in modern Mandarin Chinese from a Cardiff Grammar approach with the aim of answering three main questions: (i) What is/are the functional syntactic structure(s) of the sentences to be considered in the study? (ii) What is/are the semantic motivation(s) for the structure(s)? (iii) What is/are the contextual constraints on the structure(s)? The study is guided by three basic principles: (a) language is multifunctional; (b) meaning is primary while form is the realization of meaning; and (c) different strands of meaning are realized by a single syntactic structure. Further, the study utilizes the concepts of Theme and Subject within the Cardiff Grammar in order to analyze and discuss the generally acknowledged seven types of “S-P P sentences”. The results show that only one type is truly S-P P and another type only in one sense, whereas no other types can be categorized as such. All the syntactic structures are conditioned by a different set of distinctive semantic features and contextual factors.

linguistics
Adversarial Domain Adaptation For Chinese Semantic Dependency Graph Parsing

Huayong Li,Zizhuo Shen,Dianqing Liu,Yanqiu Shao

DOI: https://doi.org/10.1007/978-3-030-32381-3_5

2019-01-01

Abstract:The Chinese Semantic Dependency Graph (CSDG) Parsing reveals the deep and fine-grained semantic relationship of Chinese sentences, and the parsing results have a great help to the downstream NLP tasks. However, most of the existing work focuses on parsing in a single domain. When transferring to other domains, the performance of the parser tends to drop dramatically. And the target domain often lacks the annotated data, so it is difficult to train the parser directly in the target domain. To solve this problem, we propose a lightweight yet effective domain adaptation component for CSDG parsing that can be easily added to the architecture of existing single domain parser. It contains a data sampling module and an adversarial training module. Furthermore, we present CC SD, the first Chinese Cross-domain Semantic graph Dependency dataset. Experiments show that with the domain adaptation component we proposed, the model can effectively improve the performance in the target domain. On the CCSD dataset, our model achieved state-of-the-art performance with significant improvement compared to the strong baseline model.
Word alignment-based Chinese deep semantic parsing

Xiaodong ZHENG,Hanhui HU,Lindu ZHAO,Yongtao LV

DOI: https://doi.org/10.3778/j.issn.1002-8331.1707-0132

2017-01-01

Abstract:Semantic parsing is the task of transforming natural-language sentences into complete,formal,symbolic Mean-ing Representations(MR)suitable for reasoning or machine-understanding.In recent years,the research of semantic pars-ing in English has made great progress.However,little work has been done in Chinese semantic parsing.There are inher-ent differences between Chinese and English,therefore one cannot simply apply methods,which are feasible for English, to Chinese.This paper proposes a statistical approach called WACSP aiming at Chinese semantic parsing,which considers the process of converting Chinese sentence into its corresponding meaning as a machine translation procedure.At first,it turns the frequently-used dataset GEOQUERY into Chinese dataset,in which each data contains a Chinese sentence and its accurate meaning.Then it uses the word alignment model to acquire the bilingual dictionary made up by the Chinese natural language string and its meaning. In the end, it determines the ultimate semantic analysis by learning a statistical model.Experimental results show that WACSP performs well with higher precision and coverage.
Application of Grammatical Parsing Technique in Chinese Input

Yu Shiwen

DOI: https://doi.org/10.1007/bf02945283

IF: 1.871

1990-01-01

Journal of Computer Science and Technology

Abstract:In Peking University Computer Research Institute (PUCRI) a method of inputting Chinese sentences based on words has been developed. To reduce the troubles in choosing one word out of the others characterized by the same feature, grammatical parsing technique is applied to the method and good results have been achieved. This article describes the outline of the method, the principle of applying grammatical formulas and the branch-cutting algorithm used to speed up the grammatical parsing.
CHUNK PARSING SCHEME FOR CHINESE SENTENCES

Qiang ZHOU,Mao-Song SUN,Chang-Ning HUANG

DOI: https://doi.org/10.3321/j.issn:0254-4164.1999.11.008

1999-01-01

Chinese Journal of Computers

Abstract:This paper proposed the chunk parsing scheme , a shallow syntactic knowledge representation system with the descriptive ability between part of speech serial and parse tree representation, and discussed some basic concepts and automatic identification algorithms for its two main parts: word boundary stems and constituent groups. Based on this scheme, this paper also proposed a new treebank annotation strategy, i.e. from chunk bank to treebank, and carried out several syntactic parsing and knowledge acquisition experiments, such as 1) the automatic identification of Chinese maximal noun phrases, 2) the automatic acquisition of Chinese probabilistic context free grammar knowledge. All these work shows its usefulness and efficiency for natural language processing research and development.

Cross-domain Chinese Sentence Pattern Parsing

Chinese Question Answering System-Oriented Chinese Parsing

Formalized Chinese Sentence Pattern Structure and Its Hierarchical Analysis

Researches on Large Scale Corpus-Based Syntactic Pattern Matching

Exploiting Lexicalized Statistical Patterns in Chinese Linguistic Analysis

X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing

Quantitative Research on Chinese Sentences Structure Based on Pattern Grammar

Chinese Parsing Exploiting Characters.

Semantic Dependency Analysis of Special Sentence Patterns in Ancient Chinese.

Cross-Lingual Universal Dependency Parsing Only from One Monolingual Treebank

Zero-shot Chinese Discourse Dependency Parsing via Cross-lingual Mapping

Lexical Issues in Chinese Information Processing:in the Background of Sentence-based Diagram Treebank Construction

Discourse Representation Structure Parsing for Chinese

Study on Question Parsing of Restricted-Domain Chinese Question Answering System

A New Robust and Domain-Oriented Algorithm of Text Parsing

Spontaneous Speech Parsing in Travel Information Inquiring and Booking Systems

“Subject-predicate predicate sentences” in modern Mandarin Chinese: A Cardiff Grammar approach

Adversarial Domain Adaptation For Chinese Semantic Dependency Graph Parsing

Word alignment-based Chinese deep semantic parsing

Application of Grammatical Parsing Technique in Chinese Input

CHUNK PARSING SCHEME FOR CHINESE SENTENCES