Abstract:Relevance analysis is a regular and important task in many technical fields. We can get the relevance score by measuring (or quantifying) the result of relevance analysis. In this paper, we have reviewed two main tools for relevance measure, which are the covariance and the mutual information, and we have discussed that there may be some problems in relevance measure if we use the above two methods, then we give the definition on Partial Condition Entropy(PCE) based on the information theory and presented a new method for relevance measure by using the PCE. There are mainly three advantages for relevance measure by using our method: (1) The relevance degree can be compared more easy than other methods because the score of relevance calculation is equal to a numeral between 0 and 1;(2) By using the method, we can not only know whether there is relevance between the considered events but also get a special score that represents the relevance degree of these events; (3) When we calculate the PCE, we needn't know all the conditional probability density, so our method is more flexible than the calculation of mutual information. To demonstrate the usefulness of our method for relevance measure, we apply it to the sentence relevance analysis in Natural Language Processing(NLP). We find that our result of relevance measure is a more truly reflection on the relationship between the sentences.

Using quantitative context relevance analysis for text segmentation

A Practical Approach for Relevance Measure of Inter-sentence

Query Segmentation for Relevance Ranking in Web Search

A New Approach to Query Segmentation for Relevance Ranking in Web Search

A Semantic Relevancy Measure Algorithm of Chinese Sentences.

An automatic approach for efficient text segmentation

A New Method of Relevance Measure and Its Applications

A Pragmatic Approach for Classical Chinese Word Segmentation.

Method of Semantic Relevance Relation Measurement Between Words

A Hybrid Approach to the Real World Text Segmentation

Survey on Chinese Word Segmentation

Chinese word segmentation at Peking University

Chinese Term Extraction Using Different Types of Relevance.

Using multiple discriminant analysis approach for linear text segmentation

A hybrid Chinese word segmentation model for quality management-related texts based on transfer learning

Finding Salient Context based on Semantic Matching for Relevance Ranking

Segmentation of Chinese Discourse in Content-Based Information Retrieval.

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

Study on influences of different Chinese word segmentation methods to text automatic classification based on LDA model

A Hybrid Approach of Text Segmentation Based on Sensitive Word Concept for NLP

Mining Subtopics from Text Fragments for a Web Query