Abstract:With the rapid development of the internet in the past decade, it has become increasingly important to extract valuable information from vast resources efficiently, which is crucial for establishing a comprehensive digital ecosystem, particularly in the context of research surveys and comprehension. The foundation of these tasks focuses on accurate extraction and deep mining of data from scientific documents, which are essential for building a robust data infrastructure. However, parsing raw data or extracting data from complex scientific documents have been ongoing challenges. Current data extraction methods for scientific documents typically use rule-based (RB) or machine learning (ML) approaches. However, using rule-based methods can incur high coding costs for articles with intricate typesetting. Conversely, relying solely on machine learning methods necessitates annotation work for complex content types within the scientific document, which can be costly. Additionally, few studies have thoroughly defined and explored the hierarchical layout within scientific documents. The lack of a comprehensive definition of the internal structure and elements of the documents indirectly impacts the accuracy of text classification and object recognition tasks. From the perspective of analyzing the standard layout and typesetting used in the specified publication, we propose a new document layout analysis framework called CTBR(Compartment & Text Blocks Refinement). Firstly, we define scientific documents into hierarchical divisions: base domain, compartment, and text blocks. Next, we conduct an in-depth exploration and classification of the meanings of text blocks. Finally, we utilize the results of text block classification to implement object recognition within scientific documents based on rule-based compartment segmentation.

The Research and Realization about Automatic Abstracting Based on Text Clustering and Natural Language Understanding

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

Development and Evaluation of Task-Specific NLP Framework in China.

Text Categorization Based on Domain Ontology

Study on Topic Partition in Automatic Abstracting System

An automatic approach for efficient text segmentation

Automatic Abstraction of Long Chinese Patent Texts Based on P-Bertsum Model

Study of Automatic Abstracting Based on Corpus and Hierarchical Dictionary

Automatic Text Summarization Method Based on Improved TextRank Algorithm and K-Means Clustering

Study of Word-Based Chinese Document Experimental System and Chinese Free-Text Information Extraction Experiment Based on It

Automatic Text Generation Via Text Extraction Based On Submodular

Sentences clustering based automatic summarization

Labeling Clusters from Both Linguistic and Statistical Perspectives: A Hybrid Approach

Document Clustering Based on Semantic Smoothing Approach

A Study of Applying Unsupervised Learning Methods for Document Clustering and Automatic Categorization of Software.

Research on Chinese Automatic Segmentation

Chinese Natural Language Processing: From Text Categorization to Machine Translation

A Table of Content Recognition Method of Book Documents Based on Clustering Techniques

Research of Automatic News Summary Report with Topic

Object Recognition from Scientific Document based on Compartment Refinement Framework

Automatic summarization oriented Chinese word extraction and statistics system