Abstract:Document Layout Analysis (DLA) is critical for understanding and reconstructing documents, which aims to automatically recognize the layout structure of basic or semantic elements within a document. However, a DLA process faces certain challenges due to the diversity and complexity of document layouts with a variety of languages. In particular, it needs more theoretical and practical investigations for analyzing Chinese documents. This paper proposes a fusion framework of Whitespace Smear Cutting (WSC) and Swin Transformer for layout analysis, mainly in Chinese documents. Specifically, in the first phase, we perform a new kind of unsupervised segmentation of document images with our proposed WSC algorithm that can preserve the delicate edges of the connected blocks of a document. In the second phase, we utilize a novel semantic segmentation network based on the Swin Transformer for pixel-level classification. We design a new training paradigm of continuous training for the Swin Transformer, which consists of pre-training on the large-scale data and fine-tuning on the specific datasets to adapt the model to the special data distributions. In our fusion process, we utilize the pixel-level semantic information to direct and integrate the same semantic connected blocks obtained from the WSC algorithm and semantic segmentation with certain rules based on the confidence levels and block distributions, which effectively alleviates the challenging problem of bounding box overlap and thus improves the accuracy of semantic classification. Finally, it is demonstrated by the experimental results on a collected dataset of Chinese documents and the POD dataset that our proposed fusion framework is feasible and effective on DLA.

Document Structure Analysis and Text Normalization for Chinese Putonghua and Cantonese Text-to-Speech Synthesis

Text Normalization in Chinese Text-to-Speech System

Text Normalization in Mandarin Text-to-speech System.

A Three-Stage Text Normalization Strategy for Mandarin Text-to-Speech Systems

Development and Evaluation of Task-Specific NLP Framework in China.

Chinese-English Mixed Text Normalization

Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

A Fusion Framework of Whitespace Smear Cutting and Swin Transformer for Document Layout Analysis

Normalization of Lithuanian Text Using Regular Expressions

A Chinese Text-to-Speech System

Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark

A Unified Framework for Multilingual Text-to-speech Synthesis with SSML Specification As Interface

Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

A CHINESE DOCUMENT CATEGORIZATION SYSTEM WITHOUT DICTIONARY SUPPORT AND SEGMENTATION PROCESSING

Linguistic Pbolems in text-to-speech conversion Processing of the Chinese

A Unified Tagging Approach to Text Normalization.

An End-to-end Chinese Text Normalization Model Based on Rule-guided Flat-Lattice Transformer.

Segmentation standard for Chinese natural language processing

Automatic Conversion from Lexical Words to Prosodic Words for Mandarin Text-to-speech System

Modeling the Expressivity of Input Text Semantics for Chinese Text-to-Speech Synthesis in a Spoken Dialog System