Abstract:The document layout analysis (DLA) aims to decompose document images into high-level semantic areas (i.e., figures, tables, texts, and background). Creating a DLA framework with strong generalization capabilities is a challenge due to document objects are diversity in layout, size, aspect ratio, texture, etc. Many researchers devoted this challenge by synthesizing data to build large training sets. However, the synthetic training data has different styles and erratic quality. Besides, there is a large gap between the source data and the target data. In this paper, we propose an unsupervised cross-domain DLA framework based on document style guidance. We integrated the document quality assessment and the document cross-domain analysis into a unified framework. Our framework is composed of three components, Document Layout Generator (GLD), Document Elements Decorator(GED), and Document Style Discriminator(DSD). The GLD is used to document layout generates, the GED is used to document layout elements fill, and the DSD is used to document quality assessment and cross-domain guidance. First, we apply GLD to predict the positions of the generated document. Then, we design a novel algorithm based on aesthetic guidance to fill the document positions. Finally, we use contrastive learning to evaluate the quality assessment of the document. Besides, we design a new strategy to change the document quality assessment component into a document cross-domain style guide component. Our framework is an unsupervised document layout analysis framework. We have proved through numerous experiments that our proposed method has achieved remarkable performance.

Hierarchical Braille Layout Detection Model Based on Semantic Assistance

Braille Detection Model Based on Foreground Attention and Semantic Learning

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Braille Recognition Using Deep Learning

Hierarchical Layout Blending with Recursive Optimal Correspondence

WeLayout: WeChat Layout Analysis System for the ICDAR 2023 Competition on Robust Layout Segmentation in Corporate Documents

Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysis

HiM: hierarchical multimodal network for document layout analysis

HSCA-Net: A Hybrid Spatial-Channel Attention Network in Multi-Scale Feature Pyramid for Document Layout Analysis

A Graphical Approach to Document Layout Analysis

Image Layer Modeling for Complex Document Layout Generation.

DeepLayout: A Semantic Segmentation Approach to Page Layout Analysis

Framework and Model Analysis on Bengali Document Layout Analysis Dataset: BaDLAD

LayoutLM: Pre-training of Text and Layout for Document Image Understanding

A Large Dataset of Historical Japanese Documents with Complex Layouts

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis

Hierarchical Layout-Aware Graph Convolutional Network for Unified Aesthetics Assessment.

VTLayout: Fusion of Visual and Text Features for Document Layout Analysis

Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models

Cross-Domain Document Layout Analysis Using Document Style Guide

DocLLM: A layout-aware generative language model for multimodal document understanding