PdfTable: A Unified Toolkit for Deep Learning-Based Table Extraction

Lei Sheng,Shuai-Shuai Xu

DOI: https://doi.org/10.48550/arXiv.2409.05125

2024-09-08

Abstract:Currently, a substantial volume of document data exists in an unstructured format, encompassing Portable Document Format (PDF) files and images. Extracting information from these documents presents formidable challenges due to diverse table styles, complex forms, and the inclusion of different languages. Several open-source toolkits, such as Camelot, Plumb a PDF (pdfnumber), and Paddle Paddle Structure V2 (PP-StructureV2), have been developed to facilitate table extraction from PDFs or images. However, each toolkit has its limitations. Camelot and pdfnumber can solely extract tables from digital PDFs and cannot handle image-based PDFs and pictures. On the other hand, PP-StructureV2 can comprehensively extract image-based PDFs and tables from pictures. Nevertheless, it lacks the ability to differentiate between diverse application scenarios, such as wired tables and wireless tables, digital PDFs, and image-based PDFs. To address these issues, we have introduced the PDF table extraction (PdfTable) toolkit. This toolkit integrates numerous open-source models, including seven table recognition models, four Optical character recognition (OCR) recognition tools, and three layout analysis models. By refining the PDF table extraction process, PdfTable achieves adaptability across various application scenarios. We substantiate the efficacy of the PdfTable toolkit through verification on a self-labeled wired table dataset and the open-source wireless Publicly Table Reconition Dataset (PubTabNet). The PdfTable code will available on Github: <a class="link-external link-https" href="https://github.com/CycloneBoy/pdf_table" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address various challenges encountered when extracting tables from PDF files. Specifically:

1. **Diverse Table Styles and Complex Forms**: Existing table extraction tools struggle with different table styles, complex forms, and content that includes multiple languages.
2. **Limitations of Existing Tools**:
- **Camelot and pdfnumber**: These tools can only extract tables from digital PDFs and cannot handle image-based PDFs or tables within images.
- **PP-StructureV2**: Although it can comprehensively extract tables from image-based PDFs and images, it lacks the ability to distinguish between different application scenarios (such as wired tables and wireless tables, digital PDFs, and image-based PDFs).
3. **Lack of End-to-End Solutions**: While existing table parsing algorithms perform well, there is a lack of open-source tools that support multiple table extraction tasks in practical applications.

To address these issues, the authors introduce the PdfTable toolkit. This toolkit integrates multiple open-source models, including seven table recognition models, four optical character recognition (OCR) tools, and three layout analysis models, optimizing the PDF table extraction process to achieve adaptability in various application scenarios. The paper validates the effectiveness of the PdfTable toolkit through a self-annotated wired table dataset and an open-source wireless table dataset (PubTabNet).