Abstract:As global trends are shifting towards data-driven industries, the demand for automated algorithms that can convert digital images of scanned documents into machine readable information is rapidly growing. Besides the opportunity of data digitization for the application of data analytic tools, there is also a massive improvement towards automation of processes, which previously would require manual inspection of the documents. Although the introduction of optical character recognition technologies mostly solved the task of converting human-readable characters from images into machine-readable characters, the task of extracting table semantics has been less focused on over the years. The recognition of tables consists of two main tasks, namely table detection and table structure recognition. Most prior work on this problem focuses on either task without offering an end-to-end solution or paying attention to real application conditions like rotated images or noise artefacts inside the document image. Recent work shows a clear trend towards deep learning approaches coupled with the use of transfer learning for the task of table structure recognition due to the lack of sufficiently large datasets. In this paper we present a multistage pipeline named Multi-Type-TD-TSR, which offers an end-to-end solution for the problem of table recognition. It utilizes state-of-the-art deep learning models for table detection and differentiates between 3 different types of tables based on the tables' borders. For the table structure recognition we use a deterministic non-data driven algorithm, which works on all table types. We additionally present two algorithms. One for unbordered tables and one for bordered tables, which are the base of the used table structure recognition algorithm. We evaluate Multi-Type-TD-TSR on the ICDAR 2019 table structure recognition dataset and achieve a new state-of-the-art.

A Novel Encoder-Decoder Architecture for Table Border Segmentation of Scanned Documents.

CNN Based Page Object Detection in Document Images

Towards Robotic Semantic Segmentation of Supporting Surfaces

A Document Analysis and Image Preprocessing Algorithm for the Reading Robot

A Deep Semantic Segmentation Model for Image-based Table Structure Recognition

Multi-Type-TD-TSR -- Extracting Tables from Document Images using a Multi-stage Pipeline for Table Detection and Table Structure Recognition: from OCR to Structured Table Representations

Scene Table Structure Recognition with Segmentation Collaboration and Alignment

TableFormer: Table Structure Understanding with Transformers

Marior: Margin Removal and Iterative Content Rectification for Document Dewarping in the Wild

DocBed: A Multi-Stage OCR Solution for Documents with Complex Layouts

Document Layout Analysis and Reading Order Determination for a Reading Robot

DeepErase: Weakly Supervised Ink Artifact Removal in Document Text Images

Robust Table Detection and Structure Recognition from Heterogeneous Document Images

Page Stream Segmentation with Convolutional Neural Nets Combining Textual and Visual Features

Table Information Extraction and Analysis: A Robust Geometric Approach Based on GatedGCN.

Realtime Detection of Table Objects and Text Areas for OCR Preprocessing

SEMv3: A Fast and Robust Approach to Table Separation Line Detection

Divide Rows and Conquer Cells: Towards Structure Recognition for Large Tables.

Robust Table Recognition for Printed Document Images

Deep Structured Feature Networks for Table Detection and Tabular Data Extraction from Scanned Financial Document Images

Table Image Dewarping with Key Element Segmentation