Abstract:Extracting information from documents containing quantitative data in tabular format is an important but still unsolved task due to the heterogeneity of document layouts. This work aims to take a step toward developing a solution to this problem. This paper proposes a flexible, hybrid table extraction system consisting of a deep learning-based table detection module, a heuristic-based structure recognition method, and a graph-based semantic interpretation component. The proposed system is modular and supports the most frequent table layouts. Moreover, it handles both the documents in image format and PDF files with embedded text. The proposed system outperforms the baseline method and achieves results on par with state-of-the-art approaches on the challenging benchmarks from ICDAR 2013 and ICDAR 2019 table interpretation competitions. Moreover, we correct an issue with the evaluation script used in the latter competition and report extended results of the proposed method in comparison with a leading commercial product. Finally, our table extraction system achieves a high F score in the scenario where raw documents are given as input and the targeted information is contained in a subset of table columns. The presented system achieves results competitive with leading methods in the field. It has already been evaluated on general-purpose data and biomedical benchmarks. We intend to continuously improve our approach and process data from other domains, e.g., financial documents. To support future research on information extraction from documents, we make the evaluation scripts and results from our experiments publicly available at https://github.com/mnamysl/tabrec-sncs.

Learning Semantic Annotations for Tabular Data

A Hierarchical Multi-Task Learning Framework for Semantic Annotation in Tabular Data

Understanding the Semantic Structures of Tables with a Hybrid Deep Neural Network Architecture

A Deep Learning-Based Semantic Table Annotation Method

TabularNet: A Neural Network Architecture for Understanding Semantic Structures of Tabular Data

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

Tab-HGNN: Learning Column Representation with Heterogeneous Graph Neural Network for Web Table Interpretation

Web Table Column Type Detection Using Deep Learning and Probability Graph Model.

Knowledge Graph Engineering Based on Semantic Annotation of Tables

Graph Neural Network Approach to Semantic Type Detection in Tables

TETA: Text-Enhanced Tabular Data Annotation with Multi-task Graph Convolutional Network

A Joint Multi-task Learning Model for Web Table-to-Knowledge Graph Matching

A NOVEL APPROACH OF TABLE DETECTION AND ANALYSIS FOR SEMANTIC ANNOTATION

Flexible Hybrid Table Recognition and Semantic Interpretation System

Learning Latent Semantic Annotations for Grounding Natural Language to Structured Data

Semantic Labeling Using a Deep Contextualized Language Model

TabText: a Systematic Approach to Aggregate Knowledge Across Tabular Data Structures

LinkingPark: an Automatic Semantic Table Interpretation System

AnnotatedTables: A Large Tabular Dataset with Language Model Annotations

TabText: A Flexible and Contextual Approach to Tabular Data Representation

A fully automated approach to a complete Semantic Table Interpretation