Abstract:As one of the most commonly used and important data carriers, tables have the advantages of high structuring, strong readability and strong flexibility. However, in reality, tables usually present various forms, such as Excel, images, etc. Among them, the information in the table image cannot be read directly, let alone further applied. Therefore, the research related to image-based table recognition is crucial. It contains the table structure recognition and the table content recognition. Among them, table structure recognition is the most important and difficult task because the table structure is abstract and changeable. In order to address this problem, we propose an innovative table structure recognition method, named TSRDet (Table Structure Recognition based on object Detection). It includes a row-column detection method, named SACNet (StripAttention-CenterNet) and the corresponding post-processing. SACNet is an improved version of the original CenterNet. The specific improvements include the following: firstly, we introduce the Swin Transformer as the encoder to obtain the global feature map of the image. Then, we propose a plug-and-play row-column attention module, including a channel attention module and a row-column spatial attention module. It improves the detection accuracy of rows and columns by capturing long-range row-column feature maps in the image. After completing the row-column detection, this paper also designs a simple and fast post-processing to generate the table structure based on the row-column detection results. Experimental results show that for row-column detection, SACNet has high detection accuracy, even at a high IoU threshold. Specifically, when the threshold is 0.75, its mAP of row detection and column detection still exceeds 90%, which is 91.40% and 92.73% respectively. In addition, in the comparative experiment with the existing object detection methods, SACNet's performance was significantly better than that of all others. For table structure recognition, the TEDS-Struct score of TSRDet is 95.7%, which shows competitive performance in table structure recognition, and verifies the rationality and superiority of the proposed method.

Evaluating Table Structure Recognition: A New Perspective

Table Structure Recognition using Top-Down and Bottom-Up Cues

Table Structure Recognition with Conditional Attention

TSRDet: A Table Structure Recognition Method Based on Row-Column Detection

Image-based table recognition: data, model, and evaluation

TC-OCR: TableCraft OCR for Efficient Detection & Recognition of Table Structure & Content

GriTS: Grid table similarity metric for table structure recognition

Table Detection for Visually Rich Document Images

Rethinking Detection Based Table Structure Recognition for Visually Rich Document Images

A Two-Phase Approach for Recognizing Tables with Complex Structures

Aligning benchmark datasets for table structure recognition

UniTable: Towards a Unified Framework for Table Structure Recognition via Self-Supervised Pretraining

Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modeling

Scene Table Structure Recognition with Segmentation Collaboration and Alignment

Dataset, Ground-Truth and Performance Metrics for Table Detection Evaluation

Tabular Structure Detection from Document Images for Resource Constrained Devices Using A Row Based Similarity Measure

Complicated Table Structure Recognition

Image-based Table Cell Detection: a Novel Table Structure Decomposition Method with New Dataset.

Table of Contents Recognition in OCR Documents using Image-based Machine Learning

Divide Rows and Conquer Cells: Towards Structure Recognition for Large Tables.

Multiscale IOU: A Metric for Evaluation of Salient Object Detection with Fine Structures