Abstract:As one of the most commonly used and important data carriers, tables have the advantages of high structuring, strong readability and strong flexibility. However, in reality, tables usually present various forms, such as Excel, images, etc. Among them, the information in the table image cannot be read directly, let alone further applied. Therefore, the research related to image-based table recognition is crucial. It contains the table structure recognition and the table content recognition. Among them, table structure recognition is the most important and difficult task because the table structure is abstract and changeable. In order to address this problem, we propose an innovative table structure recognition method, named TSRDet (Table Structure Recognition based on object Detection). It includes a row-column detection method, named SACNet (StripAttention-CenterNet) and the corresponding post-processing. SACNet is an improved version of the original CenterNet. The specific improvements include the following: firstly, we introduce the Swin Transformer as the encoder to obtain the global feature map of the image. Then, we propose a plug-and-play row-column attention module, including a channel attention module and a row-column spatial attention module. It improves the detection accuracy of rows and columns by capturing long-range row-column feature maps in the image. After completing the row-column detection, this paper also designs a simple and fast post-processing to generate the table structure based on the row-column detection results. Experimental results show that for row-column detection, SACNet has high detection accuracy, even at a high IoU threshold. Specifically, when the threshold is 0.75, its mAP of row detection and column detection still exceeds 90%, which is 91.40% and 92.73% respectively. In addition, in the comparative experiment with the existing object detection methods, SACNet's performance was significantly better than that of all others. For table structure recognition, the TEDS-Struct score of TSRDet is 95.7%, which shows competitive performance in table structure recognition, and verifies the rationality and superiority of the proposed method.

TableDet: An end-to-end deep learning approach for table detection and table image classification in data sheet images

TableNet: Deep Learning model for end-to-end Table detection and Tabular data extraction from Scanned Document Images

HybridTabNet: Towards Better Table Detection in Scanned Document Images

Table Detection for Visually Rich Document Images

TC-OCR: TableCraft OCR for Efficient Detection & Recognition of Table Structure & Content

CasTabDetectoRS: Cascade Network for Table Detection in Document Images with Recursive Feature Pyramid and Switchable Atrous Convolution

Towards End-to-End Semi-Supervised Table Detection with Deformable Transformer

TableFormer: Table Structure Understanding with Transformers

End-to-End Semi-Supervised approach with Modulated Object Queries for Table Detection in Documents

TSRDet: A Table Structure Recognition Method Based on Row-Column Detection

Image-based table recognition: data, model, and evaluation

TDeLTA: A Light-weight and Robust Table Detection Method based on Learning Text Arrangement

Towards End-to-End Semi-Supervised Table Detection with Semantic Aligned Matching Transformer

Table Structure Recognition using Top-Down and Bottom-Up Cues

Current Status and Performance Analysis of Table Recognition in Document Images with Deep Neural Networks

Table Structure Extraction with Bi-directional Gated Recurrent Unit Networks

UTTSR: A Novel Non-Structured Text Table Recognition Model Powered by Deep Learning Technology

U-SSD: Improved SSD Based on U-Net Architecture for End-to-End Table Detection in Document Images

TableSegNet: a fully convolutional network for table detection and segmentation in document images

TableLab: An Interactive Table Extraction System with Adaptive Deep Learning