Abstract:As one of the most commonly used and important data carriers, tables have the advantages of high structuring, strong readability and strong flexibility. However, in reality, tables usually present various forms, such as Excel, images, etc. Among them, the information in the table image cannot be read directly, let alone further applied. Therefore, the research related to image-based table recognition is crucial. It contains the table structure recognition and the table content recognition. Among them, table structure recognition is the most important and difficult task because the table structure is abstract and changeable. In order to address this problem, we propose an innovative table structure recognition method, named TSRDet (Table Structure Recognition based on object Detection). It includes a row-column detection method, named SACNet (StripAttention-CenterNet) and the corresponding post-processing. SACNet is an improved version of the original CenterNet. The specific improvements include the following: firstly, we introduce the Swin Transformer as the encoder to obtain the global feature map of the image. Then, we propose a plug-and-play row-column attention module, including a channel attention module and a row-column spatial attention module. It improves the detection accuracy of rows and columns by capturing long-range row-column feature maps in the image. After completing the row-column detection, this paper also designs a simple and fast post-processing to generate the table structure based on the row-column detection results. Experimental results show that for row-column detection, SACNet has high detection accuracy, even at a high IoU threshold. Specifically, when the threshold is 0.75, its mAP of row detection and column detection still exceeds 90%, which is 91.40% and 92.73% respectively. In addition, in the comparative experiment with the existing object detection methods, SACNet's performance was significantly better than that of all others. For table structure recognition, the TEDS-Struct score of TSRDet is 95.7%, which shows competitive performance in table structure recognition, and verifies the rationality and superiority of the proposed method.

Table Image Dewarping with Key Element Segmentation

Decompose Image into Meaningful Regions Based on Contour Detector and Watershed Algorithm

DewarpNet: Single-Image Document Unwarping with Stacked 3D and 2D Regression Networks.

Learning from Documents in the Wild to Improve Document Unwarping

A Deep Semantic Segmentation Model for Image-based Table Structure Recognition

Adaptive dewarping of severely warped camera-captured document images based on document map generation

A Method of Evaluating Table Segmentation Results Based on a Table Image Ground Truther

A Novel Encoder-Decoder Architecture for Table Border Segmentation of Scanned Documents.

A Model Based Book Dewarping Method to Handle 2D Images Captured by a Digital Camera.

HybridTabNet: Towards Better Table Detection in Scanned Document Images

TSRDet: A Table Structure Recognition Method Based on Row-Column Detection

MataDoc: Margin and Text Aware Document Dewarping for Arbitrary Boundary

A Model-based Book Dewarping Method Using Text Line Detection

Table Detection for Visually Rich Document Images

DocUNet: Document Image Unwarping Via a Stacked U-Net

TableDet: An end-to-end deep learning approach for table detection and table image classification in data sheet images

Arbitrary Warped Document Image Restoration Based on Segmentation and Thin-Plate Splines.

TableSegNet: a fully convolutional network for table detection and segmentation in document images

SEMv3: A Fast and Robust Approach to Table Separation Line Detection

UVDoc: Neural Grid-based Document Unwarping

U-SSD: Improved SSD Based on U-Net Architecture for End-to-End Table Detection in Document Images