Abstract:With the rapid development of Artificial Intelligence, Optical Character Recognition(OCR) is applied to analyze and understand the contents of various images, which has a very important effect on online office and makes business more intelligent. As downstream tasks of OCR, information extraction and table analysis are indispensable for acquisition of target information. However, when the texts information are gained from an invoice image or a table image by detection and recognition methods, how to further extract necessary information from a mass of texts or to analyze table information by reconstruction method is still difficult and challenging. In the paper, based on gated graph convolutional networks (GatedGCNs), we propose a novel model to extract key information in documents and reconstruct table information from listing images. Different from manual methods, the GatedGCN-based model considers three kinds of features for the semantic entities, including the position of an entity, the box containing the entity and texts inside the box. The proposed model also considers the relationship between semantic entities, which is a key factor to improve the classification accuracy. Since the update of gated edges in GatedGCN can be treated as a new way to implement attention mechanism, the model can integrate more critical information and discard unnecessary information. Therefore, combining with the node features and the edge features we have extracted, when applying the model on key field extraction (which can be treated as node classification problems) and table reconstruction (that can be treated as link-prediction problems), the model reaches overall excellent results in terms of precision, recall, F1 score and accuracy, evaluated on Medical Invoice, Train Tickets, SciTSR, ICDAR2013 datasets.

A Knowledge-Based Table Recognition Method for Chinese Bank Statement Images

An Efficient Method to Extract Data from Bank Statements Based on Image-Based Table Detection

Robust Table Recognition for Printed Document Images

A Courtesy Amount Recognition System for Chinese Bank Checks

Extraction of legal amount from color bank check images

Table Recognition and Recovery in the Camera-Captured Image with Complex Background

Real-Time Recognition Of Series Seven New Zealand Banknotes

Table Information Extraction and Analysis: A Robust Geometric Approach Based on GatedGCN.

Automatic Recognition System of Tabular Document and Its Application

Segmentation and Recognition System of Handwritten Chinese Bank Check Amounts

Confidence Evaluation for Handwritten Chinese Financial Character Recognition

A Distinguishing Method of Printed and Handwritten Legal Amount on Chinese Bank Check

A Hybrid Character Recognition Approach Using Fuzzy Logic and Stroke Bayesian Program Learning with Naïve Bayes in Industrial Environments

TabSniper: Towards Accurate Table Detection & Structure Recognition for Bank Statements

All-content Text Recognition Method for Financial Ticket Images

Recognition and Extraction of Information from Image-based Tables for Electric Power System Operation and Maintenance

ClusTi: Clustering Method for Table Structure Recognition in Scanned Images

The Study on the Detection and Recognition of the Printed Formula

Multi-model Segmentation and Recognition Algorithm of Courtesy Amount

Recognition And Checkout Of Legal Amounts On Chinese Bank Cheques

A Method of Text Detection and Recognition from Receipt Images Based on CRAFT and CRNN