Abstract:Claims over the numerical relationships among some measures are commonly expressed in tabular forms, and widely exist in the published documents on the Web. This paper introduces the problem of numerical formula recognition from tables, namely recognizing all numerical formulas inside a given table. It can well support many interesting downstream applications, such as numerical error correction in tables, formula recommendation in tables. Here, we emphasize that table is a kind of language that adopts a different linguistic paradigm from natural language. It uses visual grammar like visual layout and visual settings (e.g., indentation, font style) to express the grammatical relationships among the table cells. Understanding tables and recognizing formulas require decoding the visual grammar while simultaneously understanding the textual information. Another challenge is that formulas are complicated in terms of diverse math functions and variable-length of arguments. To address these challenges, we convert this task into a uniform framework, extracting relations of table cell pairs in a table. A two-channel neural network model TaFor is proposed to embed both the textual and visual features for a table cell. Our framework achieves the formula-level F1-score = 0.90 on a real-world dataset of 190179 tables while a retrieval-based method achieves F1-score = 0.72. We also perform extensive experiments to demonstrate the effectiveness of each component in our model, and conduct a case study to discuss the limits of the proposed model. With our published data this study also aims to attract the community's interest in deep semantic understanding over tables.

The Design and Implementation of Web-based Formula Retrieval System

Formula Citation Graph Based Mathematical Information Retrieval

Formula Ranking Within an Article.

A Mathematics Retrieval System for Formulae in Layout Presentations

ICST Math Retrieval System for NTCIR-11 Math-2 Task.

A Symbol Dominance Based Formulae Recognition Approach For Pdf Documents

Design and Research of Web-Based Assistant Teaching System.

The Tangent Search Engine: Improved Similarity Metrics and Scalability for Math Formula Search

Wikimirs 3.0: A Hybrid Mir System Based On The Context, Structure And Importance Of Formulae In A Document

Wikimirs: A Mathematical Information Retrieval System For Wikipedia

Mathematics Content Understanding for Cyberlearning via Formula Evolution Map

Mathematical Information Retrieval Trends and Techniques

A Mathematical Information Retrieval System Based On Rankboost

On the Design and Implementation of the Retrieval System of a Large-Scale Search Engine

MathIRs: Retrieval System for Scientific Documents

Performance Evaluation of Mathematical Formula Identification

Numerical Formula Recognition from Tables

Design and Implementation of Web-based Full-text Search Engine

Research Status of Mathematical Formula Recognition

Applied Research of Knowledge in the Field of Artificial Intelligence in the Intelligent Retrieval of Teaching Resources

Design and Implementation of Cross-Search Retrieval System