Abstract:We focus on electronic theses and dissertations (ETDs), aiming to improve access and expand their utility, since more than 6 million are publicly available, and they constitute an important corpus to aid research and education across disciplines. The corpus is growing as new born-digital documents are included, and since millions of older theses and dissertations have been converted to digital form to be disseminated electronically in institutional repositories. In ETDs, as with other scholarly works, figures and tables can communicate a large amount of information in a concise way. Although methods have been proposed for extracting figures and tables from born-digital PDFs, they do not work well with scanned ETDs. Considering this problem, our assessment of state-of-the-art figure extraction systems is that the reason they do not function well on scanned PDFs is that they have only been trained on born-digital documents. To address this limitation, we present ScanBank, a new dataset containing 10 thousand scanned page images, manually labeled by humans as to the presence of the 3.3 thousand figures or tables found therein. We use this dataset to train a deep neural network model based on YOLOv5 to accurately extract figures and tables from scanned ETDs. We pose and answer important research questions aimed at finding better methods for figure extraction from scanned documents. One of those concerns the value for training, of data augmentation techniques applied to born-digital documents which are used to train models better suited for figure extraction from scanned documents. To the best of our knowledge, ScanBank is the first manually annotated dataset for figure and table extraction for scanned ETDs. A YOLOv5-based model, trained on ScanBank, outperforms existing comparable open-source and freely available baseline methods by a considerable margin.

A Neural Approach for Text Extraction from Scholarly Figures

Extracting Scientific Figures with Distantly Supervised Neural Networks

Citation Metadata Extraction Via Deep Neural Network-based Segment Sequence Labeling

Neural Content Extraction for Poster Generation of Scientific Papers

Deep Neural Network with Attention Model for Scene Text Recognition.

TextNeRF: A Novel Scene-Text Image Synthesis Method Based on Neural Radiance Fields

Automatic Document Metadata Extraction Based on Deep Networks.

DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures

Data Extraction from Charts via Single Deep Neural Network

Text to Insight: Accelerating Organic Materials Knowledge Extraction via Deep Learning

A Study on Event-Oriented Text Retrieval with Deep Neural Network

Survey and empirical comparison of different approaches for text extraction from scholarly figures

Scale-Invariant Multi-Oriented Text Detection in Wild Scene Images

Lessons from Deep Learning applied to Scholarly Information Extraction: What Works, What Doesn't, and Future Directions

Content-Based Text Extraction from Image using Deep Learning

A Systematic Investigation on Different Scene Text Detection and Recognition Method using Deep Learning Techniques

A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks

Automatic Identification and Data Extraction from 2-Dimensional Plots in Digital Documents

BreakingNews: Article Annotation by Image and Text Processing

A Novel Text Structure Feature Extractor for Chinese Scene Text Detection and Recognition.

ScanBank: A Benchmark Dataset for Figure Extraction from Scanned Electronic Theses and Dissertations