Abstract:The digitisation of historical print media archives is crucial for increasing accessibility to contemporary records. However, the process of Optical Character Recognition (OCR) used to convert physical records to digital text is prone to errors, particularly in the case of newspapers and periodicals due to their complex layouts. This paper introduces Context Leveraging OCR Correction (CLOCR-C), which utilises the infilling and context-adaptive abilities of transformer-based language models (LMs) to improve OCR quality. The study aims to determine if LMs can perform post-OCR correction, improve downstream NLP tasks, and the value of providing the socio-cultural context as part of the correction process. Experiments were conducted using seven LMs on three datasets: the 19th Century Serials Edition (NCSE) and two datasets from the Overproof collection. The results demonstrate that some LMs can significantly reduce error rates, with the top-performing model achieving over a 60% reduction in character error rate on the NCSE dataset. The OCR improvements extend to downstream tasks, such as Named Entity Recognition, with increased Cosine Named Entity Similarity. Furthermore, the study shows that providing socio-cultural context in the prompts improves performance, while misleading prompts lower performance. In addition to the findings, this study releases a dataset of 91 transcribed articles from the NCSE, containing a total of 40 thousand words, to support further research in this area. The findings suggest that CLOCR-C is a promising approach for enhancing the quality of existing digital archives by leveraging the socio-cultural information embedded in the LMs and the text requiring correction.

Enhancing OCR Performance through Post-OCR Models: Adopting Glyph Embedding for Improved Correction

Advancing Post-OCR Correction: A Comparative Study of Synthetic Data

Neural OCR Post-Hoc Correction of Historical Corpora

Post-OCR Document Correction with large Ensembles of Character Sequence Models

Neural Machine Translation with BERT for Post-OCR Error Detection and Correction

General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model

Statistical Learning for OCR Text Correction

Integrated Semantic and Phonetic Post-correction for Chinese Speech Recognition

Confidence-Aware Document OCR Error Detection

An Adaptive Post-processing Method using Proofreading Information for Chinese Character Recognition

A Hybrid Post-Processing System For Offline Handwritten Chinese Character Recognition Based On A Statistical Language Model

Leveraging Text Repetitions and Denoising Autoencoders in OCR Post-correction

Toward the Optimized Crowdsourcing Strategy for OCR Post-Correction

Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

Post-Processing Approach for Printed Chinese Character Recognition

Cleansing Jewel: A Neural Spelling Correction Model Built On Google OCR-ed Tibetan Manuscripts

OCR Error Correction Using Character Correction and Feature-Based Word Classification

CLOCR-C: Context Leveraging OCR Correction with Pre-trained Language Models

Upcycle Your OCR: Reusing OCRs for Post-OCR Text Correction in Romanised Sanskrit

A Supervised Machine Learning Approach for Post-OCR Error Detection for Historical Text

New Post-Processing Method Based on Noisy Channel Model for Chinese Character Recognition