Abstract:Since distortions in camera-captured document images significantly affect the accuracy of optical character recognition (OCR), distortion removal plays a critical role for document digitalization systems using a camera for image capturing. This paper proposes a novel framework that performs three-dimensional (3D) reconstruction and rectification of camera-captured document images. While most existing methods rely on additional calibrated hardware or multiple images to recover the 3D shape of a document page, or make a simple but not always valid assumption on the corresponding 3D shape, our framework is more flexible and practical since it only requires a single input image and is able to handle a general locally smooth document surface. The main contributions of this paper include a new iterative refinement scheme for baseline fitting from connected components of text line, an efficient discrete vertical text direction estimation algorithm based on convex hull projection profile analysis, and a 2D distortion grid construction method based on text direction function estimation using 3D regularization. In order to examine the performance of our proposed method, both qualitative and quantitative evaluation and comparison with several recent methods are conducted in our experiments. The experimental results demonstrate that the proposed method outperforms relevant approaches for camera-captured document image rectification, in terms of improvements on both visual distortion removal and OCR accuracy.

Exploiting Vector Fields For Geometric Rectification Of Distorted Document Images

Printer Forensics Based on Page Document's Geometric Distortion

Document Forgery Detection Using Distortion Mutation of Geometric Parameters in Characters

Metric Rectification of Curved Document Images.

Rectification of Curved Document Images Based on Single View Three-Dimensional Reconstruction

Geometric Rectification of Creased Document Images based on Isometric Mapping

Restoring Camera-Captured Distorted Document Images

Unified Optical Distortion Correction Method for Imaging Systems Using A Concise Geometrical Transformation Model

Active Rectification of Curved Document Images Using Structured Beams

Foreground and Text-lines Aware Document Image Rectification

Restoring Warped Document Image Through Segmentation and Full Page Interpolation

Blurring and lens distortion free scanning for large area painting and calligraphy

STRUCTURED LIGHT-ASSISTED RECTIFICATION METHOD FOR DOCUMENT IMAGE DISTORTION

Geometric Representation Learning for Document Image Rectification

Shape from Parallel Geodesics for Distortion Correction of Digital Camera Document Images

Curved Paper Rectification for Digital Camera Document Images by Shape from Parallel Geodesics Using Continuous Dynamic Programming.

Arbitrary Warped Document Image Restoration Based on Segmentation and Thin-Plate Splines.

A Cylindrical Surface Model to Rectify the Bound Document Image.

Efficient Joint Rectification of Photometric and Geometric Distortions in Document Images.

Extraction of Virtual Baselines from Distorted Document Images Using Curvilinear Projection.

Effective Document Image Rectification via a Deep Learning Framework