Abstract:Photographed documents are prevalent but often suffer from deformations like curves or folds, hindering readability. Consequently, document dewarping has been widely studied, however its performance is still not satisfied due to lack of real training samples with pixel-level annotation. To obtain the pixel-level labels, we leverage a document registration pipeline to automatically align warped-flat documents. Unlike general image registration works, registering documents poses unique challenges due to their severe deformations and fine-grained textures. In this paper, we introduce a coarse-to-fine framework including a coarse registration network (CRN) aiming to eliminate severe deformations then a fine registration network (FRN) focusing on fine-grained features. In addition, we utilize self-supervised learning to initialize our document registration model, where we propose a cross-reconstruction pre-training task on the pair of warped-flat documents. Extensive experiments show that we can achieve satisfied document registration performance, consequently obtaining a high-quality registered document dataset with pixel-level annotation. Without bells and whistles, we re-train two popular document dewarping models on our registered document dataset WarpDoc-R, and obtain superior performance with those using almost 100× scale of synthetic training data, verifying the label quality of our document registration method.

A Model-based Book Dewarping Method Using Text Line Detection

A Model Based Book Dewarping Method to Handle 2D Images Captured by a Digital Camera.

A Document Rectification Approach Dealing with Both Perspective Distortion and Warping Based on Text Flow Curve Fitting

A Page Content Independent Book Dewarping Method To Handle 2d Images Captured By A Digital Camera

Document Forgery Detection Using Distortion Mutation of Geometric Parameters in Characters

Omni-directional Image Unwarping Based on Taylor Model

A Cylindrical Surface Model to Rectify the Bound Document Image.

Rectifying the Bound Document Image Captured by the Camera: A Model Based Approach.

Foreground and Text-lines Aware Document Image Rectification

Unified Optical Distortion Correction Method for Imaging Systems Using A Concise Geometrical Transformation Model

An Adaptive Correction Algorithm of Non-Linear Distorted Document.

Restoring Camera-Captured Distorted Document Images

Multiple Geometry Transform Estimation from Single Camera-Captured Text Image

MataDoc: Margin and Text Aware Document Dewarping for Arbitrary Boundary

A method to restore Chinese warped document images based on binding characters and building curved lines

Fourier Document Restoration for Robust Document Dewarping and Recognition

Document Registration: Towards Automated Labeling of Pixel-Level Alignment Between Warped-Flat Documents

Table Image Dewarping with Key Element Segmentation

STRUCTURED LIGHT-ASSISTED RECTIFICATION METHOD FOR DOCUMENT IMAGE DISTORTION

Exploiting Vector Fields For Geometric Rectification Of Distorted Document Images

DewarpNet: Single-Image Document Unwarping with Stacked 3D and 2D Regression Networks.