Restoring Warped Document Image Through Segmentation and Full Page Interpolation

Yu Zhang,Changsong Liu,Xiaoqing Ding,Kongqiao Wang
DOI: https://doi.org/10.1117/12.805424
2009-01-01
Abstract:In camera-based optical character recognition (OCR) applications, warping is a primary problem. Warped document images should be restored before they are recognized by traditional OCR algorithm. This paper presents a novel restoration approach, which first makes an estimation of baseline and vertical direction estimation based on rough line and character segmentation, then selects several key points and determines their restoration mapping as a result of the estimation step, at last performs Thin-Plate Splines (TPS) interpolation on full page image using these key points mapping. The restored document image is expected to have straight baselines and erect character direction. This method can restore arbitrary local warping as well as keep the restoration result natural and smooth, consequently improves the performance of the OCR application. Experiments on several camera captured warped document images show effectiveness of this approach.
What problem does this paper attempt to address?