Abstract:Text line recognition methods can be categorized into explicit segmentation based and implicit segmentation based ones. Explicit segmentation based methods require character-level annotation during training, while implicit segmentation based methods, trained on line-level annotated data, face alignment drift challenges. Though some methods have been proposed to address these challenges using weakly supervised object detection, they often rely on cumbersome pseudo-box generation processes and complex decoding. In this paper, we propose a unified framework to overcome these challenges, achieving high accuracy in text recognition and character segmentation. To eliminate the need of character-level annotated real text line data in training, we introduce a novel training paradigm that utilizes character-level annotated synthetic data and line-level annotated real data jointly. For synthetic data, candidate characters are explicitly aligned with labeled characters to generate hard labels for supervising model training. For real data, implicit alignment is produced by Connectionist Temporal Classification (CTC) mapping to provide soft labels for weakly-supervised model training. And for inference, we propose two decoding strategies leveraging the advantages of Non-Maximum Suppression (NMS) and CTC decoding. Extensive experiments on benchmark datasets demonstrate the superior performance of our method in text recognition and character localization, even with minimal amounts of character-level annotated line data.

Layout and Perspective Distortion Independent Recognition of Captured Chinese Document Image

Joint Layout Analysis, Character Detection and Recognition for Historical Document Digitization

Foreground and Text-lines Aware Document Image Rectification

Restoring Camera-Captured Distorted Document Images

Robust Math Formula Recognition in Degraded Chinese Document Images

Restoring Chinese documents images based on text boundary lines

Rule-based perspective rectification for Chinese text in natural scene images

A Scheme for Automatic Text Rectification in Real Scene Images.

Document Image Orientation Based on Both Text and Image

An Improved Perspective Transform for Image Distortion Correction

Orientation-Independent Chinese Text Recognition in Scene Images

Transcript Mapping for Handwritten Chinese Documents by Integrating Character Recognition Model and Geometric Context

An approach for handwritten Chinese text recognition unifying character segmentation and recognition

STRUCTURED LIGHT-ASSISTED RECTIFICATION METHOD FOR DOCUMENT IMAGE DISTORTION

From Textline to Paragraph: A Promising Practice for Chinese Text Recognition

Fourier Document Restoration for Robust Document Dewarping and Recognition

An Improved Scene Text Extraction Method Using Conditional Random Field and Optical Character Recognition

Rethinking Irregular Scene Text Recognition

Design And Development Of An Ancient Chinese Document Recognition System

Document image super-resolution using structural similarity and Markov random field

Exploiting Vector Fields For Geometric Rectification Of Distorted Document Images