Abstract:Optical character recognition (OCR) is the process of acquiring text and layout information through analysis and recognition of text data image files. It is also a process to identify the geometric location and orientation of the texts and their symmetrical behavior. It usually consists of two steps: text detection and text recognition. Scene text recognition is a subfield of OCR that focuses on processing text in natural scenes, such as streets, billboards, license plates, etc. Unlike traditional document category photographs, it is a challenging task to use computer technology to locate and read text information in natural scenes. Imaging sequence recognition is a longstanding subject of research in the field of computer vision. Great progress has been made in this field; however, most models struggled to recognize text in images of complex scenes with high accuracy. This paper proposes a new pattern of text recognition based on the convolutional recurrent neural network (CRNN) as a solution to address this issue. It combines real-time scene text detection with differentiable binarization (DBNet) for text detection and segmentation, text direction classifier, and the Retinex algorithm for image enhancement. To evaluate the effectiveness of the proposed method, we performed experimental analysis of the proposed algorithm, and carried out simulation on complex scene image data based on existing literature data and also on several real datasets designed for a variety of nonstationary environments. Experimental results demonstrated that our proposed model performed better than the baseline methods on three benchmark datasets and achieved on-par performance with other approaches on existing datasets. This model can solve the problem that CRNN cannot identify text in complex and multi-oriented text scenes. Furthermore, it outperforms the original CRNN model with higher accuracy across a wider variety of application scenarios.

Multi-granularity Deep Local Representations for Irregular Scene Text Recognition

Improving Irregular Text Recognition by Integrating Gabor Convolutional Network

A holistic representation guided attention network for scene text recognition

2D Attentional Irregular Scene Text Recognizer

A Simple and Strong Convolutional-Attention Network for Irregular Text Recognition

A Multi-Object Rectified Attention Network for Scene Text Recognition

Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognition

Irregular Scene Text Detection Via Attention Guided Border Labeling.

Robust Scene Text Recognition with Automatic Rectification

TextNet: Irregular Text Reading from Images with an End-to-End Trainable Network.

Irregular Scene Text Detection Based on a Graph Convolutional Network

A Feasible Framework for Arbitrary-Shaped Scene Text Recognition

A Multi-level Progressive Rectification Mechanism for Irregular Scene Text Recognition

CarveNet: a Channel-Wise Attention-Based Network for Irregular Scene Text Recognition

CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition

A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application

Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation

Multi-branch guided attention network for irregular text recognition

Learning and Fusing Multi-Scale Representations for Accurate Arbitrary-Shaped Scene Text Recognition.

Scene Text Recognition Via Gated Cascade Attention

Hierarchical Refined Attention for Scene Text Recognition.