Abstract:Optical character recognition (OCR) is the process of acquiring text and layout information through analysis and recognition of text data image files. It is also a process to identify the geometric location and orientation of the texts and their symmetrical behavior. It usually consists of two steps: text detection and text recognition. Scene text recognition is a subfield of OCR that focuses on processing text in natural scenes, such as streets, billboards, license plates, etc. Unlike traditional document category photographs, it is a challenging task to use computer technology to locate and read text information in natural scenes. Imaging sequence recognition is a longstanding subject of research in the field of computer vision. Great progress has been made in this field; however, most models struggled to recognize text in images of complex scenes with high accuracy. This paper proposes a new pattern of text recognition based on the convolutional recurrent neural network (CRNN) as a solution to address this issue. It combines real-time scene text detection with differentiable binarization (DBNet) for text detection and segmentation, text direction classifier, and the Retinex algorithm for image enhancement. To evaluate the effectiveness of the proposed method, we performed experimental analysis of the proposed algorithm, and carried out simulation on complex scene image data based on existing literature data and also on several real datasets designed for a variety of nonstationary environments. Experimental results demonstrated that our proposed model performed better than the baseline methods on three benchmark datasets and achieved on-par performance with other approaches on existing datasets. This model can solve the problem that CRNN cannot identify text in complex and multi-oriented text scenes. Furthermore, it outperforms the original CRNN model with higher accuracy across a wider variety of application scenarios.

Text recognition in natural scenes based on deep learning

Deep Neural Network with Attention Model for Scene Text Recognition.

Efficient Neural Network for Text Recognition in Natural Scenes Based on End-to-End Multi-Scale Attention Mechanism

A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application

Text-Attentional Convolutional Neural Networks for Scene Text Detection

Text-Attentional Convolutional Neural Network for Scene Text Detection

Scene text recognition based on two-stage attention and multi-branch feature fusion module

Research on Text Location and Recognition in Natural Images with Deep Learning

Text Detection And Recognition Algorithm For Arbitrary Shapes In Natural Scenes

Reading Scene Text with Attention Convolutional Sequence Modeling

Chinese Image Text Recognition with BLSTM-CTC: A Segmentation-Free Method.

An Algorithm Based on Text Position Correction and Encoder-Decoder Network for Text Recognition in the Scene Image of Visual Sensors

Research on the Text Detection and Recognition in Natural Scene Images

A New Strategy for Improving the Accuracy in Scene Text Recognition

Scene Text Recognition with Deeper Convolutional Neural Networks.

Offline Handwritten Text Recognition Based On Ctc-Attention

GTC: Guided Training of CTC Towards Efficient and Accurate Scene Text Recognition

Scene Text Recognition from Two-Dimensional Perspective

Scene Text Recognition with Sliding Convolutional Character Models

A holistic representation guided attention network for scene text recognition

ReADS: A Rectified Attentional Double Supervised Network for Scene Text Recognition