Abstract:Optical character recognition (OCR) is the process of acquiring text and layout information through analysis and recognition of text data image files. It is also a process to identify the geometric location and orientation of the texts and their symmetrical behavior. It usually consists of two steps: text detection and text recognition. Scene text recognition is a subfield of OCR that focuses on processing text in natural scenes, such as streets, billboards, license plates, etc. Unlike traditional document category photographs, it is a challenging task to use computer technology to locate and read text information in natural scenes. Imaging sequence recognition is a longstanding subject of research in the field of computer vision. Great progress has been made in this field; however, most models struggled to recognize text in images of complex scenes with high accuracy. This paper proposes a new pattern of text recognition based on the convolutional recurrent neural network (CRNN) as a solution to address this issue. It combines real-time scene text detection with differentiable binarization (DBNet) for text detection and segmentation, text direction classifier, and the Retinex algorithm for image enhancement. To evaluate the effectiveness of the proposed method, we performed experimental analysis of the proposed algorithm, and carried out simulation on complex scene image data based on existing literature data and also on several real datasets designed for a variety of nonstationary environments. Experimental results demonstrated that our proposed model performed better than the baseline methods on three benchmark datasets and achieved on-par performance with other approaches on existing datasets. This model can solve the problem that CRNN cannot identify text in complex and multi-oriented text scenes. Furthermore, it outperforms the original CRNN model with higher accuracy across a wider variety of application scenarios.

Distinguishing Text/Non-Text Natural Images With Multi-Dimensional Recurrent Neural Networks

Multi-Oriented Text Detection with Fully Convolutional Networks

Recurrent Neural Network for Text Classification with Hierarchical Multiscale Dense Connections.

Text-Attentional Convolutional Neural Networks for Scene Text Detection

Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networks

CRAN: A Hybrid CNN-RNN Attention-Based Model for Text Classification

Text-Attentional Convolutional Neural Network for Scene Text Detection

Hierarchical Convolutional Recurrent Neural Network for Chinese Text Classification

Multi-applicable Text Classification Based on Deep Neural Network

Natural Scene Text Detection with Multi-Layer Segmentation and Higher Order Conditional Random Field Based Analysis.

Cells in Multidimensional Recurrent Neural Networks

Multichannel CNN with Attention for Text Classification

Multi-oriented Text Detection from Natural Scene Images Based on a CNN and Pruning Non-Adjacent Graph Edges

Recurrent Convolutional Neural Networks for Text Classification

A text classification method based on a convolutional and bidirectional long short-term memory model

Text-Guided Neural Network Training for Image Recognition in Natural Scenes and Medicine

Recursive Graphical Neural Networks for Text Classification

Gated Neural Network with Regularized Loss for Multi-label Text Classification.

Natural Scene Text Detection Based on Multiscale Connectionist Text Proposal Network

A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application

Digging Deeper into CRNN Model in Chinese Text Images Recognition