Abstract:Optical character recognition (OCR) is the process of acquiring text and layout information through analysis and recognition of text data image files. It is also a process to identify the geometric location and orientation of the texts and their symmetrical behavior. It usually consists of two steps: text detection and text recognition. Scene text recognition is a subfield of OCR that focuses on processing text in natural scenes, such as streets, billboards, license plates, etc. Unlike traditional document category photographs, it is a challenging task to use computer technology to locate and read text information in natural scenes. Imaging sequence recognition is a longstanding subject of research in the field of computer vision. Great progress has been made in this field; however, most models struggled to recognize text in images of complex scenes with high accuracy. This paper proposes a new pattern of text recognition based on the convolutional recurrent neural network (CRNN) as a solution to address this issue. It combines real-time scene text detection with differentiable binarization (DBNet) for text detection and segmentation, text direction classifier, and the Retinex algorithm for image enhancement. To evaluate the effectiveness of the proposed method, we performed experimental analysis of the proposed algorithm, and carried out simulation on complex scene image data based on existing literature data and also on several real datasets designed for a variety of nonstationary environments. Experimental results demonstrated that our proposed model performed better than the baseline methods on three benchmark datasets and achieved on-par performance with other approaches on existing datasets. This model can solve the problem that CRNN cannot identify text in complex and multi-oriented text scenes. Furthermore, it outperforms the original CRNN model with higher accuracy across a wider variety of application scenarios.

Accurate and Efficient Scene Recognition with Compact Bow and Ensemble Elm

Landmark Recognition with Compact BoW Histogram and Ensemble ELM

Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field

Encoding Learning Network Combined with Feature Similarity Constraints for Human Action Recognition

EMU: Effective Multi-Hot Encoding Net for Lightweight Scene Text Recognition with a Large Character Set.

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

From Universal Bag-of-words to Adaptive Bag-of-phrases for Mobile Scene Recognition

Ensemble Based Constrained-Optimization Extreme Learning Machine For Landmark Recognition

Effective Multi-Hot Encoding and Classifier for Lightweight Scene Text Recognition with a Large Character Set

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition

A Novel Biologically Inspired ELM-based Network for Image Recognition

EAST: An Efficient and Accurate Scene Text Detector

Dictionary Learning Inspired Deep Network for Scene Recognition

A Prototype Learning Framework Using EMD: Application to Complex Scenes Analysis

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application

SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognition

Fast online learning algorithm for landmark recognition based on BoW framework

Embedding metric learning into an extreme learning machine for scene recognition