Abstract:Recently, scene Chinese recognition has attracted increasing attention. While mainstream scene text recognition methods exhibit outstanding performance in English recognition, they are considerably limited in Chinese recognition, due to inter-class similarity, intra-class variability, and complex combination of components in scene Chinese text. In this paper, we design Adaptive Position Encoding(APE) to enhance the model's ability to perceive spatial information. Based on APE, we have innovatively designed Local Attention Module (LAM) and Global Attention Module (GAM). Specifically, LAM captures local features to identify common characteristics among characters of the same category, addressing the issue of intra-class variability. Meanwhile, LAM captures global features to identify the subordination relationships of Chinese character components. By integrating LAM and GAM, combining both local and global features, it is possible to find differences in the details among features that are fundamentally similar, thus solving the problem of inter-class similarity. Further, we contrive the transformer encoder–decoder structure to identify the vast variety of Chinese characters. Based on the Local/Global Attention Module and transformer encoder–decoder framework, we devise the novel sequence-to-sequence Local and Global Attention Network(LGANet), where both the backbone and the encoder/decoder are composed of attention mechanisms. Subsequent experiments on the Chinese scene dataset show that the recognition accuracy of our proposed LGANet is 77.3% and the normalized editing distance is 88.6%, both of which achieve the SOTA results in Fig. 1 .

Triggered attention model for scene text recognition

Deep Neural Network with Attention Model for Scene Text Recognition.

Scene Text Recognition Via Gated Cascade Attention

MASTER: Multi-Aspect Non-local Network for Scene Text Recognition

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Scene Text Recognition with Cascade Attention Network.

Scene Text Recognition with Temporal Convolutional Encoder

A holistic representation guided attention network for scene text recognition

Scene Chinese Recognition with Local and Global Attention

Scene Text Recognition with Sliding Convolutional Character Models

ReADS: A Rectified Attentional Double Supervised Network for Scene Text Recognition

Efficient Scene Text Detection with Textual Attention Tower

Text-Attentional Convolutional Neural Networks for Scene Text Detection

Text-Attentional Convolutional Neural Network for Scene Text Detection

Gaussian Constrained Attention Network for Scene Text Recognition

Reading Scene Text with Attention Convolutional Sequence Modeling

NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognition

SVTR-SRNet: A Deep Learning Model for Scene Text Recognition via SVTR Framework and Spatial Reduction Mechanism

Hierarchical Refined Attention for Scene Text Recognition.

Convolutional Attention Networks for Scene Text Recognition

Focus on the Whole Character: Discriminative Character Modeling for Scene Text Recognition