Abstract:Recently, scene Chinese recognition has attracted increasing attention. While mainstream scene text recognition methods exhibit outstanding performance in English recognition, they are considerably limited in Chinese recognition, due to inter-class similarity, intra-class variability, and complex combination of components in scene Chinese text. In this paper, we design Adaptive Position Encoding(APE) to enhance the model's ability to perceive spatial information. Based on APE, we have innovatively designed Local Attention Module (LAM) and Global Attention Module (GAM). Specifically, LAM captures local features to identify common characteristics among characters of the same category, addressing the issue of intra-class variability. Meanwhile, LAM captures global features to identify the subordination relationships of Chinese character components. By integrating LAM and GAM, combining both local and global features, it is possible to find differences in the details among features that are fundamentally similar, thus solving the problem of inter-class similarity. Further, we contrive the transformer encoder–decoder structure to identify the vast variety of Chinese characters. Based on the Local/Global Attention Module and transformer encoder–decoder framework, we devise the novel sequence-to-sequence Local and Global Attention Network(LGANet), where both the backbone and the encoder/decoder are composed of attention mechanisms. Subsequent experiments on the Chinese scene dataset show that the recognition accuracy of our proposed LGANet is 77.3% and the normalized editing distance is 88.6%, both of which achieve the SOTA results in Fig. 1 .

A Decoupled Language Model Based on Contrastive Attention Mechanism for Scene Text Recognition

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Deep Neural Network with Attention Model for Scene Text Recognition.

Sequential Alignment Attention Model for Scene Text Recognition

Scene text recognition based on two-stage attention and multi-branch feature fusion module

Spatial Attention Contrastive Network for Scene Text Recognition

Enhancing Scene Text Recognition by Strengthening Attention Alignment

Adaptive Embedding Gate for Attention-Based Scene Text Recognition.

An extended attention mechanism for scene text recognition

Improved Fusion of Visual and Semantic Representations by Gated Co-Attention for Scene Text Recognition.

A holistic representation guided attention network for scene text recognition

Reading Scene Text with Attention Convolutional Sequence Modeling

MASTER: Multi-Aspect Non-local Network for Scene Text Recognition

Decoupled Attention Network for Text Recognition

Scene Text Recognition with Cascade Attention Network.

Triggered attention model for scene text recognition

Attention after Attention: Reading Text in the Wild with Cross Attention.

Scene Text Recognition Via Gated Cascade Attention

DSAN: Double Supervised Network with Attention Mechanism for Scene Text Recognition

ReADS: A Rectified Attentional Double Supervised Network for Scene Text Recognition

Scene Chinese Recognition with Local and Global Attention