Abstract:In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or sequence contrastive learning. However, they omit modeling the linguistic information in text images, which is crucial for recognizing text. To simultaneously capture local character features and linguistic information in visual space, we propose Symmetric Superimposition Modeling (SSM). The objective of SSM is to reconstruct the direction-specific pixel and feature signals from the symmetrically superimposed input. Specifically, we add the original image with its inverted views to create the symmetrically superimposed inputs. At the pixel level, we reconstruct the original and inverted images to capture character shapes and texture-level linguistic context. At the feature level, we reconstruct the feature of the same original image and inverted image with different augmentations to model the semantic-level linguistic context and the local character discrimination. In our design, we disrupt the character shape and linguistic rules. Consequently, the dual-level reconstruction facilitates understanding character shapes and linguistic information from the perspective of visual texture and feature semantics. Experiments on various text recognition benchmarks demonstrate the effectiveness and generality of SSM, with 4.1% average performance gains and 86.6% new state-of-the-art average word accuracy on Union14M benchmarks. The code is available at

Scene Text Extraction with Local Symmetry Transform

Symmetry-based text line detection in natural scenes

A Robust Symmetry-Based Method For Scene/Video Text Detection Through Neural Network

Scene Text Extraction in Natural Scene Images Using Hierarchical Feature Combining and Verification

Symmetry-based Object Proposal for Text Detection

Scene text recognition in mobile applications by character descriptor and structure configuration

Text Recognition using local correlation

Text Localization And Recognition In Complex Scenes Using Local Features

TEXT DETECTION IN NATURAL SCENE IMAGES BY HIERARCHICAL LOCALIZATION AND GROWING OF TEXTUAL COMPONENTS

Text Location for Scene Image with Inherent Features.

Scene Text Localization Using Edge Analysis and Feature Pool.

Text Detection in Natural Images Using Localized Stroke Width Transform.

Text Extraction from Natural Scene Image: A Survey

Scale-Based Local Feature Selection for Scene Text Recognition

Robust Scene Text Detection Based on Color Consistency

Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognition

Scene Text Detection via Holistic, Multi-Channel Prediction

A Scene Text Detector for Text with Arbitrary Shapes

Symmetry-constrained Rectification Network for Scene Text Recognition

Scene Text Detection by Leveraging Multi-Channel Information and Local Context

Text localization in natural scene images with stroke width histogram and superpixel