Abstract:Existing scene text recognition (STR) methods struggle to recognize challenging texts, especially for artistic and severely distorted characters. The limitation lies in the insufficient exploration of character morphologies, including the monotonousness of widely used synthetic training data and the sensitivity of the model to character morphologies. To address these issues, inspired by the human learning process of viewing and summarizing, we facilitate the contrastive learning-based STR framework in a self-motivated manner by leveraging synthetic and real unlabeled data without any human cost. In the viewing process, to compensate for the simplicity of synthetic data and enrich character morphology diversity, we propose an Online Generation Strategy to generate background-free samples with diverse character styles. By excluding background noise distractions, the model is encouraged to focus on character morphology and generalize the ability to recognize complex samples when trained with only simple synthetic data. To boost the summarizing process, we theoretically demonstrate the derivation error in the previous character contrastive loss, which mistakenly causes the sparsity in the intra-class distribution and exacerbates ambiguity on challenging samples. Therefore, a new Character Unidirectional Alignment Loss is proposed to correct this error and unify the representation of the same characters in all samples by aligning the character features in the student model with the reference features in the teacher model. Extensive experiment results show that our method achieves SOTA performance (94.7\% and 70.9\% average accuracy on common benchmarks and Union14M-Benchmark). Code will be available at <a class="link-external link-https" href="https://github.com/qqqyd/ViSu" rel="external noopener nofollow">this https URL</a>.

Turkish scene text recognition: Introducing extensive real and synthetic datasets and a novel recognition model

Traditional Chinese Synthetic Datasets Verified with Labeled Data for Scene Text Recognition

Revisiting Scene Text Recognition: A Data Perspective.

Scene Text Recognition with Semantics

An Attention-Based Convolutional Recurrent Neural Networks for Scene Text Recognition

SVIPTR: Fast and Efficient Scene Text Recognition with Vision Permutable Extractor

SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Models

STIRER: A Unified Model for Low-Resolution Scene Text Image Recovery and Recognition

SVTR: Scene Text Recognition with a Single Visual Model

TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition

Flexible scene text recognition based on dual attention mechanism

Thai Scene Text Recognition with Character Combination

Accurate and Robust Scene Text Recognition via Adversarial Training.

S5TR: Simple Single Stage Sequencer for Scene Text Recognition.

ViTEraser: Harnessing the Power of Vision Transformers for Scene Text Removal with SegMIM Pretraining

Text Recognition in Real Scenarios with a Few Labeled Samples

ViTSTR-Transducer: Cross-Attention-Free Vision Transformer Transducer for Scene Text Recognition

Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing

STV2k: A New Benchmark for Scene Text Detection and Recognition.

Multimodal Visual-Semantic Representations Learning for Scene Text Recognition

Visual Semantics Allow for Textual Reasoning Better in Scene Text Recognition