Abstract:Unsupervised Domain Adaptation (UDA) has shown promise in Scene Text Recognition (STR) by facilitating knowledge transfer from labeled synthetic text (source) to more challenging unlabeled real scene text (target). However, existing UDA-based STR methods fully rely on the pseudo-labels of target samples, which ignores the impact of domain gaps (inter-domain noise) and various natural environments (intra-domain noise), resulting in poor pseudo-label quality. In this paper, we propose a novel noisy-aware unsupervised domain adaptation framework tailored for STR, which aims to enhance model robustness against both inter- and intra-domain noise, thereby providing more precise pseudo-labels for target samples. Concretely, we propose a reweighting target pseudo-labels by estimating the entropy of refined probability distributions, which mitigates the impact of domain gaps on pseudo-labels. Additionally, a decoupled triple-P-N consistency matching module is proposed, which leverages data augmentation to increase data diversity, enhancing model robustness in diverse natural environments. Within this module, we design a low-confidence-based character negative learning, which is decoupled from high-confidence-based positive learning, thus improving sample utilization under scarce target samples. Furthermore, we extend our framework to the more challenging Source-Free UDA (SFUDA) setting, where only a pre-trained source model is available for adaptation, with no access to source data. Experimental results on benchmark datasets demonstrate the effectiveness of our framework. Under the SFUDA setting, our method exhibits faster convergence and superior performance with less training data than previous UDA-based STR methods. Our method surpasses representative STR methods, establishing new state-of-the-art results across multiple datasets.

Pushing the Performance Limit of Scene Text Recognizer without Human Annotation

Enhancing Scene Text Recognition by Strengthening Attention Alignment

Revisiting Scene Text Recognition: A Data Perspective.

Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing

Sequential visual and semantic consistency for semi-supervised text recognition

Background-Insensitive Scene Text Recognition with Text Semantic Segmentation

Text Recognition in Real Scenarios with a Few Labeled Samples

Scene Text Recognition with Semantics

Leveraging Text Localization for Scene Text Removal via Text-aware Masked Image Modeling

Flexible scene text recognition based on dual attention mechanism

An extended attention mechanism for scene text recognition

Improving Scene Text Recognition for Character-Level Long-Tailed Distribution

Accurate and Robust Scene Text Recognition via Adversarial Training.

One Model for Two Tasks: Cooperatively Recognizing and Recovering Low-Resolution Scene Text Images by Iterative Mutual Guidance

Efficient Backbone Search for Scene Text Recognition

STIRER: A Unified Model for Low-Resolution Scene Text Image Recovery and Recognition

Scene Text Recognition Via Dual-path Network with Shape-driven Attention Alignment.

TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition

Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizer

Noisy-Aware Unsupervised Domain Adaptation for Scene Text Recognition

STR Transformer: A Cross-domain Transformer for Scene Text Recognition