Abstract:Optical degradation blurs text shapes and edges, so existing scene text recognition methods have difficulties in achieving desirable results on low-resolution (LR) scene text images acquired in realworld environments. The above problem can be solved by efficiently extracting sequential information to reconstruct super-resolution (SR) text images, which remains a challenging task. In this paper, we propose a Parallelly Contextual Attention Network (PCAN), which effectively learns sequence-dependent features and focuses more on high-frequency information of the reconstruction in text images. Firstly, we explore the importance of sequence-dependent features in horizontal and vertical directions parallelly for text SR, and then design a parallelly contextual attention block to adaptively select the key information in the text sequence that contributes to image super-resolution. Secondly, we propose a hierarchically orthogonal texture-aware attention module and an edge guidance loss function, which can help to reconstruct high-frequency information in text images. Finally, we conduct extensive experiments on TextZoom dataset, and the results can be easily incorporated into mainstream text recognition algorithms to further improve their performance in LR image recognition. Besides, our approach exhibits great robustness in defending against adversarial attacks on seven mainstream scene text recognition datasets, which means it can also improve the security of the text recognition pipeline. Compared with directly recognizing LR images, our method can respectively improve the recognition accuracy of ASTER, MORAN,and CRNN by 14.9%, 14.0%, and 20.1%. Our method outperforms eleven state-of-the-art (SOTA) SR methods in terms of boosting text recognition performance. Most importantly, it outperforms the current optimal text-orient SR method TSRN by 3.2%, 3.7%, and 6.0% on the recognition accuracy of ASTER, MORAN, and CRNN respectively.

TextRecon for Blind Polluted Text Image Reconstruction

Scene Text Detection and Recognition System for Visually Impaired People in Real World

VL-Reader: Vision and Language Reconstructor is an Effective Scene Text Recognizer

Scene Text Image Super-Resolution via Content Perceptual Loss and Criss-Cross Transformer Blocks

Improving Image Restoration through Removing Degradations in Textual Representations

Scene Text Image Super-Resolution Via Parallelly Contextual Attention Network

TextSR: Content-Aware Text Super-Resolution Guided by Recognition

Robust Scene Text Recognition with Automatic Rectification

TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model

Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection

Scene Text Telescope: Text-Focused Scene Image Super-Resolution

TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images

Text Detection in Scene Images Based on Exhaustive Segmentation

Maskstr: Guide Scene Text Recognition Models with Masking

Mask Scene Text Recognizer

Masked Text Modeling: A Self-Supervised Pre-training Method for Scene Text Detection

Text Gestalt: Stroke-Aware Scene Text Image Super-resolution

A Benchmark for Chinese-English Scene Text Image Super-resolution

Text-Guided Mask-free Local Image Retouching

A New Context-Based Method for Restoring Occluded Text in Natural Scene Images

An End-to-End OCR Text Re-organization Sequence Learning for Rich-Text Detail Image Comprehension