Abstract:Optical degradation blurs text shapes and edges, so existing scene text recognition methods have difficulties in achieving desirable results on low-resolution (LR) scene text images acquired in realworld environments. The above problem can be solved by efficiently extracting sequential information to reconstruct super-resolution (SR) text images, which remains a challenging task. In this paper, we propose a Parallelly Contextual Attention Network (PCAN), which effectively learns sequence-dependent features and focuses more on high-frequency information of the reconstruction in text images. Firstly, we explore the importance of sequence-dependent features in horizontal and vertical directions parallelly for text SR, and then design a parallelly contextual attention block to adaptively select the key information in the text sequence that contributes to image super-resolution. Secondly, we propose a hierarchically orthogonal texture-aware attention module and an edge guidance loss function, which can help to reconstruct high-frequency information in text images. Finally, we conduct extensive experiments on TextZoom dataset, and the results can be easily incorporated into mainstream text recognition algorithms to further improve their performance in LR image recognition. Besides, our approach exhibits great robustness in defending against adversarial attacks on seven mainstream scene text recognition datasets, which means it can also improve the security of the text recognition pipeline. Compared with directly recognizing LR images, our method can respectively improve the recognition accuracy of ASTER, MORAN,and CRNN by 14.9%, 14.0%, and 20.1%. Our method outperforms eleven state-of-the-art (SOTA) SR methods in terms of boosting text recognition performance. Most importantly, it outperforms the current optimal text-orient SR method TSRN by 3.2%, 3.7%, and 6.0% on the recognition accuracy of ASTER, MORAN, and CRNN respectively.

An Improved Scene Text Extraction Method Using Conditional Random Field and Optical Character Recognition

Scene Text Detection and Recognition System for Visually Impaired People in Real World

A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application

Scene text extraction based on edges and support vector regression

Scene Text Recognition from Two-Dimensional Perspective

Research on Scene Text Recognition Algorithm Basedon Improved CRNN

Scene Text Detection Using Superpixel-Based Stroke Feature Transform and Deep Learning Based Region Classification

Scene Text Detection Based on Two-Branch Feature Extraction

Robust Text Detection in Natural Scene Images

Scene Text Detection via Holistic, Multi-Channel Prediction

Scene Text Image Super-Resolution Via Parallelly Contextual Attention Network

Text-Attentional Convolutional Neural Networks for Scene Text Detection

Text-Attentional Convolutional Neural Network for Scene Text Detection

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

CORE-Text: Improving Scene Text Detection with Contrastive Relational Reasoning

I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition

Character Region Awareness Network for Scene Text Recognition

CRNet: A Center-aware Representation for Detecting Text of Arbitrary Shapes

IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition

SCENE TEXT EXTRACTION METHOD BASED ON HIERARCHICAL BLOCK FILTERING AND STROKE FEATURES