Abstract:Super-resolution of scene text images represents a formidable computational problem, marred by a myriad of intricate challenges. This paper focuses on the specific hurdles that have impeded significant advancements in this domain, and introduces the Higher-Order Degradation-Based Super-Resolution Network (HDSN) as a novel solution to address these intricate issues.The challenges in super-resolving scene text images are manifold. Firstly, the semantic ambiguity inherent to text in natural scenes often leads to degraded results, as standard super-resolution techniques struggle to preserve meaningful textual content. Additionally, the uncertainty surrounding font variability exacerbates this issue, as different fonts require distinct treatment for optimal super-resolution. Furthermore, scene text images often exhibit long trailing shadows, artifacts, and strong noise, rendering conventional methods inadequate in producing satisfactory results.To tackle these intricate challenges, we propose a pragmatic higher-order degradation modeling process. This process takes into account the nuanced characteristics of scene text images, including the diverse forms of noise such as Gaussian, Poisson, speckle, and JPEG compression noise, as well as varying levels of blurring. By meticulously considering these real-world scenarios, our approach significantly enhances the robustness and adaptability of super-resolution for scene text images.In addition to addressing these challenges, we recognize the issues arising from sparse datasets and the lack of corresponding paired images for training. To surmount this limitation, we introduce a text image pre-training strategy, which proves to be highly effective in improving recognition accuracy.The experimental results on TextZoom affirm the effectiveness of our approach, demonstrating substantial improvements over existing methods. Notably, our HDSN achieves average recognition rates of 67.2% on ASTER, 63.2% on MORAN, and 58.0% on CRNN, surpassing the performance of available approaches.

Collaborative Deep Learning for Super-Resolving Blurry Text Images

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Learning to Super-Resolve Blurry Face and Text Images.

Pixel-Level Degradation for Text Image Super-Resolution and Recognition

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Diffusion-based Blind Text Image Super-Resolution

Jointly Solving Deblurring and Super-Resolution Problems with Dual Supervised Network.

Text Image Super-Resolution Guided by Text Structure and Embedding Priors

A Deep Convolutional Deblurring And Detection Neural Network For Localizing Text In Videos

A Deep Encoder-Decoder Networks for Joint Deblurring and Super-Resolution

Gated Fusion Network for Joint Image Deblurring and Super-Resolution.

A Deep Dual-Branch Networks for Joint Blind Motion Deblurring and Super-Resolution

Gated Fusion Network for Degraded Image Super Resolution

TextSR: Content-Aware Text Super-Resolution Guided by Recognition

Research on Image Super-resolution Reconstruction Based on Deep Learning

Joint Image Deblurring and Super-Resolution with Attention Dual Supervised Network

Collaborative Blind Image Deblurring

Scene Text Image Super-Resolution via Content Perceptual Loss and Criss-Cross Transformer Blocks

Improving Text Image Resolution Using a Deep Generative Adversarial Network for Optical Character Recognition

Pragmatic degradation learning for scene text image super-resolution with data-training strategy