Abstract:Acquiring large-scale, well-annotated datasets is essential for training robust scene text detectors, yet the process is often resource-intensive and time-consuming. While some efforts have been made to explore the synthesis of scene text images, a notable gap remains between syn-thetic and authentic data. In this paper, we introduce a novel method that utilizes Neural Radiance Fields (NeRF) to model real-world scenes and emulate the data collection process by rendering images from diverse camera per-spectives, enriching the variability and realism of the synthesized data. A semi-supervised learning framework is proposed to categorize semantic regions within 3D scenes, ensuring consistent labeling of text regions across various viewpoints. Our method also models the pose, and view-dependent appearance of text regions, thereby offering precise control over camera poses and significantly improving the realism of text insertion and editing within scenes. Employing our technique on real-world scenes has led to the creation of a novel scene text image dataset (https://github.com/cuijl-ai/TextNeRF). Compared to other existing benchmarks, the proposed dataset is distinctive in providing not only standard annotations such as bounding boxes and transcriptions but also the information of 3D pose attributes for text regions, enabling a more detailed evaluation of the robustness of text detection algorithms. Through extensive experiments, we demonstrate the effectiveness of our proposed method in enhancing the performance of scene text detectors.

Chinese Text Detection Using Deep Learning Model And Synthetic Data

A CNN Based Scene Chinese Text Recognition Algorithm With Synthetic Data Engine

A method for text line detection in natural images

Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models

A Multi-stage Method for Chinese Text Detection in News Videos

Synthetic images generation for text detection and recognition in the wild

A Large Chinese Text Dataset in the Wild

Scene Text Detection Using Superpixel-Based Stroke Feature Transform and Deep Learning Based Region Classification

End-To-End Chinese Text Recognition

Detecting Text in the Wild with Deep Character Embedding Network

Real-time Scene Text Detection Based on Global Level and Word Level Features

Scene Text Detection with Fully Convolutional Neural Networks

Synthesizing Data for Text Recognition with Style Transfer

Traditional Chinese Synthetic Datasets Verified with Labeled Data for Scene Text Recognition

Scene Text Detection via Holistic, Multi-Channel Prediction

TextNeRF: A Novel Scene-Text Image Synthesis Method Based on Neural Radiance Fields

Chinese Text Detection and Location for Images in Multimedia Messaging Service

Scene Text Detection Based On Robust Stroke Width Transform And Deep Belief Network

Real-time Traffic Sign Text Detection Based on Deep Learning

DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images