Abstract:Recently, video scene text detection has received increasing attention due to its comprehensive applications. However, the lack of annotated scene text video datasets has become one of the most important problems, which hinders the development of video scene text detection. The existing scene text video datasets are not large-scale due to the expensive cost caused by manual labeling. In addition, the text instances in these datasets are too clear to be a challenge. To address the above issues, we propose a tracking based semi-automatic labeling strategy for scene text videos in this paper. We get semi-automatic scene text annotation by labeling manually for the first frame and tracking automatically for the subsequent frames, which avoid the huge cost of manual labeling. Moreover, a paired low-quality scene text video dataset named Text-RBL is proposed, consisting of raw videos, blurry videos, and low-resolution videos, labeled by the proposed convenient semi-automatic labeling strategy. Through an averaging operation and bicubic down-sampling operation over the raw videos, we can efficiently obtain blurry videos and low-resolution videos paired with raw videos separately. To verify the effectiveness of Text-RBL, we propose a baseline model combined with the text detector and tracker for video scene text detection. Moreover, a failure detection scheme is designed to alleviate the baseline model drift issue caused by complex scenes. Extensive experiments demonstrate that Text-RBL with paired low-quality videos labeled by the semi-automatic method can significantly improve the performance of the text detector in low-quality scenes.

Scene Text Detection and Tracking in Video with Background Cues

A new video text detection method.

A Novel Approach to Text Detection and Extraction from Videos by Discriminative Features and Density

A Robust Approach for Scene Text Detection and Tracking in Video.

Video Text Detection with Fully Convolutional Network and Tracking

A method for text line detection in natural images

A New Technique for Multi-Oriented Scene Text Line Detection and Tracking in Video

A Research on Video Text Tracking and Recognition

Video Text Detection by Attentive Spatiotemporal Fusion of Deep Convolutional Features

Text Detection Using Delaunay Triangulation in Video Sequence

Video text rediscovery: Predicting and tracking text across complex scenes

Tracking Based Semi-Automatic Annotation for Scene Text Videos

Detecting both superimposed and scene text with multiple languages and multiple alignments in video

Tracking Based Multi-Orientation Scene Text Detection: A Unified Framework With Dynamic Programming.

Video Text Tracking With a Spatio-Temporal Complementary Model

Automatic video superimposed text detection based on Nonsubsampled Contourlet Transform

Robust Video Text Detection Through Parametric Shape Regression, Propagation and Fusion.

Towards Robust Video Text Detection with Spatio-Temporal Attention Modeling and Text Cues Fusion

TEXT DETECTION IN NATURAL SCENE IMAGES BY HIERARCHICAL LOCALIZATION AND GROWING OF TEXTUAL COMPONENTS

Scene Text Detection with Fully Convolutional Neural Networks

Graphics and Scene Text Classification in Video