DSText V2: A Comprehensive Video Text Spotting Dataset for Dense and Small Text

Weijia Wu,Yiming Zhang,Yefei He,Luoming Zhang,Zhenyu Lou,Hong Zhou,Xiang Bai

2023-11-29

Abstract:Recently, video text detection, tracking, and recognition in natural scenes are becoming very popular in the computer vision community. However, most existing algorithms and benchmarks focus on common text cases (e.g., normal size, density) and single scenario, while ignoring extreme video text challenges, i.e., dense and small text in various scenarios. In this paper, we establish a video text reading benchmark, named DSText V2, which focuses on Dense and Small text reading challenges in the video with various scenarios. Compared with the previous datasets, the proposed dataset mainly include three new challenges: 1) Dense video texts, a new challenge for video text spotters to track and read. 2) High-proportioned small texts, coupled with the blurriness and distortion in the video, will bring further challenges. 3) Various new scenarios, e.g., Game, Sports, etc. The proposed DSText V2 includes 140 video clips from 7 open scenarios, supporting three tasks, i.e., video text detection (Task 1), video text tracking (Task 2), and end-to-end video text spotting (Task 3). In this article, we describe detailed statistical information of the dataset, tasks, evaluation protocols, and the results summaries. Most importantly, a thorough investigation and analysis targeting three unique challenges derived from our dataset are provided, aiming to provide new insights. Moreover, we hope the benchmark will promise video text research in the community. DSText v2 is built upon DSText v1, which was previously introduced to organize the ICDAR 2023 competition for dense and small video text.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The main goal of this paper is to establish a comprehensive video text detection dataset, named DSText V2, to address the challenges of dense and small text in videos. Specifically, the paper addresses the following key issues:

1. **Problems with existing datasets**: Most existing video text detection algorithms and benchmarks mainly focus on text of regular size and density, neglecting extreme cases such as dense and small text in videos.

2. **Features of the new dataset**: The DSText V2 dataset focuses on the challenges of recognizing dense and small text in videos. It contains 140 video clips from 7 different open scenes and supports three tasks: video text detection, video text tracking, and end-to-end video text localization.

3. **Unique challenges of the dataset**:
- Dense video text: Each video frame in the new dataset contains a large number of text instances, posing new challenges to existing video text locators.
- High proportion of small text: These small texts may appear blurred and distorted in videos, increasing the difficulty of recognition.
- Diverse scenes: Scenes such as games and sports are introduced, further increasing the complexity and diversity of the dataset.

4. **Applications of the dataset**: The paper not only describes detailed statistics, task definitions, evaluation protocols, and result summaries of the dataset but also provides in-depth analysis of the three unique challenges (dense text, small text, and diverse scenes) to offer new insights to the video text research community.

5. **Competition organization**: The authors organized the 2023 ICDAR video text reading competition based on the DSText V2 dataset, including video text tracking and localization tasks, to promote research progress in this field.

In summary, this paper aims to advance research and development in the field of computer vision for dense and small video text by constructing a new video text detection benchmark, DSText V2.