Abstract:Existing methods for arbitrary shaped text spotting can be divided into two categories: bottom-up methods detect and recognize local areas of text, and then group them into text lines or words; top-down methods detect text regions of interest, then apply polygon fitting and text recognition to the detected regions. In this paper, we analyze the advantages and disadvantages of these two methods, and propose a novel text spotter by fusing bottom-up and top-down processing. To detect text of arbitrary shapes, we employ a bottom-up detector to describe text with a series of rotated squares, and design a top-down detector to represent the region of interest with a minimum enclosing rotated rectangle. Then the text boundary is determined by fusing the outputs of two detectors. To connect arbitrary shaped text detection and recognition, we propose a differentiable operator named RoISlide, which can extract features for arbitrary text regions from whole image feature maps. Based on the extracted features through RoISlide, a CNN and CTC based text recognizer is introduced to make the framework free from character-level annotations. To improve the robustness against scale variance, we further propose a residual dual scale spotting mechanism, where two spotters work on different feature levels, and the high-level spotter is based on residuals of the low-level spotter. Our method has achieved state-of-the-art performance on four English datasets and one Chinese dataset, including both arbitrary shaped and oriented texts. We also provide abundant ablation experiments to analyze how the key components affect the performance.

A Multi-oriented Chinese Keyword Spotter Guided by Text Line Detection

The Keywords Spotting with Context for Multi -Oriented Chinese Scene Text

A method for text line detection in natural images

Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes

Keyword Spotting Simplified: A Segmentation-Free Approach using Character Counting and CTC re-scoring

A Multi-stage Method for Chinese Text Detection in News Videos

Towards End-to-End Text Spotting in Natural Scenes

TextBlock: Towards Scene Text Spotting without Fine-grained Detection

MANGO: A Mask Attention Guided One-Stage Scene Text Spotter

A Keyword Spotting Method

Mask TextSpotter V3: Segmentation Proposal Network for Robust Scene Text Spotting

Mlts: A Multi-Language Scene Text Spotter

Residual Dual Scale Scene Text Spotting by Fusing Bottom-Up and Top-Down Processing

A chinese words detection method in camera based images

TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model

An End-to-End TextSpotter with Explicit Alignment and Attention.

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

TextBlock

Audio-visual Keyword Spotting for Mandarin Based on Discriminative Local Spatial-Temporal Descriptors.

Boundary TextSpotter: Toward Arbitrary-Shaped Scene Text Spotting

MT: Multi-Perspective Feature Learning Network for Scene Text Detection