Abstract:Direct regression methods have demonstrated their success on various multi-oriented benchmarks for scene text detection due to the high recall rate for small targets and the direct regression for text boxes. However, too many false positive candidates and inaccurate position regression still limit the performance of these methods. In this paper, we propose an end-to-end method by introducing position-sensitive segmentation into the direct regression method to overcome these shortcomings. We generate the ground truth of position-sensitive segmentation maps based on the information of text boxes so that the position-sensitive segmentation module can be trained synchronously with the direct regression module. Besides, more information about the relative position of text is provided for the network through the training of position-sensitive segmentation maps, which improves the expressiveness of the network. We also introduce spatial pyramid of position-sensitive segmentation into the proposed method considering the huge differences in sizes and aspect ratios of scene texts and we propose position-sensitive COI(Corner area of Interest) pooling into the proposed method to speed up the inference. Experiments on datasets ICDAR2015, MLT-17 and COCO-Text demonstrate that the proposed method has a comparable performance with state-of-the-art methods while it is more efficient. We also provide abundant ablation experiments to demonstrate the effectiveness of these improvements in our proposed method.

Focus on Scene Text Using Deep Reinforcement Learning

RLST: A Reinforcement Learning Approach to Scene Text Detection Refinement

Deep Neural Network with Attention Model for Scene Text Recognition.

A Direct Regression Scene Text Detector with Position-Sensitive Segmentation

Deep Scene Text Detection with Connected Component Proposals.

Sequential Alignment Attention Model for Scene Text Recognition

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

DeepText: Detecting Text from the Wild with Multi-ASPP-Assembled DeepLab

A Cost-Efficient Framework for Scene Text Detection in the Wild

FDTA: Fully Convolutional Scene Text Detection with Text Attention.

Scene Text Detection with Fully Convolutional Neural Networks

Scene Text Detection Using Superpixel-Based Stroke Feature Transform and Deep Learning Based Region Classification

A Unified Deep Neural Network For Scene Text Detection

Efficient Scene Text Detection with Textual Attention Tower

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation

Multi-oriented Scene Text Detection by Fixed-Width Multi-Ratio Rotation Anchors

Enhancing Scene Text Recognition by Strengthening Attention Alignment

Scene text recognition based on two-stage attention and multi-branch feature fusion module

Deep Strip-Based Network with Cascade Learning for Scene Text Localization