Abstract:This paper introduces a novel bi-directional con-volutional framework to cope with the large-variance scale problem in scene text detection. Due to the lack of scale normalization in recent CNN-based methods, text instances with large-variance scale are activated inconsistently in feature maps, which makes it hard for CNN-based methods to accurately locate multi-size text instances. Thus, we propose the relationship network (R-Net) that maps multi-scale convolutional features to a scale-invariant space to obtain consistent activation of multi-size text instances. Firstly, we implement an FPN-like backbone with a Spatial Relationship Module (SPM) to extract multi-scale features with powerful spatial semantics. Then, a Scale Relationship Module (SRM) constructed on feature pyramid propagates contextual scale information in sequential features through a bi-directional convolutional operation. SRM supplements the multi-scale information in different feature maps to obtain consistent activation of multi-size text instances. Compared with previous approaches, R-Net effectively handles the large-variance scale problem without complicated post processing and complex hand-crafted hyperparameter setting. Extensive experiments conducted on several benchmarks verify that our R-Net obtains state-of-the-art performance on both accuracy and efficiency. More specifically, R-Net achieves an F-measure of 85.6% at 21.4 frames/s and an F-measure of 81.7% at 11.8 frames/s for ICDAR 2015 and MSRA-TD500 datasets respectively, which is the latest SOTA. The code is available on https://github.com/wangyuxin87/R-Net.

Scale Robust Deep Oriented-Text Detection Network

Multi-orientation scene text detection with scale-guided regression

DSRN: A Deep Scale Relationship Network for Scene Text Detection.

Shape Robust Text Detection with Progressive Scale Expansion Network

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

Multi-Oriented Text Detection with Fully Convolutional Networks

A Direct Regression Scene Text Detector with Position-Sensitive Segmentation

Exploring the Capacity of an Orderless Box Discretization Network for Multi-orientation Scene Text Detection

R-Net: A Relationship Network for Efficient and Accurate Scene Text Detection

Detecting Multi-Oriented Text with Corner-Based Region Proposals

MOST: A Multi-Oriented Scene Text Detector with Localization Refinement

Deep Neural Network with Attention Model for Scene Text Recognition.

Scene Text Detection with Fully Convolutional Neural Networks

Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion

Robust Scene Text Recognition Through Adaptive Image Enhancement

Scale-Residual Learning Network for Scene Text Detection

Natural Scene Text Detection Based on Multiscale Connectionist Text Proposal Network

OPMP: An Omnidirectional Pyramid Mask Proposal Network for Arbitrary-Shape Scene Text Detection

EAST: An Efficient and Accurate Scene Text Detector

Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection