Abstract:In arbitrary shape text detection, locating accurate text boundaries is challenging and non-trivial. Existing methods often suffer from indirect text boundary modeling or complex post-processing. In this paper, we systematically present a unified coarse-to-fine framework via boundary learning for arbitrary shape text detection, which can accurately and efficiently locate text boundaries without post-processing. In our method, we explicitly model the text boundary via an innovative iterative boundary transformer in a coarse-to-fine manner. In this way, our method can directly gain accurate text boundaries and abandon complex post-processing to improve efficiency. Specifically, our method mainly consists of a feature extraction backbone, a boundary proposal module, and an iteratively optimized boundary transformer module. The boundary proposal module consisting of multi-layer dilated convolutions will predict important prior information (including classification map, distance field, and direction field) for generating coarse boundary proposals while guiding the boundary transformer's optimization. The boundary transformer module adopts an encoder-decoder structure, in which the encoder is constructed by multi-layer transformer blocks with residual connection while the decoder is a simple multi-layer perceptron network (MLP). Under the guidance of prior information, the boundary transformer module will gradually refine the coarse boundary proposals via iterative boundary deformation. Furthermore, we propose a novel boundary energy loss (BEL) that introduces an energy minimization constraint and an energy monotonically decreasing constraint to further optimize and stabilize the learning of boundary refinement. Extensive experiments on publicly available and challenging datasets demonstrate the state-of-the-art performance and promising efficiency of our method. The code and model are available at:https://github.com/GXYM/TextBPN-Puls-Plus.

Circle Text Expansion as Low-Rank Textures

Rectification of Optical Characters as Transform Invariant Low-Rank Textures

A method for text line detection in natural images

Transform Invariant Text Extraction

TILT: Transform Invariant Low-rank Textures

TextDCT: Arbitrary-Shaped Text Detection Via Discrete Cosine Transform Mask.

CentripetalText: an Efficient Text Instance Representation for Scene Text Detection

Linearized Alternating Direction Method with Adaptive Penalty and Warm Starts for Fast Solving Transform Invariant Low-Rank Textures

Towards Robust Curve Text Detection with Conditional Spatial Expansion

CT-Net: Arbitrary-Shaped Text Detection via Contour Transformer

Rethinking Irregular Scene Text Recognition

MA-CharNet: Multi-angle fusion character recognition network

ContourNet: Taking a Further Step Toward Accurate Arbitrary-shaped Scene Text Detection.

Follow the Curve: Arbitrarily Oriented Scene Text Detection Using Key Points Spotting and Curve Prediction

A Scheme for Automatic Text Rectification in Real Scene Images.

$$\Mathrm T^2$$Net: an Improved Image-Based Text Transfer Framework Using Background Inpainting and Text Conversion

Curved Text Detection in Blurred/non-Blurred Video/scene Images

Arbitrary Shape Text Detection via Boundary Transformer

Contour Restoration of Text Components for Recognition in Video/Scene Images.

TextTriangle: an End-to-end Textspotter with Piecewise Linear Alignment

Feature-aligned Shape Texturing