Abstract:Arbitrary-shaped text detection in natural images is a challenging task due to the complexity of the background and the diversity of text properties. The difficulty lies in two aspects: accurate separation of adjacent texts and sufficient text feature representation. To handle these problems, we consider text detection as instance segmentation and propose a novel text detection framework, which jointly learns semantic segmentation and a pixel affinity pyramid in a unified fully convolutional network. Specifically, the pixel affinity pyramid is proposed to encode multi-scale instance affiliation relationships of pixels, which is not only robust to varying shapes of text but also provides an accurate boundary description for separating closely located texts. In the inference phase, a simple but effective post-processing is presented to reconstruct text instances from the semantic segmentation results under the guidance of the learned pixel affinity pyramid, achieving good accuracy and efficiency. Furthermore, to enhance the representation of text features in the neural network, two modules — the Region Enhancement Module (REM) and Attentional Fusion Module (AFM) — are proposed. The REM models the semantic correlations of regional features to enhance the features from the text area, which effectively suppresses false-positive detection. The AFM adaptively fuses multi-scale textual information through an attention mechanism to obtain abundant text semantic features, which benefits multi-sized text detection. Extensive ablation experiments are conducted demonstrating the effectiveness of the REM and AFM. Evaluation results on standard benchmarks, including Total-Text, ICDAR2015, SCUT-CTW1500, and MSRA-TD500, show that our method surpasses most existing text detectors and achieves state-of-the-art performance, denoting its superior capability in detecting arbitrary-shaped texts.

FARNet: Fragmented Affinity Reasoning Network of Text Instances for Arbitrary Shape Text Detection.

Learning Pixel Affinity Pyramid for Arbitrary-Shaped Text Detection

HGR-Net: Hierarchical Graph Reasoning Network for Arbitrary Shape Scene Text Detection.

Arbitrary Shape Scene Text Detector with Accurate Text Instance Generation Based on Instance-Relevant Contexts

Arbitrary-shape Scene Text Detection via Visual-Relational Rectification and Contour Approximation

CRNet: A Center-aware Representation for Detecting Text of Arbitrary Shapes

Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network

Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detection

Fenet: Feature Enhancement Network for Arbitrary Direction Text Detection

Arbitrary-Shaped Text Detection withAdaptive Text Region Representation

Feature Fusion Pyramid Network for End-to-end Scene Text Detection

Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection

CM-Net: Concentric Mask Based Arbitrary-Shaped Text Detection

Region-aware Arbitrary-shaped Text Detection with Progressive Fusion

ADNet: Rethinking the Shrunk Polygon-Based Approach in Scene Text Detection

TextFuseNet: Scene Text Detection with Richer Fused Features.

Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation

CSFF-Net: Scene Text Detection Based on Cross-Scale Feature Fusion

Fourier Contour Embedding for Arbitrary-Shaped Text Detection

ContourNet: Taking a Further Step Toward Accurate Arbitrary-shaped Scene Text Detection.

Adaptive Boundary Proposal Network for Arbitrary Shape Text Detection