Abstract:End-to-end text-spotting, which aims to integrate detection and recognition in a unified framework, has attracted increasing attention due to its simplicity of the two complimentary tasks. It remains an open problem especially when processing arbitrarily-shaped text instances. Previous methods can be roughly categorized into two groups: character-based and segmentation-based, which often require character-level annotations and/or complex post-processing due to the unstructured output. Here, we tackle end-to-end text spotting by presenting Adaptive Bezier Curve Network v2 (ABCNet v2). Our main contributions are four-fold: 1) For the first time, we adaptively fit arbitrarily-shaped text by a parameterized Bezier curve, which, compared with segmentation-based methods, can not only provide structured output but also controllable representation. 2) We design a novel BezierAlign layer for extracting accurate convolution features of a text instance of arbitrary shapes, significantly improving the precision of recognition over previous methods. 3) Different from previous methods, which often suffer from complex post-processing and sensitive hyper-parameters, our ABCNet v2 maintains a simple pipeline with the only post-processing non-maximum suppression (NMS). 4) As the performance of text recognition closely depends on feature alignment, ABCNet v2 further adopts a simple yet effective coordinate convolution to encode the position of the convolutional filters, which leads to a considerable improvement with negligible computation overhead. Comprehensive experiments conducted on various bilingual (English and Chinese) benchmark datasets demonstrate that ABCNet v2 can achieve state-of-the-art performance while maintaining very high efficiency. More importantly, as there is little work on quantization of text spotting models, we quantize our models to improve the inference time of the proposed ABCNet v2. This can be valuable for real-time applications. Code and model are availa-le at: https://git.io/AdelaiDet.

CFS: Character Feature Summarization Model for Real-time End-to-end Text Spotting

Focus on the Whole Character: Discriminative Character Modeling for Scene Text Recognition

CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarization

Character-Oriented Video Summarization with Visual and Textual Cues

Scene Text Recognition with Sliding Convolutional Character Models

C2F: an Effective Coarse-to-fine Network for Video Summarization

ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting

A New Perspective for Flexible Feature Gathering in Scene Text Recognition Via Character Anchor Pooling

A Hybrid Word-Character Approach to Abstractive Summarization

MSFM: Multi-view Semantic Feature Fusion Model for Chinese Named Entity Recognition.

Turning a CLIP Model into a Scene Text Spotter

A Character-Level Length-Control Algorithm for Non-Autoregressive Sentence Summarization

A Novel Text Structure Feature Extractor for Chinese Scene Text Detection and Recognition.

Scene Text Recognition Using Part-Based Tree-Structured Character Detection

An End-to-End TextSpotter with Explicit Alignment and Attention.

Improving Scene Text Recognition for Character-Level Long-Tailed Distribution

Compact Feedforward Sequential Memory Networks For Small-Footprint Keyword Spotting

LATextSpotter: Empowering Transformer Decoder with Length Perception Ability

A Discriminative Latent Variable Chinese Segmenter with Hybrid Word/Character Information.

An effective multi-modal adaptive contextual feature information fusion method for Chinese long text classification

CPMFA: A Character Pair-Based Method for Chinese Nested Named Entity Recognition