Abstract:End-to-end text-spotting, which aims to integrate detection and recognition in a unified framework, has attracted increasing attention due to its simplicity of the two complimentary tasks. It remains an open problem especially when processing arbitrarily-shaped text instances. Previous methods can be roughly categorized into two groups: character-based and segmentation-based, which often require character-level annotations and/or complex post-processing due to the unstructured output. Here, we tackle end-to-end text spotting by presenting Adaptive Bezier Curve Network v2 (ABCNet v2). Our main contributions are four-fold: 1) For the first time, we adaptively fit arbitrarily-shaped text by a parameterized Bezier curve, which, compared with segmentation-based methods, can not only provide structured output but also controllable representation. 2) We design a novel BezierAlign layer for extracting accurate convolution features of a text instance of arbitrary shapes, significantly improving the precision of recognition over previous methods. 3) Different from previous methods, which often suffer from complex post-processing and sensitive hyper-parameters, our ABCNet v2 maintains a simple pipeline with the only post-processing non-maximum suppression (NMS). 4) As the performance of text recognition closely depends on feature alignment, ABCNet v2 further adopts a simple yet effective coordinate convolution to encode the position of the convolutional filters, which leads to a considerable improvement with negligible computation overhead. Comprehensive experiments conducted on various bilingual (English and Chinese) benchmark datasets demonstrate that ABCNet v2 can achieve state-of-the-art performance while maintaining very high efficiency. More importantly, as there is little work on quantization of text spotting models, we quantize our models to improve the inference time of the proposed ABCNet v2. This can be valuable for real-time applications. Code and model are availa-le at: https://git.io/AdelaiDet.

SpottingNet: Learning the Similarity of Word Images with Convolutional Neural Network for Word Spotting in Handwritten Historical Documents

Page-Level Handwritten Word Spotting via Discriminative Feature Learning.

Deep Features Representation of Word Image for Keyword Spotting in Historical Mongolian Document Images

Word Image Representation Based On Visual Embeddings And Spatial Constraints For Keyword Spotting On Historical Documents

Query by Strings and Return Ranking Word Regions with Only One Look

A Hybrid Representation of Word Images for Keyword Spotting.

Representing Word Image Using Visual Word Embeddings And Rnn For Keyword Spotting On Historical Document Images

HWNet v2: An Efficient Word Image Representation for Handwritten Documents

Towards End-to-End Text Spotting in Natural Scenes

HENet: Hyperbolic-Based Encoder-Decoder Network for Word Spotting in Historical Mongolian Documents

An End-to-End TextSpotter with Explicit Alignment and Attention.

Bootstrapping Weakly Supervised Segmentation-free Word Spotting through HMM-based Alignment

Discovering similar Chinese characters in online handwriting with deep convolutional neural networks

Handwritten-word spotting using biologically inspired features

Spotting the Unseen: Reciprocal Consensus Network Guided by Visual Archetypes

ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting

Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networks

Keyword Spotting Simplified: A Segmentation-Free Approach using Character Counting and CTC re-scoring

Robust End-to-End Offline Chinese Handwriting Text Page Spotter with Text Kernel

A Case Study of Bovw for Keyword Spotting on Historical Mongolian Document Images

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.