Abstract:More and more end-to-end text spotting methods based on Transformer architecture have demonstrated superior performance. These methods utilize a bipartite graph matching algorithm to perform one-to-one optimal matching between predicted objects and actual objects. However, the instability of bipartite graph matching can lead to inconsistent optimization targets, thereby affecting the training performance of the model. Existing literature applies denoising training to solve the problem of bipartite graph matching instability in object detection tasks. Unfortunately, this denoising training method cannot be directly applied to text spotting tasks, as these tasks need to perform irregular shape detection tasks and more complex text recognition tasks than classification. To address this issue, we propose a novel denoising training method (DNTextSpotter) for arbitrary-shaped text spotting. Specifically, we decompose the queries of the denoising part into noised positional queries and noised content queries. We use the four Bezier control points of the Bezier center curve to generate the noised positional queries. For the noised content queries, considering that the output of the text in a fixed positional order is not conducive to aligning position with content, we employ a masked character sliding method to initialize noised content queries, thereby assisting in the alignment of text content and position. To improve the model's perception of the background, we further utilize an additional loss function for background characters classification in the denoising training <a class="link-external link-http" href="http://part.Although" rel="external noopener nofollow">this http URL</a> DNTextSpotter is conceptually simple, it outperforms the state-of-the-art methods on four benchmarks (Total-Text, SCUT-CTW1500, ICDAR15, and Inverse-Text), especially yielding an improvement of 11.3% against the best approach in Inverse-Text dataset.

LATextSpotter: Empowering Transformer Decoder with Length Perception Ability

Word length-aware text spotting: Enhancing detection and recognition in dense text image

ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformer

DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting.

Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting

FastTextSpotter: A High-Efficiency Transformer for Multilingual Scene Text Spotting

DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Training

LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition

DeepSolo++: Let Transformer Decoder with Explicit Points Solo for Multilingual Text Spotting

Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidance

AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting

TextFormer: A Query-based End-to-End Text Spotter with Mixed Supervision

An End-to-End TextSpotter with Explicit Alignment and Attention.

SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition

Towards End-to-End Text Spotting in Natural Scenes

Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes

End-to-End Video Text Spotting with Transformer

Efficiently Leveraging Linguistic Priors for Scene Text Spotting

MANGO: A Mask Attention Guided One-Stage Scene Text Spotter

Boundary TextSpotter: Toward Arbitrary-Shaped Scene Text Spotting

TDI TextSpotter: Taking Data Imbalance into Account in Scene Text Spotting.