Abstract:Recent deep learning models have demonstrated strong capabilities for classifying text and non-text components in natural images. They extract a high-level feature globally computed from a whole image component (patch), where the cluttered background information may dominate true text features in the deep representation. This leads to less discriminative power and poorer robustness. In this paper, we present a new system for scene text detection by proposing a novel text-attentional convolutional neural network (Text-CNN) that particularly focuses on extracting text-related regions and features from the image components. We develop a new learning mechanism to train the Text-CNN with multi-level and rich supervised information, including text region mask, character label, and binary text/non-text information. The rich supervision information enables the Text-CNN with a strong capability for discriminating ambiguous texts, and also increases its robustness against complicated background components. The training process is formulated as a multi-task learning problem, where low-level supervised information greatly facilitates the main task of text/non-text classification. In addition, a powerful low-level detector called contrast-enhancement maximally stable extremal regions (MSERs) is developed, which extends the widely used MSERs by enhancing intensity contrast between text patterns and background. This allows it to detect highly challenging text patterns, resulting in a higher recall. Our approach achieved promising results on the ICDAR 2013 data set, with an F-measure of 0.82, substantially improving the state-of-the-art results.

A Quantum-Based Attention Mechanism in Scene Text Detection.

Deep Neural Network with Attention Model for Scene Text Recognition.

Efficient Scene Text Detection with Textual Attention Tower

An Application of Quantum Mechanics to Attention Methods in Computer Vision

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Improved Fusion of Visual and Semantic Representations by Gated Co-Attention for Scene Text Recognition.

Gaussian Constrained Attention Network for Scene Text Recognition

Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection

Scene Text Recognition Via Gated Cascade Attention

QEA-Net: Quantum-Effects-based Attention Networks.

Text-Attentional Convolutional Neural Networks for Scene Text Detection

A Decoupled Language Model Based on Contrastive Attention Mechanism for Scene Text Recognition

Sequential Alignment Attention Model for Scene Text Recognition

Text-Attentional Convolutional Neural Network for Scene Text Detection

A Novel Attention Mechanism for Scene Text Detection

FDTA: Fully Convolutional Scene Text Detection with Text Attention.

Scene text recognition based on two-stage attention and multi-branch feature fusion module

Channel Attention for Quantum Convolutional Neural Networks

Using of Attention for Scene Text Detection

Quantum self-attention neural networks for text classification

Adaptive Multi-Scale HyperNet with Bi-Direction Residual Attention Module for Scene Text Detection