Abstract:Writing style is an abstract attribute in handwritten text. It plays an important role in recognition systems and is not easy to define explicitly. Considering the effect of writing style, a writer adaptation method is proposed to transform a writer-independent recognizer toward a particular writer. This transformation has the potential to significantly increase accuracy. In this paper, under the deep learning framework, we propose a general fast writer adaptation solution. Specifically, without depending on other complex skills, a well designed style extractor network (SEN) trained by identification loss (IDL) is introduced to explicitly extract personalized writer information. The architecture of SEN consists of a stack of convolutional layers followed by a recurrent neural network with gated recurrent units to remove semantic context and retain writer information. Then, the outputs of the GRU are further integrated into a one-dimensional vector that is adopted to represent writing style. Finally, the extracted style information is fed into the writer-independent recognizer to achieve adaptation. Validated on offline handwritten text recognition tasks, the proposed fast sentence-level adaptation achieves remarkable improvements in Chinese and English text recognition tasks. Specifically, in the HETR task, a multi-information fusion network that is equipped with a hybrid attention mechanism and that integrates visual features, context features and writing style is proposed. In addition, under the same condition (only one writer-specific text line used as adaptation data), the proposed solution, without consuming extra time, can significantly outperform the previous multiple-pass decoding method. The code is available at https://github.com/Wukong90/Handwritten-Text-Recognition.

Global Regular Network for Writer Identification

Off- Line Chinese Writer Identification Based on Character-Level Decision Combination

A Stroke-Based RNN for Writer-Independent Online Signature Verification.

Dual-Branch Multitask Fusion Network for Offline Chinese Writer Identification.

Character-level Chinese Writer Identification using Path Signature Feature, DropStroke and Deep CNN

GMU: A Novel RNN Neuron and Its Application to Handwriting Recognition.

Exploiting Multi-Scale Fusion, Spatial Attention and Patch Interaction Techniques for Text-Independent Writer Identification

Siamese based Neural Network for Offline Writer Identification on word level data

Writer Adaptation Using Bottleneck Features and Discriminative Linear Regression for Online Handwritten Chinese Character Recognition

Fast writer adaptation with style extractor network for handwritten text recognition

A Neural Network Expert System for Chinese Handwriting-Based Writer Identification

Writer Adaptation Via Deeply Learned Features for Online Chinese Handwriting Recognition

Vision Graph Convolutional Network for Writer-Independent Offline Signature Verification

Writer Adaptive Feature Extraction Based on Convolutional Neural Networks for Online Handwritten Chinese Character Recognition

Text-Independent Writer Identification Via CNN Features and Joint Bayesian

Writer Code Based Adaptation of Deep Neural Network for Offline Handwritten Chinese Text Recognition.

Top interpretable neural network for handwriting identification

Refocus attention span networks for handwriting line recognition

Robust Shared Feature Learning for Script and Handwritten/machine-Printed Identification

Dense Residual Network: Enhancing global dense feature flow for character recognition

Research on Text-Independent Writer Recognition with Background Image