Abstract:Recurrent neural networks have achieved outstanding recognition performance for handwriting identification despite the enormous variety observed across diverse handwriting structures and poor-quality scanned documents. We initially proposed a BiLSTM baseline model with a sequential architecture well-suited for modeling text lines due to its ability to learn probability distributions over character or word sequences. However, employing such recurrent paradigms prevents parallelization and suffers from vanishing gradients for long sequences during training. To alleviate these limitations, we propose four significant contributions to this work. First, we devised an end-to-end model composed of a split-attention CNN-backbone that serves as a feature extraction method and a self-attention Transformer encoder–decoder that serves as a transcriber method to recognize handwriting manuscripts. The multi-head self-attention layers in an encoder–decoder transformer-based enhance the model's ability to tackle handwriting recognition and learn the linguistic dependencies of character sequences. Second, we conduct various studies on transfer learning (TL) from large datasets to a small database, determining which model layers require fine-tuning. Third, we attained an efficient paradigm by combining different strategies of TL with data augmentation (DA). Finally, since the robustness of the proposed model is lexicon-free and can recognize sentences not presented in the training phase, the model is only trained on a few labeled examples with no extra cost of generating and training on synthetic datasets. We recorded comparable and outperformed Character and Word Error Rates CER/WER on four benchmark datasets to the most recent (SOTA) models.

HANDWRITING RECOGNITION SYSTEM BASED ON NEURAL NETWORK ENSEMBLE

Boosting the Expense and Performance of Ann／Hmm Approch for On-Line Handwriting Recognition

A Hybrid Handwritten Digits Recognition System Based on Neural Networks and Fuzzy Logic

A novel connectionist system for unconstrained handwriting recognition

A Handwritten Character Recognition Method with ANN Feedback.

Segmentation and recognition of handwritten Pitman shorthand outlines using neural networks

Multiple Experts Recognition System Based on Neural Network

A Model for Dynamic Handwritten Signature Verification Based on Neural Network

Segmentation and Recognition of On-Line Pitman Shorthand Outlines Using Neural Networks

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

A Stroke-Based RNN for Writer-Independent Online Signature Verification.

Chinese Character Recognition Method Based On Multi-Features And Parallel Neural Network Computation

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Online Chinese Handwriting Recognition with Time Sequence Information

Recognition of Handwritten Japanese Characters Using Ensemble of Convolutional Neural Networks

Refocus attention span networks for handwriting line recognition

Handwriting Recognition Using Artificial Intelligence with Neural Network

Handwritten Recognition Using SVM, KNN and Neural Network

Offline Arabic Handwriting Recognition Using Artificial Neural Network

Convolutional Neural Network Based Intelligent Handwritten Document Recognition

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition