Abstract:The Handwritten Text Recognition problem has been a challenge for researchers for the last few decades, especially in the domain of computer vision, a subdomain of pattern recognition. Variability of texts amongst writers, cursiveness, and different font styles of handwritten texts with degradation of historical text images make it a challenging problem. Recognizing scanned document images in neural network-based systems typically involves a two-step approach: segmentation and recognition. However, this method has several drawbacks. These shortcomings encompass challenges in identifying text regions, analyzing layout diversity within pages, and establishing accurate ground truth segmentation. Consequently, these processes are prone to errors, leading to bottlenecks in achieving high recognition accuracies. Thus, in this study, we present an end-to-end paragraph recognition system that incorporates internal line segmentation and gated convolutional layers based encoder. The gating is a mechanism that controls the flow of information and allows to adaptively selection of the more relevant features in handwritten text recognition models. The attention module plays an important role in performing internal line segmentation, allowing the page to be processed line-by-line. During the decoding step, we have integrated a connectionist temporal classification-based word beam search decoder as a post-processing step. In this work, we have extended existing LexiconNet by carefully applying and utilizing gated convolutional layers in the existing deep neural network. Our results at line and page levels also favour our new GatedLexiconNet. This study reported character error rates of 2.27% on IAM, 0.9% on RIMES, and 2.13% on READ-16, and word error rates of 5.73% on IAM, 2.76% on RIMES, and 6.52% on READ-2016 datasets.

Segmentation and recognition of handwritten Pitman shorthand outlines using neural networks

Segmentation and Recognition of On-Line Pitman Shorthand Outlines Using Neural Networks

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Refocus attention span networks for handwriting line recognition

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

HANDWRITING RECOGNITION SYSTEM BASED ON NEURAL NETWORK ENSEMBLE

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

GatedLexiconNet: A Comprehensive End-to-End Handwritten Paragraph Text Recognition System

Using neural network classifier in post-processing system for handwritten Chinese character recognition

Novel Character Segmentation Method for Overlapped Chinese Handwriting Recognition Based on LSTM Neural Networks

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

A novel connectionist system for unconstrained handwriting recognition

PageNet: Towards End-to-End Weakly Supervised Page-Level Handwritten Chinese Text Recognition

A comprehensive study of hybrid neural network hidden Markov model for offline handwritten Chinese text recognition

Watch, Attend and Parse: an End-to-end Neural Network Based Approach to Handwritten Mathematical Expression Recognition.

On-line Handwritten Chinese Word Recognition Based on Lexicon

Deep LSTM Networks for Online Chinese Handwriting Recognition

Parallel Neural Networks for Speaker-Independent All-Chinese-syllable Speech Recognition

Off-line Recognition of Realistic Chinese Handwriting Using Segmentation-Free Strategy

Handwritten Character Recognition Based on Hybrid Neural Networks

New Neural Network Architecture with Application in Mandarin Digit Speech Recognition