Abstract:Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.

Refocus attention span networks for handwriting line recognition

Pay Attention to What You Read: Non-recurrent Handwritten Text-Line Recognition

An Efficient End-to-End Neural Model for Handwritten Text Recognition

A novel connectionist system for unconstrained handwriting recognition

GatedLexiconNet: A Comprehensive End-to-End Handwritten Paragraph Text Recognition System

HAND: Hierarchical Attention Network for Multi-Scale Handwritten Document Recognition and Layout Analysis

Densely connected layer to improve VGGnet-based CRNN for Arabic handwriting text line recognition

Handwritten character recognition with sequential convolutional neural network

Integrating Canonical Neural Units and Multi-Scale Training for Handwritten Text Recognition

A Sequential Handwriting Recognition Model Based on a Dynamically Configurable CRNN

Intelligent character recognition using fully convolutional neural networks

AttentionHTR: Handwritten Text Recognition Based on Attention Encoder-Decoder Networks

Lexicon and Attention based Handwritten Text Recognition System

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Multi-layer Recurrent Neural Network Based Offline Arabic Handwriting Recognition

Towards End-to-end Handwritten Document Recognition

Deep LSTM Networks for Online Chinese Handwriting Recognition

Residual Recurrent Neural Network with Sparse Training for Offline Arabic Handwriting Recognition

Fully Convolutional Networks for Handwriting Recognition

Cross Lingual Handwritten Character Recognition Using Long Short Term Memory Network with aid of Elephant Herding Optimization Algorithm

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)