Abstract:Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.

A recurrent neural network based deep learning model for text and non-text stroke classification in online handwritten Devanagari document

A Stroke-Based RNN for Writer-Independent Online Signature Verification.

NeuroWrite: Predictive Handwritten Digit Classification using Deep Neural Networks

An Efficient End-to-End Neural Model for Handwritten Text Recognition

A Study on Handwritten Text Recognition Classification using Diverse Deep Learning Techniques and Computation of CTC Loss

Handwritten Digit Recognition of MNIST dataset using Deep Learning state-of-the-art Artificial Neural Network (ANN) and Convolutional Neural Network (CNN)

DeepNetDevanagari: a deep learning model for Devanagari ancient character recognition

Enhancement of handwritten text recognition using AI-based hybrid approach

Handwritten Text Recognition Using Convolutional Neural Network

Siamese based Neural Network for Offline Writer Identification on word level data

Devanagari Handwritten Character Recognition using fine-tuned Deep Convolutional Neural Network on trivial dataset

Bangla-Meitei Mayek scripts handwritten character recognition using Convolutional Neural Network

Handwritten Digit Recognition using Machine and Deep Learning Algorithms

HANDWRITTEN CHARACTER RECOGNITION USING CONVOLUTIONAL NEURAL NETWORKS

DevNet: An Efficient CNN Architecture for Handwritten Devanagari Character Recognition

A Framework for On-Line Devanagari Handwritten Character Recognition

Bengali Handwritten Character Classification using Transfer Learning on Deep Convolutional Neural Network

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

OCR using CRNN: A Deep Learning Approach for Text Recognition

Handwritten text recognition and information extraction from ancient manuscripts using deep convolutional and recurrent neural network

Handwritten Odia Digit Recognition using Learning Systems: A Comparison of Neural Networks and Support Vector Machine Models