Abstract:Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.

A neural network structure for feature extraction and recognition of handwritten digits

Chinese Calligraphic Style Representation for Recognition

Research on Automatic Recognition of Unconstratined Handwritten Digits

Digit Recognition Based on Programmable Nanophotonic Processor

Handwritten digits recognition with artificial neural network

A Hybrid Handwritten Digits Recognition System Based on Neural Networks and Fuzzy Logic

Diagonal Based Feature Extraction for Handwritten Alphabets Recognition System using Neural Network

Handwritten Digit Recognition Using Low Rank Approximation Based Competitive Neural Network

TAF Neural Network for Handwritten Digits Recognition.

Multiple classifiers fusion and CNN feature extraction for handwritten digits recognition

A Simple Feature Extraction Method for Analysis of Hand Written Characters

A Machine Learning Framework for Recognizing Handwritten Digits Using Convexity-Based Feature Vector Encoding

Banknote Serial Number Recognition Using Deep Learning

FPGA Implementation of Feature Extraction and Neural Network Classifier for Handwritten Digit Recognition

A Study of Designing Compact Classifiers Using Deep Neural Networks for Online Handwritten Chinese Character Recognition

A novel multilevel stacked SqueezeNet model for handwritten Chinese character recognition

Adhesive Handwritten Digit Recognition Algorithm Based on Improved Convolutional Neural Network

User-Independent Online Handwritten Digit Recognition

Character-Level Feature Extraction with Densely Connected Networks

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

Handwritten Digit Recognition of MNIST dataset using Deep Learning state-of-the-art Artificial Neural Network (ANN) and Convolutional Neural Network (CNN)