Abstract:Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.

Improves Character Recognition Rate on Low Quality Images by a Deep Learning Framework

Low-Light Image Enhancement Based on Deep Convolutional Neural Network

Handwriting Verification Using Wavelet Transform and Neural Network Ensemble

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

An improved LeNet-5 model for Image Recognition

Recognition of Off-line Handwritten Chinese Character Based on Deep Residual Network

Beyond Human Recognition: A CNN-based Framework for Handwritten Character Recognition

Adhesive Handwritten Digit Recognition Algorithm Based on Improved Convolutional Neural Network

Multilayer Self-Organizing Impulse Neural Network for Handwritten Digit Recognition

A Deep Learning Technology based OCR Framework for Recognition Handwritten Expression and Text

An Improved Image Enhancement Technique for Low Light Images Using Deep Learning Approach

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

Similar Handwritten Chinese Character Recognition Based on Deep Neural Networks with Big Data

The Performance Realization of Some Improved BP Neural Networkin Handwritten Digit Recognition

A Robust Cross-Ethnic Digital Handwriting Recognition Method Based on Deep Learning

Deep Matching Network for Handwritten Chinese Character Recognition

Improved Deep Convolutional Neural Network For Online Handwritten Chinese Character Recognition using Domain-Specific Knowledge

An Adaptive Deep Q-learning Strategy for Handwritten Digit Recognition

Improvement of the AlexNet Networks for Large-Scale Recognition Applications

Deep networks for online handwriting Chinese character recognition

Handwritten Digits Recognition Based on Fused Convolutional Neural Network Model