Abstract:Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.

Optical Neural Networks of Handwriting Recognition Using Optical Scattering Unit System

Optical Convolutional Neural Network Based on an Amplitude Modulation Spatial Light Modulator and a 4-Level Phase Plate

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

OP-FCNN: an Optronic Fully Convolutional Neural Network for Imaging Through Scattering Media.

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Particle Swarm Optimization-Based Convolutional Neural Network for Handwritten Chinese Character Recognition

A Novel Handwritten Digit Classification System Based on Convolutional Neural Network Approach

The Handwritten Chinese Character Recognition Uses Convolutional Neural Networks with the GoogLeNet

Optoelectronic Convolutional Neural Networks Based on Time-Stretch Method

Leveraging ShuffleNet transfer learning to enhance handwritten character recognition

Multilayer Optoelectronic Hybrid Convolutional Neural Network with an Optical 4F-System Recurrent Structure

Beyond Human Recognition: A CNN-based Framework for Handwritten Character Recognition

Handwritten Text Recognition Using Convolutional Neural Network

Object Recognition Through Scattering Media Using Convolutional Neural Network

A New Deep Learning-Based Handwritten Character Recognition System on Mobile Computing Devices

Optical Character Recognition System for Digit Recognition Using Deep Learning

Improved Convolutional Neural Image Recognition Algorithm based on LeNet-5

Convolutional neural image recognition algorithm based on LeNet-5

Scalable Handwritten Digit Recognition Application using Neural Network and Convolutional Neural Network On Heterogeneous Architecture

High Performance Offline Handwritten Chinese Character Recognition Using GoogLeNet and Directional Feature Maps