Abstract:Neural networks have made big strides in image classification. Convolutional neural networks (CNN) work successfully to run neural networks on direct images. Handwritten character recognition (HCR) is now a very powerful tool to detect traffic signals, translate language, and extract information from documents, etc. Although handwritten character recognition technology is in use in the industry, present accuracy is not outstanding, which compromises both performance and usability. Thus, the character recognition technologies in use are still not very reliable and need further improvement to be extensively deployed for serious and reliable tasks. On this account, characters of the English alphabet and digit recognition are performed by proposing a custom-tailored CNN model with two different datasets of handwritten images, i.e., Kaggle and MNIST, respectively, which are lightweight but achieve higher accuracies than state-of-the-art models. The best two models from the total of twelve designed are proposed by altering hyper-parameters to observe which models provide the best accuracy for which dataset. In addition, the classification reports (CRs) of these two proposed models are extensively investigated considering the performance matrices, such as precision, recall, specificity, and F1 score, which are obtained from the developed confusion matrix (CM). To simulate a practical scenario, the dataset is kept unbalanced and three more averages for the F measurement (micro, macro, and weighted) are calculated, which facilitates better understanding of the performances of the models. The highest accuracy of 99.642% is achieved for digit recognition, with the model using ‘RMSprop’, at a learning rate of 0.001, whereas the highest detection accuracy for alphabet recognition is 99.563%, which is obtained with the proposed model using ‘ADAM’ optimizer at a learning rate of 0.00001. The macro F1 and weighted F1 scores for the best two models are 0.998, 0.997:0.992, and 0.996, respectively, for digit and alphabet recognition.

A Recognition Method for Italian Alphabet Gestures Based on Convolutional Neural Network

Deep Learning Based Hand Gesture Recognition in Complex Scenes

Visual Hand Gesture Recognition With Convolution Neural Network

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

An Improved Gesture Segmentation Method for Gesture Recognition Based on CNN and YCbCr

Convolutional neural network with spatial pyramid pooling for hand gesture recognition

A Static Hand Gesture Recognition for Peruvian Sign Language Using Digital Image Processing and Deep Learning

Recognition of Handwritten Japanese Characters Using Ensemble of Convolutional Neural Networks

Indian Sign Language Gesture Recognition using Image Processing and Deep Learning

3D dynamic hand gestures recognition using the Leap Motion sensor and convolutional neural networks

Air-GR: An Over-the-Air Handwritten Character Recognition System Based on Coordinate Correction YOLOv5 Algorithm and LGR-CNN

Real-Time Hand Gesture Recognition Using Fine-Tuned Convolutional Neural Network

A Comprehensive Evaluation of Moving Static Gesture Recognition with Convolutional Networks

A novel hand gesture detection and recognition system based on ensemble-based convolutional neural network

Convolutional-Neural-Network-Based Handwritten Character Recognition: An Approach with Massive Multisource Data

Gesture Recognition System Based on CNN-IndRNN and OpenBCI

A novel art gesture recognition model based on two channel region-based convolution neural network for explainable human-computer interaction understanding

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Gesture recognition based on deep deformable 3D convolutional neural networks

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)