Handwritten Character Recognition by Extended Loop Neural Networks

Miao Zhenjiang,Yuan Baozong

DOI: https://doi.org/10.1109/sipnn.1994.344871

1994-01-01

Abstract:Presents an extended loop neural network approach to handwritten character recognition. Experiments show that this method is very effective. The recognition rate by this method is higher than that by a backpropagation network

What problem does this paper attempt to address?

Off-line Chinese Handwriting Recognition Using Multi-Stage Neural Network Architecture

LW Jin,KP Chan,BZ Xu

DOI: https://doi.org/10.1109/icnn.1995.487276

1995-01-01

Abstract:In this paper, we propose a multi-stage neural network architecture (MNNA) which integrates several neural networks and various feature extraction approaches into a unique pattern recognition system. The general mechanism for designing the MNNA is presented. A three-stage fully connected feedforward neural networks system is designed for handwritten Chinese character recognition (HCCR). Different feature extraction methods are employed at each stage. Experiments show that the three-stage neural network based HCCR system achieved impressive performance and the preliminary results are very encouraging
An Effective Result-Feedback Neural Algorithm for Handwritten Character Recognition

Xiaoyan Zhu,Yu Hao,Yifan Shi,David Zhang

2001-01-01

Abstract:In this paper, a new algorithm of handwritten character recognition based on result-feedback is proposed. It is designed as an effective neural network by adding confidence back-propagation and input modification, thus both pre-processing and recognition operations are closely integrated together. The convergence of the algorithm is proved and many experiments show that the error rate in such a result-feedback neural network (RFNN) can be greatly reduced as well as the robust to environmental noise.
The Optical Character Recognition Technique Based On Computer Vision And Neural Network

Ying Yun,Shuguang Dai,Ping'An Mu,Lin Wang

2008-01-01

Abstract:This paper mainly introduced a recognition method of the handwritten optical character based on computer vision and neural network. Handwritten optical character recognition is a technical difficulty in this field. This paper solved two problems. One is the characteristic extraction of the character imager, the other is the design of the classifier. According to the four-layer BP network which has great adaptability and study ability, ten classifiers were set up to classify the character. In the paper, several aspects of this new method were discussed. First, learning the technique of computer vision and the BP network which are the basic. Second, some standards of the characteristic extraction should be chosen. Third, think of some influence factors to design good classifiers. Finally, improve the design and get the better result. Through the experiment, this method can identify handwritten optical character availably, and this nerve network system has high convergence speed. So there will be a further application foreground in the future.
Handwritten Character Recognition Based on Hybrid Neural Networks

P Wang,GM Sun,XM Zhang

DOI: https://doi.org/10.1117/12.441669

2001-01-01

Abstract:A hybrid neural network system for the recognition of handwritten character using SOFM,BP and Fuzzy network is presented. The horizontal and vertical project of preprocessed character and 4_directional edge project are used as feature vectors. In order to improve the recognition effect, the GAT algorithm is applied. Through the hybrid neural network system, the recognition rate is improved visibly.
Handwriting Verification Using Wavelet Transform and Neural Network Ensemble

ZHANG Hui-dang,HE Yu-yao

DOI: https://doi.org/10.3969/j.issn.1001-3695.2008.03.028

2008-01-01

Abstract:In order to obtain the exiguous character of handwriting,texture feature of single character was extracted based on linearity moments and wavelet transform.The feature of character construction could be extracted by wavelet transform effectively and described by moments.A Chinese character image could be compressed into a vector of 52 elements in handwriting verification system.A finite number of neural networks were trained,and the method of neural network ensemble was adopted to combine their results for classifying the space of the feature vector.The experiments were done based on different numbers of feature characters and candidates,and comparative experiments were also done with the methods proposed by other researchers. Experimental results show that in average 5% improvement of recognition accuracy can be obtained,which indicates the method can be put into handwriting verification effectively.
A Handwritten Character Recognition Method with ANN Feedback.

XY Zhu,YF Shi

DOI: https://doi.org/10.1109/icdar.2001.953794

2001-01-01

Abstract:In this paper, a new approach of handwritten character recognition system with Artificial Neural Network (ANN) feedback is proposed. This recognition system is based on a neural recognition network and a neural feedback network, the out put of which is used to modify the feature of the input pattern, thus preprocessing and recognition are integrated closely. Experiments show that this approach can make system performance very good and robust to environmental noise
A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Haiqing Ren,Weiqiang Wang,Xiwen Qu,Yuanqiang Cai

DOI: https://doi.org/10.1016/j.patrec.2019.10.001

IF: 4.757

2019-01-01

Pattern Recognition Letters

Abstract:The recurrent neural network (RNN) is appropriate for dealing with temporal sequences. In this paper, we present a deep RNN with new features and apply it for online handwritten Chinese character recognition. Compared with the existing RNN models, three innovations are involved in the proposed system. First, a new hidden layer function for RNN is proposed for learning temporal information better. we call it Memory Pool Unit (MPU). The proposed MPU has a simple architecture. Second, a new RNN architecture with hybrid parameter is presented, in order to increasing the expression capacity of RNN. The proposed hybrid-parameter RNN has parameter changes when calculating the iteration at temporal dimension. Third, we make a adaptation that all the outputs of each layer are stacked as the output of network. Stacked hidden layer states combine all the hidden layer states for increasing the expression capacity. Experiments are carried out on the IAHCC-UCAS2016 dataset and the CASIA-OLHWDB1.1 dataset. The experimental results show that the hybrid-parameter RNN obtain a better recognition performance with higher efficiency (fewer parameters and faster speed). And the proposed Memory Pool Unit is proved to be a simple hidden layer function and obtains a competitive recognition results.
Handwritten character recognition with sequential convolutional neural network

Caihua Liu,Jie Liu,Fang Yu,Yalou Huang,Jimeng Chen

DOI: https://doi.org/10.1109/ICMLC.2013.6890483

2013-01-01

Abstract:Handwritten character recognition has been an active and challenging research problem, due to the large variations of characters and the dependency relationship between characters. Most of traditional methods rarely consider these two challenges simultaneously. This paper proposes a sequential convolutional neural network(CNN) to solve this problem. It considers handwritten words as image sequences and each node of the sequence is an image of a character. A particularly modified convolutional neural network is firstly employed as a trainable feature extractor to extract low-dimensional, linear separable, translationally invariant features. Furthermore, a sequential model, modified conditional random field(CRF), is utilized to model the dependency between characters. Benefiting from the invariant feature learning ability of CNN and structured prediction ability of CRF, the proposed approach boosts the performance over the standard CRF a large margin. Comparing with the state-of-the-art models, our method achieves a better or comparable performance.
Beyond Human Recognition: A CNN-based Framework for Handwritten Character Recognition

Li Chen,Song Wang,Wei Fan,Jun Sun,Satoshi Naoi

DOI: https://doi.org/10.1109/acpr.2015.7486592

2015-01-01

Abstract:Because of the various appearance (different writers, writing styles, noise, etc.), the handwritten character recognition is one of the most challenging task in pattern recognition. Through decades of research, the traditional method has reached its limit while the emergence of deep learning provides a new way to break this limit. In this paper, a CNN-based handwritten character recognition framework is proposed. In this framework, proper sample generation, training scheme and CNN network structure are employed according to the properties of handwritten characters. In the experiments, the proposed framework performed even better than human on handwritten digit (MNIST) and Chinese character (CASIA) recognition. The advantage of this framework is proved by these experimental results.
Multilayer Self-Organizing Impulse Neural Network for Handwritten Digit Recognition

Hongzhou Chen,Bin Hu,Long Chen,Dingxue Zhang,Zhihong Guan

DOI: https://doi.org/10.1109/ddcls52934.2021.9455541

2021-01-01

Abstract:This paper proposes a multi-layer self-organizing impulse neural network. By adding an improved lateral inhibition mechanism and neuron model, the novel network can extract more information from the pictures, thus improving the expressive ability and elevating the recognition accuracy of the classification model. Besides, we replace the topology of the excitation layer and the inhibition layer with a recurrent connection structure. Several experiments have been carried out based on the proposed neural network and proved that the network can well complete the task of handwritten digit recognition. By tuning the network parameters, the recognition accuracy can reach 92.8%, which is at a high level in the same type of network. Besides, we also verified the robust performance of the network by randomly reducing the number of synapses and the number of neurons. It turns out that the network can still achieve high recognition accuracy after randomly discarding some neurons or synapses.
A New Algorithm For Handwritten Character Recognition

Xy Zhu,Yf Shi

DOI: https://doi.org/10.1109/ICIP.2001.959250

2001-01-01

Abstract:In this paper, a new algorithm of handwritten character recognition based on feedback theory is proposed. We suggest this new method by adding confidence back-propagation and input modification on the Neural Network model, thus preprocessing and recognition are integrated closely. Convergence of the algorithm is proved. Experiments show that it greatly reduced the system's error rate and was robust to environmental noise.
Refocus attention span networks for handwriting line recognition

Mohammed Hamdan,Himanshu Chaudhary,Ahmed Bali,Mohamed Cheriet

DOI: https://doi.org/10.1007/s10032-022-00422-7

2022-12-26

International Journal on Document Analysis and Recognition

Abstract:Recurrent neural networks have achieved outstanding recognition performance for handwriting identification despite the enormous variety observed across diverse handwriting structures and poor-quality scanned documents. We initially proposed a BiLSTM baseline model with a sequential architecture well-suited for modeling text lines due to its ability to learn probability distributions over character or word sequences. However, employing such recurrent paradigms prevents parallelization and suffers from vanishing gradients for long sequences during training. To alleviate these limitations, we propose four significant contributions to this work. First, we devised an end-to-end model composed of a split-attention CNN-backbone that serves as a feature extraction method and a self-attention Transformer encoder–decoder that serves as a transcriber method to recognize handwriting manuscripts. The multi-head self-attention layers in an encoder–decoder transformer-based enhance the model's ability to tackle handwriting recognition and learn the linguistic dependencies of character sequences. Second, we conduct various studies on transfer learning (TL) from large datasets to a small database, determining which model layers require fine-tuning. Third, we attained an efficient paradigm by combining different strategies of TL with data augmentation (DA). Finally, since the robustness of the proposed model is lexicon-free and can recognize sentences not presented in the training phase, the model is only trained on a few labeled examples with no extra cost of generating and training on synthetic datasets. We recorded comparable and outperformed Character and Word Error Rates CER/WER on four benchmark datasets to the most recent (SOTA) models.

computer science, artificial intelligence
Application of BP algorithm to handwritten Chinese characters' recognition

左文明,黎绍发,曾宪贵

DOI: https://doi.org/10.3969/j.issn.1000-7024.2003.10.021

2003-01-01

Abstract:To investigate the application of back-propagation algorithm to the recognition of handwritten Chinese characters, the principle of artificial neural network and Back-propagation algorithm are discussed. Then the problems that handwriting Chinese characters' recognition meets are descrlbed and the techniques that it uses are introduced. And handwritten Chinese characters' recognition using BP algorithm in detail is also analyzed. Finally the improvement to BP algorithm is introduced.
A Neural Network Based Classifier for Handwritten Chinese Character Recognition

MR Wu,B Zhang,L Zhang

DOI: https://doi.org/10.1109/icpr.2000.906136

2000-01-01

Abstract:In this paper, a geometrical approach for building neural networks is proposed. With the proposed approach, it is very easy to construct an efficient neural classifier to solve the handwritten Chinese character recognition problem, as well as other pattern recognition problems of large scale. Experiments are conducted to evaluate the performance of the proposed approach and results obtained are promising
Drawing and Recognizing Chinese Characters with Recurrent Neural Network

Xu-Yao Zhang,Fei Yin,Yan-Ming Zhang,Cheng-Lin Liu,Yoshua Bengio

DOI: https://doi.org/10.1109/tpami.2017.2695539

IF: 23.6

2018-04-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten Chinese characters. However, recognition is only one aspect for understanding a language, another challenging and interesting task is to teach a machine to automatically write (pictographic) Chinese characters. In this paper, we propose a framework by using the recurrent neural network (RNN) as both a discriminative model for recognizing Chinese characters and a generative model for drawing (generating) Chinese characters. To recognize Chinese characters, previous methods usually adopt the convolutional neural network (CNN) models which require transforming the online handwriting trajectory into image-like representations. Instead, our RNN based approach is an end-to-end system which directly deals with the sequential structure and does not require any domain-specific knowledge. With the RNN system (combining an LSTM and GRU), state-of-the-art performance can be achieved on the ICDAR-2013 competition database. Furthermore, under the RNN framework, a conditional generative model with character embedding is proposed for automatically drawing recognizable Chinese characters. The generated characters (in vector format) are human-readable and also can be recognized by the discriminative RNN model with high accuracy. Experimental results verify the effectiveness of using RNNs as both generative and discriminative models for the tasks of drawing and recognizing Chinese characters.

computer science, artificial intelligence,engineering, electrical & electronic
Intelligent character recognition using fully convolutional neural networks

Raymond Ptucha,Felipe Petroski Such,Suhas Pillai,Frank Brockler,Vatsala Singh,Paul Hutkowski

DOI: https://doi.org/10.1016/j.patcog.2018.12.017

IF: 8

2019-04-01

Pattern Recognition

Abstract:The recognition of handwritten text is challenging as there are virtually infinite ways a human can write the same message. Deep learning approaches for handwriting analysis have recently demonstrated breakthrough performance using both lexicon-based architectures and recurrent neural networks. This paper presents a fully convolutional network architecture which outputs arbitrary length symbol streams from handwritten text. A preprocessing step normalizes input blocks to a canonical representation which negates the need for costly recurrent symbol alignment correction. When a lexicon is known, we further introduce a probabilistic character error rate to correct errant word blocks. Our multi-state convolutional method is the first to demonstrate state-of-the-art results on both lexicon-based and arbitrary symbol based handwriting recognition benchmarks.

computer science, artificial intelligence,engineering, electrical & electronic
Online Chinese Handwriting Recognition with Time Sequence Information

Zeyu Wang,Yue Gao,Jinshi Yao,Tao Li

DOI: https://doi.org/10.1109/isass.2019.8757774

2019-01-01

Abstract:Handwriting recognition has been a heated topic over years. Due to the development of deep learning, a lot of research has been done to apply convolutional neural network (CNN) model to this task, which have achieved outstanding accuracy. Instead of focusing merely on CNN models, this article takes the features of Chinese handwritten character into consideration and manages to extract the information of the stroke order of the online handwriting recognition. To achieve this, two methods are proposed: (1) Design a two-branch model combining CNN and recurrent neural network (RNN);(2) Give a new channel division strategy. Also, the task of advanced prediction of the character which little research has been worked on is the key point. With the information of stroke order and some data augmentation strategy, methods proposed have achieved satisfying results.
Handwritten Digit String Recognition by Combination of Residual Network and RNN-CTC.

Hongjian Zhan,Qingqing Wang,Yue Lu

DOI: https://doi.org/10.1007/978-3-319-70136-3_62

2017-01-01

Abstract:Recurrent neural network (RNN) and connectionist temporal classification (CTC) have showed successes in many sequence labeling tasks with the strong ability of dealing with the problems where the alignment between the inputs and the target labels is unknown. Residual network is a new structure of convolutional neural network and works well in various computer vision tasks. In this paper, we take advantage of the architectures mentioned above to create a new network for handwritten digit string recognition. First we design a residual network to extract features from input images, then we employ a RNN to model the contextual information within feature sequences and predict recognition results. At the top of this network, a standard CTC is applied to calculate the loss and yield the final results. These three parts compose an end-to-end trainable network. The proposed new architecture achieves the highest performances on ORAND-CAR-A and ORAND-CAR-B with recognition rates 89.75% and 91.14%, respectively. In addition, the experiments on a generated captcha dataset which has much longer string length show the potential of the proposed network to handle long strings.
Research on Handwritten Chinese Character Recognition Based on BP Neural Network

Zihao Ning

DOI: https://doi.org/10.26549/met.v6i1.11359

2022-06-23

Modern Electronic Technology

Abstract:The application of pattern recognition technology enables us to solve various human-computer interaction problems that were difficult to solve before. Handwritten Chinese character recognition, as a hot research object in image pattern recognition, has many applications in people’s daily life, and more and more scholars are beginning to study off-line handwritten Chinese character recognition. This paper mainly studies the recognition of handwritten Chinese characters by BP (Back Propagation) neural network. Establish a handwritten Chinese character recognition model based on BP neural network, and then verify the accuracy and feasibility of the neural network through GUI (Graphical User Interface) model established by Matlab. This paper mainly includes the following aspects: Firstly, the preprocessing process of handwritten Chinese character recognition in this paper is analyzed. Among them, image preprocessing mainly includes six processes: graying, binarization, smoothing and denoising, character segmentation, histogram equalization and normalization. Secondly, through the comparative selection of feature extraction methods for handwritten Chinese characters, and through the comparative analysis of the results of three different feature extraction methods, the most suitable feature extraction method for this paper is found. Finally, it is the application of BP neural network in handwritten Chinese character recognition. The establishment, training process and parameter selection of BP neural network are described in detail. The simulation software platform chosen in this paper is Matlab, and the sample images are used to train BP neural network to verify the feasibility of Chinese character recognition. Design the GUI interface of human-computer interaction based on Matlab, show the process and results of handwritten Chinese character recognition, and analyze the experimental results.
HNR based on autoencoder feature extraction and resilient back propagation

Fang-fang JIANG,Ming-yi HE,Xin-xin WANG

DOI: https://doi.org/10.16652/j.issn.1004-373x.2014.10.036

2014-01-01

Abstract:As the autoencoder algorithm for input feature extraction is better in discovering the correlation between sam-ples,an new approach is proposed for handwriting number recognition(HNR),in which the autoencoder algorithm is taken to extract the feature under recognition as the input of multilayer feedforward network,resilient back propagation(BP)algorithm is emplored to train the classifer,and some saples chosen from MNIST handwriting digits database are used to test the performance of this new approach. A comprehensive comparisons between this new approach and the pixel-by-pixel method is coducted in cor-rect rate,rejection rate,error rate and reliability rate. This study results show that the proposed new approach(the autoencoder feature extraction,multilayer feedforward neural network classifier and resilient back propagation training algorithm are used to-gether)has faster training speed and higher recognition reliability.

Handwritten Character Recognition by Extended Loop Neural Networks

Off-line Chinese Handwriting Recognition Using Multi-Stage Neural Network Architecture

An Effective Result-Feedback Neural Algorithm for Handwritten Character Recognition

The Optical Character Recognition Technique Based On Computer Vision And Neural Network

Handwritten Character Recognition Based on Hybrid Neural Networks

Handwriting Verification Using Wavelet Transform and Neural Network Ensemble

A Handwritten Character Recognition Method with ANN Feedback.

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Handwritten character recognition with sequential convolutional neural network

Beyond Human Recognition: A CNN-based Framework for Handwritten Character Recognition

Multilayer Self-Organizing Impulse Neural Network for Handwritten Digit Recognition

A New Algorithm For Handwritten Character Recognition

Refocus attention span networks for handwriting line recognition

Application of BP algorithm to handwritten Chinese characters' recognition

A Neural Network Based Classifier for Handwritten Chinese Character Recognition

Drawing and Recognizing Chinese Characters with Recurrent Neural Network

Intelligent character recognition using fully convolutional neural networks

Online Chinese Handwriting Recognition with Time Sequence Information

Handwritten Digit String Recognition by Combination of Residual Network and RNN-CTC.

Research on Handwritten Chinese Character Recognition Based on BP Neural Network

HNR based on autoencoder feature extraction and resilient back propagation