Method for Visualizing Filaments in Axoplasm by Electron Microscopy.

E. Bearer,J. Liu,A. Hsu,T. Reese

DOI: https://doi.org/10.1086/BBLv191n2p272

1996-10-01

Abstract:

What problem does this paper attempt to address?

SmartHandwriting: Handwritten Chinese Character Recognition with Smartwatch.

Jian Zhang,Hongliang Bi,Yanjiao Chen,Mingyu Wang,Liming Han,Ligan Cai

DOI: https://doi.org/10.1109/jiot.2019.2947448

IF: 10.6

2019-01-01

IEEE Internet of Things Journal

Abstract:Most existing systems use portable devices or image processing techniques for handwritten Chinese character recognition (HCCR), which are unable to detect character when writing on a paper or sensitive to lighting conditions. In this article, we present the design, implementation, and evaluation of a smartwatch-based HCCR system, called SmartHandwriting. To segment each Chinese character, we further analyze the hand movement between the handwriting gesture and the wrist movement gesture and propose a novel algorithm to distinguish the two types of gestures. Due to too many Chinese characters for classification, we utilize the data augmentation method for avoiding overfitting. Then, we build the HCCR model using the deep convolutional neural network (DCNN) method. The recognition accuracy of the Chinese characters is 96.0%, and extensive experiments confirm its effectiveness and robustness. Moreover, we also explore adverse factors that affect the recognition performance, which can be avoided in the future.
Fully Convolutional Recurrent Network for Handwritten Chinese Text Recognition

Zecheng Xie,Zenghui Sun,Lianwen Jin,Ziyong Feng,Shuye Zhang

DOI: https://doi.org/10.48550/arXiv.1604.04953

2016-04-18

Abstract:This paper proposes an end-to-end framework, namely fully convolutional recurrent network (FCRN) for handwritten Chinese text recognition (HCTR). Unlike traditional methods that rely heavily on segmentation, our FCRN is trained with online text data directly and learns to associate the pen-tip trajectory with a sequence of characters. FCRN consists of four parts: a path-signature layer to extract signature features from the input pen-tip trajectory, a fully convolutional network to learn informative representation, a sequence modeling layer to make per-frame predictions on the input sequence and a transcription layer to translate the predictions into a label sequence. The FCRN is end-to-end trainable in contrast to conventional methods whose components are separately trained and tuned. We also present a refined beam search method that efficiently integrates the language model to decode the FCRN and significantly improve the recognition results. We evaluate the performance of the proposed method on the test sets from the databases CASIA-OLHWDB and ICDAR 2013 Chinese handwriting recognition competition, and both achieve state-of-the-art performance with correct rates of 96.40% and 95.00%, respectively.

Computer Vision and Pattern Recognition
Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approach

Dezhi Peng,Lianwen Jin,Weihong Ma,Canyu Xie,Hesuo Zhang,Shenggao Zhu,Jing Li

DOI: https://doi.org/10.1109/TMM.2022.3146771

2022-07-30

Abstract:Online and offline handwritten Chinese text recognition (HTCR) has been studied for decades. Early methods adopted oversegmentation-based strategies but suffered from low speed, insufficient accuracy, and high cost of character segmentation annotations. Recently, segmentation-free methods based on connectionist temporal classification (CTC) and attention mechanism, have dominated the field of HCTR. However, people actually read text character by character, especially for ideograms such as Chinese. This raises the question: are segmentation-free strategies really the best solution to HCTR? To explore this issue, we propose a new segmentation-based method for recognizing handwritten Chinese text that is implemented using a simple yet efficient fully convolutional network. A novel weakly supervised learning method is proposed to enable the network to be trained using only transcript annotations; thus, the expensive character segmentation annotations required by previous segmentation-based methods can be avoided. Owing to the lack of context modeling in fully convolutional networks, we propose a contextual regularization method to integrate contextual information into the network during the training stage, which can further improve the recognition performance. Extensive experiments conducted on four widely used benchmarks, namely CASIA-HWDB, CASIA-OLHWDB, ICDAR2013, and SCUT-HCCDoc, show that our method significantly surpasses existing methods on both online and offline HCTR, and exhibits a considerably higher inference speed than CTC/attention-based approaches.

Computer Vision and Pattern Recognition
End-to-end attention convolutional recurrent network for online handwritten Chinese text recognition

Xiwen Qu,Zhihong Wu,Jun Huang

DOI: https://doi.org/10.1007/s11042-023-17987-y

IF: 2.577

2024-01-07

Multimedia Tools and Applications

Abstract:Online handwritten Chinese text recognition (OHCTR) has been a challenging problem due to the large character set, diverse writing styles and variable text line length. The existing convolutional recurrent network (CNN) architectures have achieved greatly success in OHCTR, but they need to convert chronological sequence coordinates into image-like representations or vectors, which will lead to information loss and increase time consumption. To avoid the conversion process, we propose a novel end-to-end attention convolutional recurrent network (EACRN) for OHCTR in this paper. Specifically, The EACRN directly extract local contextual features from raw chronological sequence coordinates using end-to-end CNN. After that, bidirectional long short-term memory (BiLSTM) is employed to capture long-term dependencies of local contextual features. Then multi-head attention is utilized to weight local contextual features. Finally, focal connectionist temporal classification (CTC) objective function is introduced into OHCTR by us to increase attention to low-frequency characters in text and makes predictions. Experiments on two publicly datasets, standard benchmarks dataset CASIA-OLHWDB2.0-2.2 and in-air handwritten Chinese text dataset IAHCT-UCAS2018, demonstrate that our method obtains higher recognition accuracy with faster computation speed and more compact model compared with previous CNN architectures.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Haiqing Ren,Weiqiang Wang,Xiwen Qu,Yuanqiang Cai

DOI: https://doi.org/10.1016/j.patrec.2019.10.001

IF: 4.757

2019-01-01

Pattern Recognition Letters

Abstract:The recurrent neural network (RNN) is appropriate for dealing with temporal sequences. In this paper, we present a deep RNN with new features and apply it for online handwritten Chinese character recognition. Compared with the existing RNN models, three innovations are involved in the proposed system. First, a new hidden layer function for RNN is proposed for learning temporal information better. we call it Memory Pool Unit (MPU). The proposed MPU has a simple architecture. Second, a new RNN architecture with hybrid parameter is presented, in order to increasing the expression capacity of RNN. The proposed hybrid-parameter RNN has parameter changes when calculating the iteration at temporal dimension. Third, we make a adaptation that all the outputs of each layer are stacked as the output of network. Stacked hidden layer states combine all the hidden layer states for increasing the expression capacity. Experiments are carried out on the IAHCC-UCAS2016 dataset and the CASIA-OLHWDB1.1 dataset. The experimental results show that the hybrid-parameter RNN obtain a better recognition performance with higher efficiency (fewer parameters and faster speed). And the proposed Memory Pool Unit is proved to be a simple hidden layer function and obtains a competitive recognition results.
Sentence-level Online Handwritten Chinese Character Recognition

Yunxin Li,Qian Yang,Qingcai Chen,Lin Ma,Baotian Hu,Xiaolong Wang,Yuxin Ding

DOI: https://doi.org/10.48550/arXiv.2108.02561

2021-07-04

Abstract:Single online handwritten Chinese character recognition~(single OLHCCR) has achieved prominent performance. However, in real application scenarios, users always write multiple Chinese characters to form one complete sentence and the contextual information within these characters holds the significant potential to improve the accuracy, robustness and efficiency of sentence-level OLHCCR. In this work, we first propose a simple and straightforward end-to-end network, namely vanilla compositional network~(VCN) to tackle the sentence-level OLHCCR. It couples convolutional neural network with sequence modeling architecture to exploit the handwritten character's previous contextual information. Although VCN performs much better than the state-of-the-art single OLHCCR model, it exposes high fragility when confronting with not well written characters such as sloppy writing, missing or broken strokes. To improve the robustness of sentence-level OLHCCR, we further propose a novel deep spatial-temporal fusion network~(DSTFN). It utilizes a pre-trained autoregresssive framework as the backbone component, which projects each Chinese character into word embeddings, and integrates the spatial glyph features of handwritten characters and their contextual information multiple times at multi-layer fusion module. We also construct a large-scale sentence-level handwriting dataset, named as CSOHD to evaluate models. Extensive experiment results demonstrate that DSTFN achieves the state-of-the-art performance, which presents strong robustness compared with VCN and exiting single OLHCCR models. The in-depth empirical analysis and case studies indicate that DSTFN can significantly improve the efficiency of handwriting input, with the handwritten Chinese character with incomplete strokes being recognized precisely.

Computer Vision and Pattern Recognition,Computation and Language
Offline Handwritten Chinese Text Recognition with Convolutional Neural Networks

Brian Liu,Xianchao Xu,Yu Zhang

DOI: https://doi.org/10.48550/arXiv.2006.15619

2020-06-28

Computer Vision and Pattern Recognition

Abstract:Deep learning based methods have been dominating the text recognition tasks in different and multilingual scenarios. The offline handwritten Chinese text recognition (HCTR) is one of the most challenging tasks because it involves thousands of characters, variant writing styles and complex data collection process. Recently, the recurrent-free architectures for text recognition appears to be competitive as its highly parallelism and comparable results. In this paper, we build the models using only the convolutional neural networks and use CTC as the loss function. To reduce the overfitting, we apply dropout after each max-pooling layer and with extreme high rate on the last one before the linear layer. The CASIA-HWDB database is selected to tune and evaluate the proposed models. With the existing text samples as templates, we randomly choose isolated character samples to synthesis more text samples for training. We finally achieve 6.81% character error rate (CER) on the ICDAR 2013 competition set, which is the best published result without language model correction.
Improved Deep Convolutional Neural Network For Online Handwritten Chinese Character Recognition using Domain-Specific Knowledge

Weixin Yang,Lianwen Jin,Zecheng Xie,Ziyong Feng

DOI: https://doi.org/10.48550/arXiv.1505.07675

2015-05-28

Abstract:Deep convolutional neural networks (DCNNs) have achieved great success in various computer vision and pattern recognition applications, including those for handwritten Chinese character recognition (HCCR). However, most current DCNN-based HCCR approaches treat the handwritten sample simply as an image bitmap, ignoring some vital domain-specific information that may be useful but that cannot be learnt by traditional networks. In this paper, we propose an enhancement of the DCNN approach to online HCCR by incorporating a variety of domain-specific knowledge, including deformation, non-linear normalization, imaginary strokes, path signature, and 8-directional features. Our contribution is twofold. First, these domain-specific technologies are investigated and integrated with a DCNN to form a composite network to achieve improved performance. Second, the resulting DCNNs with diversity in their domain knowledge are combined using a hybrid serial-parallel (HSP) strategy. Consequently, we achieve a promising accuracy of 97.20% and 96.87% on CASIA-OLHWDB1.0 and CASIA-OLHWDB1.1, respectively, outperforming the best results previously reported in the literature.

Computer Vision and Pattern Recognition
A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

Yintong Wang,Yingjie Yang,Weiping Ding,Shuo Li

DOI: https://doi.org/10.1109/access.2021.3115606

IF: 3.9

2021-01-01

IEEE Access

Abstract:Offline handwritten Chinese text recognition is one of the most challenging tasks in that it involves various writing styles, complex character-touching, and large number of character categories. In this paper, we propose a residual-attention offline handwritten Chinese text recognition based on fully convolutional neural networks, which is segmentation-free handwritten recognition that avoids the impact of incorrect character segmentation. By designing a smart residual attention gate block, our model can help to extract important features, and effectively implement the training of deep convolutional neural networks. Furthermore, we deploy an expansion factor to indicate the trade-off between computing resources for model training and the ability of a gradient to propagate across multiple layers, and make our model training adapt to different computing platforms. Experiments on the CASIA-HWDB and ICDAR-2013 competition dataset show that our method achieves a competitive performance on offline handwritten Chinese text recognition. On the CASIA-HWDB test set, the character-level accurate rate and correct rate achieve 97.32% and 97.90% respectively.
Stroke Sequence-Dependent Deep Convolutional Neural Network for Online Handwritten Chinese Character Recognition

Xin Liu,Baotian Hu,Qingcai Chen,Xiangping Wu,Jinghan You

DOI: https://doi.org/10.1109/tnnls.2019.2956965

IF: 14.255

2020-11-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:We propose a novel model, called stroke sequence-dependent deep convolutional neural network (SSDCNN), which uses the stroke sequence information and eight-directional features of Chinese characters for online handwritten Chinese character recognition (OLHCCR). SSDCNN learns the representation of OLHCCs by incorporating the natural sequence information of the strokes. Furthermore, it naturally incorporates the eight-directional features. First, SSDCNN inputs the stroke sequence and transforms it into stacks of feature maps following the writing order of the strokes. Second, the fixed-length, stroke sequence-dependent representations of OLHCC are derived through convolutional, residual, and max-pooling operations. Third, the stroke sequence-dependent representation is combined with the eight-directional features via a number of fully connected neural network layers. Finally, the Chinese characters are recognized using a softmax classifier. The SSDCNN is trained in two stages: 1) the whole architecture is pretrained using the training data until the performance converges to an acceptable degree. 2) The stroke sequence-dependent representation is combined with the eight-directional features by a fully connected neural network and a softmax layer for further training. The model was experimentally evaluated on the OLHCCR competition tasks of International Conference on Document Analysis and Recognition (ICDAR) 2013. The recognition error was a maximum 58.28% lower in SSDCNN than in a model using the eight-directional features alone (5.13% versus 2.14%). Owing to its high accuracy (97.86%), the proposed SSDCNN reduced the recognition error by approximately 18.0% as compared with that of the winning system in the ICDAR 2013 competition. SSDCNN integrated with an adaptation mechanism, called the SSDCNN+Adapt model, and reached a new state-of-the-art (SOTA) stan-ard with an accuracy of 97.94%. The SSDCNN exploits the stroke sequence information to learn high-quality OLHCC representations. Moreover, the learned representation and the classical eight-directional features complement each other within the SSDCNN architecture.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Zi-Rui Wang,Jun Du,Wen-Chao Wang,Jian-Fang Zhai,Jin-Shui Hu

DOI: https://doi.org/10.1007/s10032-018-0307-0

2018-01-01

International Journal on Document Analysis and Recognition

Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.
Online Chinese Handwriting Recognition with Time Sequence Information

Zeyu Wang,Yue Gao,Jinshi Yao,Tao Li

DOI: https://doi.org/10.1109/isass.2019.8757774

2019-01-01

Abstract:Handwriting recognition has been a heated topic over years. Due to the development of deep learning, a lot of research has been done to apply convolutional neural network (CNN) model to this task, which have achieved outstanding accuracy. Instead of focusing merely on CNN models, this article takes the features of Chinese handwritten character into consideration and manages to extract the information of the stroke order of the online handwriting recognition. To achieve this, two methods are proposed: (1) Design a two-branch model combining CNN and recurrent neural network (RNN);(2) Give a new channel division strategy. Also, the task of advanced prediction of the character which little research has been worked on is the key point. With the information of stroke order and some data augmentation strategy, methods proposed have achieved satisfying results.
Characters as Graphs: Recognizing Online Handwritten Chinese Characters via Spatial Graph Convolutional Network

Ji Gan,Weiqiang Wang,Ke Lu

DOI: https://doi.org/10.48550/arXiv.2004.09412

2020-04-21

Abstract:Chinese is one of the most widely used languages in the world, yet online handwritten Chinese character recognition (OLHCCR) remains challenging. To recognize Chinese characters, one popular choice is to adopt the 2D convolutional neural network (2D-CNN) on the extracted feature images, and another one is to employ the recurrent neural network (RNN) or 1D-CNN on the time-series features. Instead of viewing characters as either static images or temporal trajectories, here we propose to represent characters as geometric graphs, retaining both spatial structures and temporal orders. Accordingly, we propose a novel spatial graph convolution network (SGCN) to effectively classify those character graphs for the first time. Specifically, our SGCN incorporates the local neighbourhood information via spatial graph convolutions and further learns the global shape properties with a hierarchical residual structure. Experiments on IAHCC-UCAS2016, ICDAR-2013, and UNIPEN datasets demonstrate that the SGCN can achieve comparable recognition performance with the state-of-the-art methods for character recognition.

Computer Vision and Pattern Recognition
CCRS: Web Service for Chinese Character Recognition

Hang Zhuang,Changlong Li,Xuehai Zhou

DOI: https://doi.org/10.1109/icws.2018.00010

2018-01-01

Abstract:Handwritten Chinese character recognition (HCCR) is an important research field of pattern recognition, which has attracted extensive studies during the past decades. Recently convolutional neural network (CNN) based methods have achieved the state-of-the-art performance for handwritten Chinese character recognition. Nevertheless, handwritten Chinese character recognition is still limited to be effectively used in the actual environment due to the large-scale vocabulary and great diversity of handwriting style. In this paper, we constructed a handwritten Chinese character recognition service based on convolutional neural network, which tries to make effective use of handwritten based printed fonts and existing handwritten database. At the same time, the service can effectively collect more handwritten data to expand the training dataset, which makes it easy to adapt to the new handwriting styles. Meanwhile, We propose a multi-level recognition theory applied to online handwritten Chinese character recognition, which may improve the accuracy of handwritten Chinese character recognition and break the limitations of handwritten Chinese character recognition by identifying the structure of Chinese characters and possible stroke orders firstly. Furthermore, we try to apply the method of online character recognition to the offline character recognition based on the basic writing rules.
Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Zi-Rui Wang,Jun Du,Jin-Shui Hu,Yu-Long Hu

DOI: https://doi.org/10.1109/acpr.2017.65

2017-01-01

Abstract:This paper proposes a novel segmentation-free approach using deep neural network based hidden Markov model (DNN-HMM) for offline handwritten Chinese text recognition. In the general Bayesian framework, three key issues are comprehensively investigated, namely feature extraction, character modeling, and language modeling. First, as for the feature extraction on the basis of each frame or sliding window, the gradient-based features are extracted for the DNN-based classifier. Second, the text line is sequentially modeled by HMMs with each representing one character class. Meanwhile the DNNbased classifier is adopted to calculate the posterior probability of all HMM states. Finally, the character n-gram language model is integrated with the DNN-HMM character model for the Bayesian decision. The experiments on the ICDAR 2013 competition task of CASIA-HWDB database show that the proposed approach can achieve the best published recognition results to our knowledge, yielding a character error rate (CER) of 6.50%, which significantly outperforms the previously best reported oversegmentation approach (with a CER of 9.25%) and the segmentation- free approach using multidimensional longshort term memory recurrent neural network (MDLSTM-RNN) approach (with a CER of 10.6%).
Trajectory-based Radical Analysis Network for Online Handwritten Chinese Character Recognition

Jianshu Zhang,Yixing Zhu,Jun Du,Lirong Dai

DOI: https://doi.org/10.48550/arXiv.1801.10109

2018-01-22

Abstract:Recently, great progress has been made for online handwritten Chinese character recognition due to the emergence of deep learning techniques. However, previous research mostly treated each Chinese character as one class without explicitly considering its inherent structure, namely the radical components with complicated geometry. In this study, we propose a novel trajectory-based radical analysis network (TRAN) to firstly identify radicals and analyze two-dimensional structures among radicals simultaneously, then recognize Chinese characters by generating captions of them based on the analysis of their internal radicals. The proposed TRAN employs recurrent neural networks (RNNs) as both an encoder and a decoder. The RNN encoder makes full use of online information by directly transforming handwriting trajectory into high-level features. The RNN decoder aims at generating the caption by detecting radicals and spatial structures through an attention model. The manner of treating a Chinese character as a two-dimensional composition of radicals can reduce the size of vocabulary and enable TRAN to possess the capability of recognizing unseen Chinese character classes, only if the corresponding radicals have been seen. Evaluated on CASIA-OLHWDB database, the proposed approach significantly outperforms the state-of-the-art whole-character modeling approach with a relative character error rate (CER) reduction of 10%. Meanwhile, for the case of recognition of 500 unseen Chinese characters, TRAN can achieve a character accuracy of about 60% while the traditional whole-character method has no capability to handle them.

Computer Vision and Pattern Recognition
PageNet: Towards End-to-End Weakly Supervised Page-Level Handwritten Chinese Text Recognition

Dezhi Peng,Lianwen Jin,Yuliang Liu,Canjie Luo,Songxuan Lai

DOI: https://doi.org/10.48550/arXiv.2207.14807

2022-07-30

Abstract:Handwritten Chinese text recognition (HCTR) has been an active research topic for decades. However, most previous studies solely focus on the recognition of cropped text line images, ignoring the error caused by text line detection in real-world applications. Although some approaches aimed at page-level text recognition have been proposed in recent years, they either are limited to simple layouts or require very detailed annotations including expensive line-level and even character-level bounding boxes. To this end, we propose PageNet for end-to-end weakly supervised page-level HCTR. PageNet detects and recognizes characters and predicts the reading order between them, which is more robust and flexible when dealing with complex layouts including multi-directional and curved text lines. Utilizing the proposed weakly supervised learning framework, PageNet requires only transcripts to be annotated for real data; however, it can still output detection and recognition results at both the character and line levels, avoiding the labor and cost of labeling bounding boxes of characters and text lines. Extensive experiments conducted on five datasets demonstrate the superiority of PageNet over existing weakly supervised and fully supervised page-level methods. These experimental results may spark further research beyond the realms of existing methods based on connectionist temporal classification or attention. The source code is available at <a class="link-external link-https" href="https://github.com/shannanyinxiang/PageNet" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Offline Handwritten Chinese Character Using Convolutional Neural Network: State-of-the-Art Methods

Yingna Zhong,Kauthar Mohd Daud,Ain Najiha Binti Mohamad Nor,Richard Adeyemi Ikuesan,Kohbalan Moorthy

DOI: https://doi.org/10.20965/jaciii.2023.p0567

2023-07-20

Journal of Advanced Computational Intelligence and Intelligent Informatics

Abstract:Given the presence of handwritten documents in human transactions, including email sorting, bank checks, and automating procedures, handwritten characters recognition (HCR) of documents has been invaluable to society. Handwritten Chinese characters (HCC) can be divided into offline and online categories. Online HCC recognition (HCCR) involves the trajectory movement of the pen tip for expressing linguistic content. In contrast, offline HCCR involves analyzing and categorizing the sample binary or grayscale images of characters. As recognition technology develops, academics’ interest in Chinese character recognition has continuously increased, as it significantly affects social and economic development. Recent development in this area is promising. However, the recognition accuracy of offline HCCR is still a sophisticated challenge owing to their complexity and variety of writing styles. With the advancement of deep learning, convolutional neural network (CNN)-based algorithms have demonstrated distinct benefits in offline HCCR and have achieved outstanding results. In this review, we aim to show the different HCCR methods for tackling the complexity and variability of offline HCC writing styles. This paper also reviews different activation functions used in offline HCCR and provides valuable assistance to new researchers in offline Chinese handwriting recognition by providing a succinct study of various methods for recognizing offline HCC.
A New Hybrid-parameter Recurrent Neural Networks for Online Handwritten Chinese Character Recognition

Haiqing Ren,Weiqiang Wang

DOI: https://doi.org/10.48550/arXiv.1711.02809

2017-11-08

Computer Vision and Pattern Recognition

Abstract:The recurrent neural network (RNN) is appropriate for dealing with temporal sequences. In this paper, we present a deep RNN with new features and apply it for online handwritten Chinese character recognition. Compared with the existing RNN models, three innovations are involved in the proposed system. First, a new hidden layer function for RNN is proposed for learning temporal information better. we call it Memory Pool Unit (MPU). The proposed MPU has a simple architecture. Second, a new RNN architecture with hybrid parameter is presented, in order to increasing the expression capacity of RNN. The proposed hybrid-parameter RNN has parameter changes when calculating the iteration at temporal dimension. Third, we make a adaptation that all the outputs of each layer are stacked as the output of network. Stacked hidden layer states combine all the hidden layer states for increasing the expression capacity. Experiments are carried out on the IAHCC-UCAS2016 dataset and the CASIA-OLHWDB1.1 dataset. The experimental results show that the hybrid-parameter RNN obtain a better recognition performance with higher efficiency (fewer parameters and faster speed). And the proposed Memory Pool Unit is proved to be a simple hidden layer function and obtains a competitive recognition results.
Drawing and Recognizing Chinese Characters with Recurrent Neural Network

Xu-Yao Zhang,Fei Yin,Yan-Ming Zhang,Cheng-Lin Liu,Yoshua Bengio

DOI: https://doi.org/10.1109/tpami.2017.2695539

IF: 23.6

2018-04-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten Chinese characters. However, recognition is only one aspect for understanding a language, another challenging and interesting task is to teach a machine to automatically write (pictographic) Chinese characters. In this paper, we propose a framework by using the recurrent neural network (RNN) as both a discriminative model for recognizing Chinese characters and a generative model for drawing (generating) Chinese characters. To recognize Chinese characters, previous methods usually adopt the convolutional neural network (CNN) models which require transforming the online handwriting trajectory into image-like representations. Instead, our RNN based approach is an end-to-end system which directly deals with the sequential structure and does not require any domain-specific knowledge. With the RNN system (combining an LSTM and GRU), state-of-the-art performance can be achieved on the ICDAR-2013 competition database. Furthermore, under the RNN framework, a conditional generative model with character embedding is proposed for automatically drawing recognizable Chinese characters. The generated characters (in vector format) are human-readable and also can be recognized by the discriminative RNN model with high accuracy. Experimental results verify the effectiveness of using RNNs as both generative and discriminative models for the tasks of drawing and recognizing Chinese characters.

computer science, artificial intelligence,engineering, electrical & electronic

Method for Visualizing Filaments in Axoplasm by Electron Microscopy.

SmartHandwriting: Handwritten Chinese Character Recognition with Smartwatch.

Fully Convolutional Recurrent Network for Handwritten Chinese Text Recognition

Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approach

End-to-end attention convolutional recurrent network for online handwritten Chinese text recognition

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Sentence-level Online Handwritten Chinese Character Recognition

Offline Handwritten Chinese Text Recognition with Convolutional Neural Networks

Improved Deep Convolutional Neural Network For Online Handwritten Chinese Character Recognition using Domain-Specific Knowledge

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

Stroke Sequence-Dependent Deep Convolutional Neural Network for Online Handwritten Chinese Character Recognition

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Online Chinese Handwriting Recognition with Time Sequence Information

Characters as Graphs: Recognizing Online Handwritten Chinese Characters via Spatial Graph Convolutional Network

CCRS: Web Service for Chinese Character Recognition

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Trajectory-based Radical Analysis Network for Online Handwritten Chinese Character Recognition

PageNet: Towards End-to-End Weakly Supervised Page-Level Handwritten Chinese Text Recognition

Offline Handwritten Chinese Character Using Convolutional Neural Network: State-of-the-Art Methods

A New Hybrid-parameter Recurrent Neural Networks for Online Handwritten Chinese Character Recognition

Drawing and Recognizing Chinese Characters with Recurrent Neural Network