Large Scale Neural Networks and Its Application on Recognition of Chinese Character

SW Luo,Z Han

DOI: https://doi.org/10.1109/icosp.1998.770851

1998-01-01

Abstract:In this paper we proposed a method of building neural networks with large scale units using microcomputer clusters. Based on the method we have presented the application to Chinese character recognition

What problem does this paper attempt to address?

Hybrid Neural Networks System for Large Scale Chinese Character Set Recognition.

Mingsheng Zhao,Youshou Wu

DOI: https://doi.org/10.1109/ijcnn.1999.833526

1999-01-01

Abstract:This paper addresses a hybrid neural networks system, “TsingNeu-1”, for large scale printed Chinese character recognition. The system, which consists of three-level structure of neural networks with feedback error control, is a well designed unbalanced hierarchical tree structure with its functional parts working in a cooperative way according to their functions. Feedback error control based on output evaluation has been adopted for improving robustness of the system. Recognition features of the Chinese characters are extracted automatically and adaptively by self-organizing learning in every stage of the recognition processes. The implemented system can recognize 3755 categories of Chinese characters and some common used punctuations with various fonts and sizes. Experimental results show that the whole system is of reasonable size, easy to train and satisfactory performance
A Sphere Neighborhood Covering-Structuring Approach Based on Neural Network and Its Application

叶少珍,郑文波,马少平

DOI: https://doi.org/10.3969/j.issn.1000-2243.2002.03.011

2002-01-01

Abstract:In this paper, a sphere neighborhood covering-structuring approach based on neural network for pattern recognition problem of large scale is introduced. And the method has been used for the typical pattern recognition problem of large scale such as Handwritten Chinese Characters recognition. Compared with these different effects in practical applications, the approach can be used for solving ultimately these problems such as slow training speed and no convergent. And integrated with other method, the approach can also improve the recognition rate and accuracy rate in dealing with pattern recognition problem of large scale. Experiments are conducted to evaluate the performance of the proposed approach. The results are promising and showing the application value in solving pattern recognition problem of large scale.
A Neural Network Based Classifier for Handwritten Chinese Character Recognition

MR Wu,B Zhang,L Zhang

DOI: https://doi.org/10.1109/icpr.2000.906136

2000-01-01

Abstract:In this paper, a geometrical approach for building neural networks is proposed. With the proposed approach, it is very easy to construct an efficient neural classifier to solve the handwritten Chinese character recognition problem, as well as other pattern recognition problems of large scale. Experiments are conducted to evaluate the performance of the proposed approach and results obtained are promising
Chinese Character Recognition Method Based On Multi-Features And Parallel Neural Network Computation

Yanfang Li,Huamin Yang,Jing Xu,Wei He,Jingtao Fan

DOI: https://doi.org/10.1007/978-3-540-74171-8_112

2007-01-01

Abstract:Based on neural network with favorable adaptability to handwritten Chinese character multi-features, in this paper a new method is proposed, using existing multi-features as inputs to structure multi neural network recognition subsystems and these subsystems are integrated with parallel connection mode. The integrated system has the lowest false recognition rate. When using traditional von Neumann architecture computer to implement this system, the system response time is longer as a result of serial computation. This paper introduces a kind of parallel computation method of using pc cluster to implement multi subsystems. It can reduce effectively recognition system's response time.
New clustering method for Chinese characters recognition system using neural networks

Youshou Wu,Ning Xu,Xiaoqing Ding

1994-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:A new clustering method was proposed for a Chinese characters recognition system using ANN. By use of this clustering technique, the large Chinese characters set of 3755 characters can be divided into many small subsets with accuracy higher than 98%.
Large-Scale Printed Chinese Character Recognition for ID Cards Using Deep Learning and Few Samples Transfer Learning

Yi-Quan Li,Hao-Sen Chang,Daw-Tung Lin,Yi-Quan Li,Hao-Sen Chang,Daw-Tung Lin

DOI: https://doi.org/10.20944/preprints202112.0376.v1

2021-12-22

Abstract:In the field of computer vision, large-scale image classification tasks are both important and highly challenging. With the ongoing advances in deep learning and optical character recognition (OCR) technologies, neural networks designed to perform large-scale classification play an essential role in facilitating OCR systems. In this study, we developed an automatic OCR system designed to identify up to 13,070 large-scale printed Chinese characters by using deep learning neural networks and fine-tuning techniques. The proposed framework comprises four components, including training dataset synthesis and background simulation, image preprocessing and data augmentation, the process of training the model, and transfer learning. The training data synthesis procedure is composed of a character font generation step and a background simulation process. Three background models are proposed to simulate the factors of the background noise and anti-counterfeiting patterns on ID cards. To expand the diversity of the synthesized training dataset, rotation and zooming data augmentation are applied. A massive dataset comprising more than 19.6 million images was thus created to accommodate the variations in the input images and improve the learning capacity of the CNN model. Subsequently, we modified the GoogLeNet neural architecture by replacing the FC layer with a global average pooling layer to avoid overfitting caused by a massive amount of training data. Consequently, the number of model parameters was reduced. Finally, we employed the transfer learning technique to further refine the CNN model using a small number of real data samples. Experimental results show that the overall recognition performance of the proposed approach is significantly better than that of prior methods and thus demonstrate the effectiveness of proposed framework, which exhibited a recognition accuracy as high as 99.39% on the constructed real ID card dataset.
Characters as Graphs: Recognizing Online Handwritten Chinese Characters via Spatial Graph Convolutional Network

Ji Gan,Weiqiang Wang,Ke Lu

DOI: https://doi.org/10.48550/arXiv.2004.09412

2020-04-21

Abstract:Chinese is one of the most widely used languages in the world, yet online handwritten Chinese character recognition (OLHCCR) remains challenging. To recognize Chinese characters, one popular choice is to adopt the 2D convolutional neural network (2D-CNN) on the extracted feature images, and another one is to employ the recurrent neural network (RNN) or 1D-CNN on the time-series features. Instead of viewing characters as either static images or temporal trajectories, here we propose to represent characters as geometric graphs, retaining both spatial structures and temporal orders. Accordingly, we propose a novel spatial graph convolution network (SGCN) to effectively classify those character graphs for the first time. Specifically, our SGCN incorporates the local neighbourhood information via spatial graph convolutions and further learns the global shape properties with a hierarchical residual structure. Experiments on IAHCC-UCAS2016, ICDAR-2013, and UNIPEN datasets demonstrate that the SGCN can achieve comparable recognition performance with the state-of-the-art methods for character recognition.

Computer Vision and Pattern Recognition
Chinese Image Character Recognition Using DNN and Machine Simulated Training Samples.

Jinfeng Bai,Zhineng Chen,Bailan Feng,Bo Xu

DOI: https://doi.org/10.1007/978-3-319-11179-7_27

2014-01-01

Abstract:Inspired by the success of deep neural network (DNN) models in solving challenging visual problems, this paper studies the task of Chinese Image Character Recognition (ChnICR) by leveraging DNN model and huge machine simulated training samples. To generate the samples, clean machine born Chinese characters are extracted and are plus with common variations of image characters such as changes in size, font, boldness, shift and complex backgrounds, which in total produces over 28 million character images, covering the vast majority of occurrences of Chinese character in real life images. Based on these samples, a DNN training procedure is employed to learn the appropriate Chinese character recognizer, where the width and depth of DNN, and the volume of samples are empirically discussed. Parallel to this, a holistic Chinese image text recognition system is developed. Encouraging experimental results on text from 13 TV channels demonstrate the effectiveness of the learned recognizer, from which significant performance gains are observed compared to the baseline system.
A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Haiqing Ren,Weiqiang Wang,Xiwen Qu,Yuanqiang Cai

DOI: https://doi.org/10.1016/j.patrec.2019.10.001

IF: 4.757

2019-01-01

Pattern Recognition Letters

Abstract:The recurrent neural network (RNN) is appropriate for dealing with temporal sequences. In this paper, we present a deep RNN with new features and apply it for online handwritten Chinese character recognition. Compared with the existing RNN models, three innovations are involved in the proposed system. First, a new hidden layer function for RNN is proposed for learning temporal information better. we call it Memory Pool Unit (MPU). The proposed MPU has a simple architecture. Second, a new RNN architecture with hybrid parameter is presented, in order to increasing the expression capacity of RNN. The proposed hybrid-parameter RNN has parameter changes when calculating the iteration at temporal dimension. Third, we make a adaptation that all the outputs of each layer are stacked as the output of network. Stacked hidden layer states combine all the hidden layer states for increasing the expression capacity. Experiments are carried out on the IAHCC-UCAS2016 dataset and the CASIA-OLHWDB1.1 dataset. The experimental results show that the hybrid-parameter RNN obtain a better recognition performance with higher efficiency (fewer parameters and faster speed). And the proposed Memory Pool Unit is proved to be a simple hidden layer function and obtains a competitive recognition results.
LCSegNet: An Efficient Semantic Segmentation Network for Large-Scale Complex Chinese Character Recognition

Xiangping Wu,Qingcai Chen,Yulun Xiao,Wei Li,Xin Liu,Baotian Hu

DOI: https://doi.org/10.1109/tmm.2020.3025696

IF: 7.3

2021-01-01

IEEE Transactions on Multimedia

Abstract:Complex scene character recognition is a challenging yet important task in machine learning, especially for languages with large character sets, such as Chinese, which is composed of hieroglyphics with large-scale categories and similar glyphs. Recently, state-of-the-art methods based on semantic segmentation have achieved great success in scene parsing and have been applied in scene text recognition. However, because of limitations in terms of memory and computation, they are only applied in the small category recognition tasks, such as tasks involving English alphabets and digits. In this paper, we propose an efficient semantic segmentation model based on label coding (LC), called LCSegNet, to recognize large-scale Chinese characters. First, to reduce the number of labels, we design a new label coding method based on the Wubi Chinese characters code, called Wubi-CRF. In this method, glyphs and structure information of Chinese characters are encoded into 140-bit labels. Second, we employ an efficient semantic segmentation model for pixel-wise prediction and utilize a conditional random field (CRF) module to learn the constraint rules of Wubi-like coding. Finally, experiments are conducted on three benchmarks: a large Chinese text dataset in the wild (CTW), ICDAR2019-ReCTS, and HIT-OR3C dataset. Results show that the proposed method achieves state-of-the-art performances in both complex scene and handwritten character recognition tasks.
Image Character Recognition Using Deep Convolutional Neural Network Learned from Different Languages

Jinfeng Bai,Zhineng Chen,Bailan Feng,Bo Xu

DOI: https://doi.org/10.1109/icip.2014.7025518

2014-01-01

Abstract:This paper proposes a shared-hidden-layer deep convolutional neural network (SHL-CNN) for image character recognition. In SHL-CNN, the hidden layers are made common across characters from different languages, performing a universal feature extraction process that aims at learning common character traits existed in different languages such as strokes, while the final softmax layer is made language dependent, trained based on characters from the destination language only. This paper is the first attempt to introduce the SHL-CNN framework to image character recognition. Under the SHL-CNN framework, we discuss several issues including architecture of the network, training of the network, from which a suitable SHL-CNN model for image character recognition is empirically learned. The effectiveness of the learned SHL-CNN is verified on both English and Chinese image character recognition tasks, showing that the SHL-CNN can reduce recognition errors by 16-30% relatively compared with models trained by characters of only one language using conventional CNN, and by 35.7% relatively compared with state-of-the-art methods. In addition, the shared hidden layers learned are also useful for unseen image character recognition tasks.
Empirical Study on Character Level Neural Network Classifier for Chinese Text.

Tonglee Chung,Bin Xu,Yongbin Liu,Chunping Ouyang,Siliang Li,Lingyun Luo

DOI: https://doi.org/10.1016/j.engappai.2019.01.009

IF: 8

2019-01-01

Engineering Applications of Artificial Intelligence

Abstract:Character level models are drawing attention recently. A number of these models have been proposed and shown successful in Natural Language Processing tasks. While most of the models are experimented mainly on English, or other alphabetic languages, a number of problems arise when they applied these models to non-alphabetic language such as Chinese. In this study, we investigated the problems encountered when transferring these models to the Chinese and put forward some solutions. We propose a double embedding neural network model that is also character level and consists of both CNN and RNN with two separate embeddings. The model is applied to a fundamental Natural Language Processing task, text classification. Experiment results conducted on the Chinese corpus demonstrated that our character level neural network model performs just as well as or better than those word level classification models. Our model is able to reach 95.9% accuracy on a Chinese Fudan news dataset, which outperforms the state-of-the-art models.
FontRNN: Generating Large‐scale Chinese Fonts via Recurrent Neural Network

Shusen Tang,Zeqing Xia,Zhouhui Lian,Yingmin Tang,Jianguo Xiao

DOI: https://doi.org/10.1111/cgf.13861

IF: 2.5

2019-01-01

Computer Graphics Forum

Abstract:Despite the recent impressive development of deep neural networks, using deep learning based methods to generate large-scale Chinese fonts is still a rather challenging task due to the huge number of intricate Chinese glyphs, e.g., the official standard Chinese charset GB18030-2000 consists of 27,533 Chinese characters. Until now, most existing models for this task adopt Convolutional Neural Networks (CNNs) to generate bitmap images of Chinese characters due to CNN based models' remarkable success in various applications. However, CNN based models focus more on image-level features while usually ignore stroke order information when writing characters. Instead, we treat Chinese characters as sequences of points (i.e., writing trajectories) and propose to handle this task via an effective Recurrent Neural Network (RNN) model with monotonic attention mechanism, which can learn from as few as hundreds of training samples and then synthesize glyphs for remaining thousands of characters in the same style. Experimental results show that our proposed FontRNN can be used for synthesizing large-scale Chinese fonts as well as generating realistic Chinese handwritings efficiently.
Research on Chinese ancient characters image recognition method based on adaptive receptive field

Yalin Miao,Li Liang,Yichun Ji,Zhen Li,Guodong Li

DOI: https://doi.org/10.1007/s00500-022-07270-x

IF: 3.732

2022-08-10

Soft Computing

Abstract:As the main carrier of Chinese civilization, the importance of ancient Chinese documents cannot be overstated. However, the phenomenon of "Heavy storage and light use" is serious in modern society. In order to improve the utilization of its content, and to improve the difficult recognition problem caused by the complex character glyphs and diverse styles of Chinese characters in ancient books, as well as the single and double column mismatch and the different sizes of Chinese characters, in this paper, we propose an adaptive receptive field-based image recognition network for Chinese ancient characters. The network fully considers the high sensitivity of residual dense network to data fluctuation and uses selective convolution kernel to construct residual dense blocks to provide a dynamic selection mechanism for the receptive fields of different images, so that it can focus on the fine structure of Chinese characters and thus realize cross-channel information interaction and integration. The experimental results show that the accuracy and precision of recognition using this paper's network can reach 93.48% and 95.37%, which is a significant improvement compared with other recognition methods, and proves that SKRDN has good advantages in dealing with the recognition problem of ancient Chinese characters.

computer science, artificial intelligence, interdisciplinary applications
Printed Chinese Character Recognition Via the Cooperative Block Neural Networks

Ning Xu,Xiaoqing Ding

DOI: https://doi.org/10.1109/isie.1992.279580

1992-01-01

Abstract:In this paper, the authors propose a new architecture of artificial neural networks, which is called the cooperative block neural networks (CBNN), and use it for the recognition of multi-font printed Chinese characters. Preliminary simulation results have proven that in tackling the difficulties associated with sophisticated topological structures of characters and the large number of Chinese characters to be recognized, the CBNN system is successful
Particle Swarm Optimization-Based Convolutional Neural Network for Handwritten Chinese Character Recognition

Yongping Dan,Zhuo Li

DOI: https://doi.org/10.20965/jaciii.2023.p0165

2023-03-20

Journal of Advanced Computational Intelligence and Intelligent Informatics

Abstract:Recently, handwritten Chinese character recognition has become an important research field in computer vision. With the development of deep learning, convolutional neural networks (CNNs) have demonstrated excellent performance in computer vision. However, CNNs are typically designed manually, which requires extensive experience and may lead to redundant computations. To solve these problems, in this study, the particle swarm optimization approach is incorporated into the design of a CNN for handwritten Chinese character recognition, reducing redundant computations in the network. In this approach, each network architecture is represented by a particle, and the optimal network architecture is determined by continuously updating the particles until a global particle is identified. The experimental validation resulted in a network accuracy of 97.24% with only 1.43 million network parameters. Therefore, it is demonstrated that the proposed particle swarm optimization method can quickly and accurately find the optimal network architecture.
The Handwritten Chinese Character Recognition Uses Convolutional Neural Networks with the GoogLeNet

Ning Bi,Jiahao Chen,Jun Tan

DOI: https://doi.org/10.1142/S0218001419400160

IF: 1.261

2019-10-07

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:With the outstanding performance in 2014 at the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC14), an effective convolutional neural network (CNN) model named GoogLeNet has drawn the attention of the mainstream machine learning field. In this paper we plan to take an insight into the application of the GoogLeNet in the Handwritten Chinese Character Recognition (HCCR) on the database HCL2000 and CASIA-HWDB with several necessary adjustments and also state-of-the-art improvement methods for this end-to-end approach. Through the experiments we have found that the application of the GoogLeNet for the Handwritten Chinese Character Recognition (HCCR) results into significant high accuracy, to be specific more than 99% for the final version, which is encouraging for us to further research.

computer science, artificial intelligence
Lsh-Based Large Scale Chinese Calligraphic Character Recognition

Yuan Lin,Jiangqin Wu,Pengcheng Gao,Yang Xia,Tianjiao Mao

DOI: https://doi.org/10.1145/2467696.2467704

2013-01-01

Abstract:Chinese calligraphy is the art of handwriting and is an important part of Chinese traditional culture. But due to the complexity of shape and styles of calligraphic characters, it is difficult for common people to recognize them. So it would be great if a tool is provided to help users to recognize the unknown calligraphic characters. But the well-known OCR (Optical Character Recognition) technology can hardly help people to recognize the unknown characters because of their deformation and complexity. Numerous collections of historical Chinese calligraphic works are digitized and stored in CADAL (China Academic Digital Associate Library) calligraphic system [1], and a huge database CCD (Calligraphic Character Dictionary) is built, which contains character images labeled with semantic meaning. In this paper, a LSH-based large scale Chinese calligraphic character recognition method is proposed basing on CCD. In our method, GIST descriptor is used to represent the global features of the calligraphic character images, LSH (Locality-sensitive hashing) is used to search CCD to find the similar character images to the recognized calligraphic character image. The recognition is based on the semantic probability which is computed according to the ranks of retrieved images and their distances to the recognized image in the Gist feature space. Our experiments show that our method is effective and efficient for recognizing Chinese calligraphic character image.
Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognition

Xuefeng Xiao,Lianwen Jin,Yafeng Yang,Weixin Yang,Jun Sun,Tianhai Chang

DOI: https://doi.org/10.48550/arXiv.1702.07975

2017-02-26

Abstract:Like other problems in computer vision, offline handwritten Chinese character recognition (HCCR) has achieved impressive results using convolutional neural network (CNN)-based methods. However, larger and deeper networks are needed to deliver state-of-the-art results in this domain. Such networks intuitively appear to incur high computational cost, and require the storage of a large number of parameters, which renders them unfeasible for deployment in portable devices. To solve this problem, we propose a Global Supervised Low-rank Expansion (GSLRE) method and an Adaptive Drop-weight (ADW) technique to solve the problems of speed and storage capacity. We design a nine-layer CNN for HCCR consisting of 3,755 classes, and devise an algorithm that can reduce the networks computational cost by nine times and compress the network to 1/18 of the original size of the baseline model, with only a 0.21% drop in accuracy. In tests, the proposed algorithm surpassed the best single-network performance reported thus far in the literature while requiring only 2.3 MB for storage. Furthermore, when integrated with our effective forward implementation, the recognition of an offline character image took only 9.7 ms on a CPU. Compared with the state-of-the-art CNN model for HCCR, our approach is approximately 30 times faster, yet 10 times more cost efficient.

Computer Vision and Pattern Recognition
Dual-Branch Multitask Fusion Network for Offline Chinese Writer Identification.

Haixia Wang,Yingyu Mao,Qingran Miao,Qun Xiao,Yilong Zhang

DOI: https://doi.org/10.1145/3638554

IF: 1.471

2023-01-01

ACM Transactions on Asian and Low-Resource Language Information Processing

Abstract:Chinese characters are complex and contain discriminative information, meaning that their writers have the potential to be recognized using less text. In this study, offline Chinese writer identification based on a single character was investigated. To extract comprehensive features to model Chinese characters, explicit and implicit information as well as global and local features are of interest. A dual-branch multitask fusion network is proposed that contains two branches for global and local feature extraction simultaneously, and introduces auxiliary tasks to help the main task. Content recognition, stroke number estimation, and stroke recognition are considered as three auxiliary tasks for explicit information. The main task extracts implicit information of writer identity. The experimental results validated the positive influences of auxiliary tasks on the writer identification task, with the stroke number estimation task being most helpful. In-depth research was conducted to investigate the influencing factors in Chinese writer identification, with respect to character complexity, stroke importance, and character number, which provides a systematic reference for the actual application of neural networks in Chinese writer identification.

Large Scale Neural Networks and Its Application on Recognition of Chinese Character

Hybrid Neural Networks System for Large Scale Chinese Character Set Recognition.

A Sphere Neighborhood Covering-Structuring Approach Based on Neural Network and Its Application

A Neural Network Based Classifier for Handwritten Chinese Character Recognition

Chinese Character Recognition Method Based On Multi-Features And Parallel Neural Network Computation

New clustering method for Chinese characters recognition system using neural networks

Large-Scale Printed Chinese Character Recognition for ID Cards Using Deep Learning and Few Samples Transfer Learning

Characters as Graphs: Recognizing Online Handwritten Chinese Characters via Spatial Graph Convolutional Network

Chinese Image Character Recognition Using DNN and Machine Simulated Training Samples.

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

LCSegNet: An Efficient Semantic Segmentation Network for Large-Scale Complex Chinese Character Recognition

Image Character Recognition Using Deep Convolutional Neural Network Learned from Different Languages

Empirical Study on Character Level Neural Network Classifier for Chinese Text.

FontRNN: Generating Large‐scale Chinese Fonts via Recurrent Neural Network

Research on Chinese ancient characters image recognition method based on adaptive receptive field

Printed Chinese Character Recognition Via the Cooperative Block Neural Networks

Particle Swarm Optimization-Based Convolutional Neural Network for Handwritten Chinese Character Recognition

The Handwritten Chinese Character Recognition Uses Convolutional Neural Networks with the GoogLeNet

Lsh-Based Large Scale Chinese Calligraphic Character Recognition

Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognition

Dual-Branch Multitask Fusion Network for Offline Chinese Writer Identification.