New clustering method for Chinese characters recognition system using neural networks

Youshou Wu,Ning Xu,Xiaoqing Ding

1994-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:A new clustering method was proposed for a Chinese characters recognition system using ANN. By use of this clustering technique, the large Chinese characters set of 3755 characters can be divided into many small subsets with accuracy higher than 98%.

What problem does this paper attempt to address?

Hybrid Neural Networks System for Large Scale Chinese Character Set Recognition.

Mingsheng Zhao,Youshou Wu

DOI: https://doi.org/10.1109/ijcnn.1999.833526

1999-01-01

Abstract:This paper addresses a hybrid neural networks system, “TsingNeu-1”, for large scale printed Chinese character recognition. The system, which consists of three-level structure of neural networks with feedback error control, is a well designed unbalanced hierarchical tree structure with its functional parts working in a cooperative way according to their functions. Feedback error control based on output evaluation has been adopted for improving robustness of the system. Recognition features of the Chinese characters are extracted automatically and adaptively by self-organizing learning in every stage of the recognition processes. The implemented system can recognize 3755 categories of Chinese characters and some common used punctuations with various fonts and sizes. Experimental results show that the whole system is of reasonable size, easy to train and satisfactory performance
Mandarin Digital Speech Recognition Based on a Chaotic Neural Network and Fuzzy C-means Clustering

Guang Li,Jin Zhang,Walter J. Freeman

DOI: https://doi.org/10.1109/fuzzy.2007.4295337

2007-01-01

Abstract:Modeling olfactory neural systems, the Kill model proposed by Freeman exhibits chaotic dynamic characteristics and has potential for pattern recognition. Fuzzy c-means clustering can classify an object to several classes at the same time but with different degrees based on fuzzy sets theory. Based on the Kill model, mandarin digital speech is recognized utilizing the features extracted by the fuzzy c-means clustering. Experimental results show that the Kill model can perform digital speech recognition efficiently and the fuzzy c-means clustering has better performance than the hard k-means clustering.
Sequential Cluster Method and Its Application on Neural Network Based Speech Recognition

SHI Xiao-xing,GU Ming-liang,WANG Tai-jun,HE Zhen-ya

DOI: https://doi.org/10.3969/j.issn.1007-0249.2000.02.022

2000-01-01

Abstract:This paper proposes a novel method named sequential cluster network to solve the time alignment problems in artificial neural network (ANN) based speech recognition. Using this network, a fixed number of feature vectors is extracted from the input speech signal, and then processed by a ANN classifier for recognition. Compared with other ANN based methods, the proposed method has many advantages such as less time taken for training and recognition with simpler ANN structure and higher accuracy. A word recognition system is established based on this method and then tested with two sets of English words. The experiment results demonstrate that the proposed method outperforms the conventional HMM and some other ANN methods.
A New Clustering Method Suitable for Large Scale Data

Xu Yin,Hong Xingyong,Zhou Wenjiang,Wang Lunwen,Zhang Ling,Tan Ying

DOI: https://doi.org/10.1109/wcica.2008.4593875

2008-01-01

Abstract:In this paper, constructive neural networks (i.e. CNN) are used to cluster large-scale patterns, and the optimum granularity is chosen by quotient space granularity analysis method. This method not only makes good use of the characteristic of CNN in reducing the computing complexity, but also takes the advantage of quotient space theory in choosing the optimum granularity. So it can cluster large-scale and complicated data effectively. The results of the experiments show the validity of this method.
Chinese Character Recognition Method Based On Multi-Features And Parallel Neural Network Computation

Yanfang Li,Huamin Yang,Jing Xu,Wei He,Jingtao Fan

DOI: https://doi.org/10.1007/978-3-540-74171-8_112

2007-01-01

Abstract:Based on neural network with favorable adaptability to handwritten Chinese character multi-features, in this paper a new method is proposed, using existing multi-features as inputs to structure multi neural network recognition subsystems and these subsystems are integrated with parallel connection mode. The integrated system has the lowest false recognition rate. When using traditional von Neumann architecture computer to implement this system, the system response time is longer as a result of serial computation. This paper introduces a kind of parallel computation method of using pc cluster to implement multi subsystems. It can reduce effectively recognition system's response time.
A Neural Network Based Classifier for Handwritten Chinese Character Recognition

MR Wu,B Zhang,L Zhang

DOI: https://doi.org/10.1109/icpr.2000.906136

2000-01-01

Abstract:In this paper, a geometrical approach for building neural networks is proposed. With the proposed approach, it is very easy to construct an efficient neural classifier to solve the handwritten Chinese character recognition problem, as well as other pattern recognition problems of large scale. Experiments are conducted to evaluate the performance of the proposed approach and results obtained are promising
Improved YOLOV5 Angle Embossed Character Recognition by Multiscale Residual Attention with Selectable Clustering

Shenshun Ying,Jianhai Fang,Shaozhang Tang,Wenzhi Bao

DOI: https://doi.org/10.3390/electronics13132435

IF: 2.9

2024-06-22

Electronics

Abstract:In the intelligentization process of power transmission towers, automated identification of stamped characters is crucial. Currently, manual methods are predominantly used, which are time-consuming, labor-intensive, and prone to errors. For small-sized characters that are incomplete, connected, and irregular in shape, existing OCR technologies also struggle to achieve satisfactory recognition results. Thus, an approach utilizing an improved deep neural network model to enhance the recognition performance of stamped characters is proposed. Based on the backbone network of YOLOv5, a multi-scale residual attention encoding mechanism is introduced during the upsampling process to enhance the weights of small and incomplete character targets. Additionally, a selectable clustering minimum iteration center module is introduced to optimize the selection of clustering centers and integrate multi-scale information, thereby reducing random errors. Experimental verification shows that the improved model significantly reduces the instability caused by random selection of clustering centers during the clustering process, accelerates the convergence of small target recognition, achieves a recognition accuracy of 97.6% and a detection speed of 43 milliseconds on the task of stamped character recognition, and significantly outperforms existing Fast-CNN, YOLOv5, and YOLOv6 models in terms of performance, effectively enhancing the precision and efficiency of automatic identification.

engineering, electrical & electronic,computer science, information systems,physics, applied
A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Haiqing Ren,Weiqiang Wang,Xiwen Qu,Yuanqiang Cai

DOI: https://doi.org/10.1016/j.patrec.2019.10.001

IF: 4.757

2019-01-01

Pattern Recognition Letters

Abstract:The recurrent neural network (RNN) is appropriate for dealing with temporal sequences. In this paper, we present a deep RNN with new features and apply it for online handwritten Chinese character recognition. Compared with the existing RNN models, three innovations are involved in the proposed system. First, a new hidden layer function for RNN is proposed for learning temporal information better. we call it Memory Pool Unit (MPU). The proposed MPU has a simple architecture. Second, a new RNN architecture with hybrid parameter is presented, in order to increasing the expression capacity of RNN. The proposed hybrid-parameter RNN has parameter changes when calculating the iteration at temporal dimension. Third, we make a adaptation that all the outputs of each layer are stacked as the output of network. Stacked hidden layer states combine all the hidden layer states for increasing the expression capacity. Experiments are carried out on the IAHCC-UCAS2016 dataset and the CASIA-OLHWDB1.1 dataset. The experimental results show that the hybrid-parameter RNN obtain a better recognition performance with higher efficiency (fewer parameters and faster speed). And the proposed Memory Pool Unit is proved to be a simple hidden layer function and obtains a competitive recognition results.
A Handwritten Character Recognition Method with ANN Feedback.

XY Zhu,YF Shi

DOI: https://doi.org/10.1109/icdar.2001.953794

2001-01-01

Abstract:In this paper, a new approach of handwritten character recognition system with Artificial Neural Network (ANN) feedback is proposed. This recognition system is based on a neural recognition network and a neural feedback network, the out put of which is used to modify the feature of the input pattern, thus preprocessing and recognition are integrated closely. Experiments show that this approach can make system performance very good and robust to environmental noise
Printed Chinese Optical Character Recognition by Neural Network.

MS Zhao,YS Wu

1998-01-01

Abstract:A printed Chinese Optical Character Recognition (OCR) system, TsingNeu-I system, is introduced in this paper. First, we give an overview of the system; Then, two of the important techniques in designing the neural network Chinese OCR system, concerning feature extraction and NN coarse classifier, are addressed. The implemented system can recognize 3755 categories of Chinese characters with various fonts and sizes. The testing results show that the recognition rate is superior to 98% on a testing sample set containing more than 100,000 Chinese characters collected from various printed materials.
Distributional Character Clustering For Chinese Text Categorization

Xz Zhou,Zh Wu

DOI: https://doi.org/10.1007/978-3-540-28633-2_61

2004-01-01

Abstract:A novel feature generation method-distributional character clustering for Chinese text categorization, which avoids word segmentation, is presented and experimentally evaluated. We propose a hybrid clustering criterion function and bisecting divisive clustering algorithm to improve the quality of clusters. The experimental results show that distributional character clustering is an effective dimensionality reduction method, which reduce the feature space to very low dimensionality (e.g. 500 features) while maintaining high performance. The performance is much better than information gain. Moreover, Naive Bayes classifier with distributional character clustering has state-of-the-art performance in Chinese text classification.
Finding Common Features in Multilingual Fake News: a Quantitative Clustering Approach

Wei Yuan,Haitao Liu

DOI: https://doi.org/10.1093/llc/fqae016

IF: 1.299

2024-01-01

Digital Scholarship in the Humanities

Abstract:Since the Internet is a breeding ground for unconfirmed fake news, its automatic detection and clustering studies have become crucial. Most current studies focus on English texts, and the common features of multilingual fake news are not sufficiently studied. Therefore, this article uses English, Russian, and Chinese as examples and focuses on identifying the common quantitative features of fake news in different languages at the word, sentence, readability, and sentiment levels. These features are then utilized in principal component analysis, K-means clustering, hierarchical clustering, and two-step clustering experiments, which achieved satisfactory results. The common features we proposed play a greater role in achieving automatic cross-lingual clustering than the features proposed in previous studies. Simultaneously, we discovered a trend toward linguistic simplification and economy in fake news. Furthermore, fake news is easier to understand and uses negative emotional expressions in ways that real news does not. Our research provides new reference features for fake news detection tasks and facilitates research into their linguistic characteristics.
Empirical Study on Character Level Neural Network Classifier for Chinese Text.

Tonglee Chung,Bin Xu,Yongbin Liu,Chunping Ouyang,Siliang Li,Lingyun Luo

DOI: https://doi.org/10.1016/j.engappai.2019.01.009

IF: 8

2019-01-01

Engineering Applications of Artificial Intelligence

Abstract:Character level models are drawing attention recently. A number of these models have been proposed and shown successful in Natural Language Processing tasks. While most of the models are experimented mainly on English, or other alphabetic languages, a number of problems arise when they applied these models to non-alphabetic language such as Chinese. In this study, we investigated the problems encountered when transferring these models to the Chinese and put forward some solutions. We propose a double embedding neural network model that is also character level and consists of both CNN and RNN with two separate embeddings. The model is applied to a fundamental Natural Language Processing task, text classification. Experiment results conducted on the Chinese corpus demonstrated that our character level neural network model performs just as well as or better than those word level classification models. Our model is able to reach 95.9% accuracy on a Chinese Fudan news dataset, which outperforms the state-of-the-art models.
A Novel Method for Chinese Named Entity Recognition Based on Character Vector.

Jing Lu,Mao Ye,Zhi Tang,Xiao-Jun Huang,Jia-Le Ma

DOI: https://doi.org/10.1007/978-3-319-28910-6_13

2015-01-01

Abstract:In this paper, a novel method using for Chinese named entity recognition is proposed. For each class, A posteriori probability model is acquired by combing probabilistic model and character vector, which are acquired from each class by using training data. After segment Chinese sentence into words, the posteriori probability of every words in each class can be calculated by using model we proposed, and thus the type of word could be determined according to maximum posteriori probability.
Printed Chinese Character Recognition Via the Cooperative Block Neural Networks

Ning Xu,Xiaoqing Ding

DOI: https://doi.org/10.1109/isie.1992.279580

1992-01-01

Abstract:In this paper, the authors propose a new architecture of artificial neural networks, which is called the cooperative block neural networks (CBNN), and use it for the recognition of multi-font printed Chinese characters. Preliminary simulation results have proven that in tackling the difficulties associated with sophisticated topological structures of characters and the large number of Chinese characters to be recognized, the CBNN system is successful
Dual-Branch Multitask Fusion Network for Offline Chinese Writer Identification.

Haixia Wang,Yingyu Mao,Qingran Miao,Qun Xiao,Yilong Zhang

DOI: https://doi.org/10.1145/3638554

IF: 1.471

2023-01-01

ACM Transactions on Asian and Low-Resource Language Information Processing

Abstract:Chinese characters are complex and contain discriminative information, meaning that their writers have the potential to be recognized using less text. In this study, offline Chinese writer identification based on a single character was investigated. To extract comprehensive features to model Chinese characters, explicit and implicit information as well as global and local features are of interest. A dual-branch multitask fusion network is proposed that contains two branches for global and local feature extraction simultaneously, and introduces auxiliary tasks to help the main task. Content recognition, stroke number estimation, and stroke recognition are considered as three auxiliary tasks for explicit information. The main task extracts implicit information of writer identity. The experimental results validated the positive influences of auxiliary tasks on the writer identification task, with the stroke number estimation task being most helpful. In-depth research was conducted to investigate the influencing factors in Chinese writer identification, with respect to character complexity, stroke importance, and character number, which provides a systematic reference for the actual application of neural networks in Chinese writer identification.
Chinese Image Character Recognition Using DNN and Machine Simulated Training Samples.

Jinfeng Bai,Zhineng Chen,Bailan Feng,Bo Xu

DOI: https://doi.org/10.1007/978-3-319-11179-7_27

2014-01-01

Abstract:Inspired by the success of deep neural network (DNN) models in solving challenging visual problems, this paper studies the task of Chinese Image Character Recognition (ChnICR) by leveraging DNN model and huge machine simulated training samples. To generate the samples, clean machine born Chinese characters are extracted and are plus with common variations of image characters such as changes in size, font, boldness, shift and complex backgrounds, which in total produces over 28 million character images, covering the vast majority of occurrences of Chinese character in real life images. Based on these samples, a DNN training procedure is employed to learn the appropriate Chinese character recognizer, where the width and depth of DNN, and the volume of samples are empirically discussed. Parallel to this, a holistic Chinese image text recognition system is developed. Encouraging experimental results on text from 13 TV channels demonstrate the effectiveness of the learned recognizer, from which significant performance gains are observed compared to the baseline system.
A Novel Data Augmentation Method for Chinese Character Spatial Structure Recognition by Normalized Deformable Convolutional Networks

Sheng Zhuo,Jiangshe Zhang,Chunxia Zhang

DOI: https://doi.org/10.1007/s11063-022-10873-y

IF: 2.565

2022-08-31

Neural Processing Letters

Abstract:In this paper, we propose a novel data augmentation method and a normalized deformable convolutional network for natural image classification and handwritten Chinese character structure recognition. The spatial structure is the basic characteristics of Chinese character, and it plays a very important role in understanding and learning Chinese character. But the convolutional neural networks are inherently limited to model geometric transformations due to the fixed geometric structures in their building modules. So, we use the deformable convolutional network to deal with this task. Furthermore, we propose a normalized deformable convolutional network to improve the stability and accuracy of the model. Besides, some traditional data augmentation method could change one Chinese character structure to another, we propose a novel data augmentation method named Matt data augmentation (MDA) to improve the recognition performance. The normalized deformable Resnet with MDA achieve the best accuracy (93.62%) on handwritten Chinese character structure data set. Besides, the CapsuleNet with MDA can also improve to 89.41% test accuracy compared to without MDA (87.75%). Extensive experiments validate the performance of our approach.

computer science, artificial intelligence
Improvement of Ancient Shui Character Recognition Model Based on Convolutional Neural Network

Hongshuai Zhao,Haozhen Chu,Yuanyuan Zhang,Yu Jia

DOI: https://doi.org/10.1109/access.2020.2972807

IF: 3.9

2020-01-01

IEEE Access

Abstract:This study uses deep learning theory into the character recognition technology for Shui characters in ancient books, with the objectives of overcoming the instability of the high-pixel ancient Shui characters generative model and the need for large scale handwritten text data annotation among other issues. By constructing a multilayer adversarial neural network with a Laplacian structure, a clear generative model is established for original image data of Shui characters and a stable adversarial network model with multiple mapping relationships from coarse to fine is formed. Based on the analysis of the feature distance of Shui character image samples, the minimum inter-class spacing value and the optimal number of clusters are calculated. Combined with feedback from the classifier model, the optimal number of clusters in the clustering model is adjusted, an evaluation function with information entropy adjustment and clustering threshold convergence is constructed for the unsupervised labelling of Shui character image samples. In this paper, the feedback from the convolutional neural network is used to determine the algorithmic model of the hyperparameters for clustering annotation, and this structure is also designed to improve the recognition rate of handwritten Shui characters in ancient books.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Zi-Rui Wang,Jun Du,Wen-Chao Wang,Jian-Fang Zhai,Jin-Shui Hu

DOI: https://doi.org/10.1007/s10032-018-0307-0

2018-01-01

International Journal on Document Analysis and Recognition

Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

New clustering method for Chinese characters recognition system using neural networks

Hybrid Neural Networks System for Large Scale Chinese Character Set Recognition.

Mandarin Digital Speech Recognition Based on a Chaotic Neural Network and Fuzzy C-means Clustering

Sequential Cluster Method and Its Application on Neural Network Based Speech Recognition

A New Clustering Method Suitable for Large Scale Data

Chinese Character Recognition Method Based On Multi-Features And Parallel Neural Network Computation

A Neural Network Based Classifier for Handwritten Chinese Character Recognition

Improved YOLOV5 Angle Embossed Character Recognition by Multiscale Residual Attention with Selectable Clustering

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

A Handwritten Character Recognition Method with ANN Feedback.

Printed Chinese Optical Character Recognition by Neural Network.

Distributional Character Clustering For Chinese Text Categorization

Finding Common Features in Multilingual Fake News: a Quantitative Clustering Approach

Empirical Study on Character Level Neural Network Classifier for Chinese Text.

A Novel Method for Chinese Named Entity Recognition Based on Character Vector.

Printed Chinese Character Recognition Via the Cooperative Block Neural Networks

Dual-Branch Multitask Fusion Network for Offline Chinese Writer Identification.

Chinese Image Character Recognition Using DNN and Machine Simulated Training Samples.

A Novel Data Augmentation Method for Chinese Character Spatial Structure Recognition by Normalized Deformable Convolutional Networks

Improvement of Ancient Shui Character Recognition Model Based on Convolutional Neural Network

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.