Chinese Text Categorization Algorithm Based on SVM

冀胜利,李波

DOI: https://doi.org/10.3969/j.issn.1674-8425-b.2008.07.021

2008-01-01

Abstract:A Chinese text categorization algorithm based on SVM is presented,and its key techniques in the process of text organizing-text expression,feature selection,SVM algorithm,etc.are introduced.The experiments show that it works well in precision rate,recall rate,etc.

What problem does this paper attempt to address?

Fast Qualitative Analysis of Textile Fiber in Near Infrared Spectroscopy Based on Support Vector Machine

DH Wang,SZ Jin,B Gan,HX Feng

DOI: https://doi.org/10.1117/12.674348

2006-01-01

Abstract:The fast qualitative analysis of textile fiber is a crucial step in textile manufacture, export and inspection. This paper presents a near infrared spectroscopy classification method based on SVM for fast qualitative analysis of textile fiber. SVM is a new automatic classification tool and it has successfully been applied to standard classification tasks, such as text classification, pattern identification, bioinformatics and medical diagnosis. In this paper, SVM is extended into near infrared fast qualitative analysis of textile fiber for the first time. In this paper, eight kinds classification algorithms which are composed of two classifiers(C-SVC and v-SVC) and four kernel functions (linear, polynomial, RBF and sigmoid) are used to do classification experiments and comparison analysis for ten kinds familiar textiles fiber. Experiment results show that it is feasible to apply SVM in fast qualitative analysis of textile fiber, and the optimal classifier algorithm and the corresponding experimental results are reported.
Research on Chinese Text Automatic Categorization Based on VSM

Tong Xiao-Jun,Cui Ming-Gen,Song Guo-Long

DOI: https://doi.org/10.1109/wicom.2007.955

2007-01-01

Abstract:Automatic text classifying is an import application of the information processing technology. This paper introduces the key techniques of Chinese text categorization such as text preprocessing, feature selection, feature representation, training and classifying algorithm, especially analyses the current most important several feature selection methods with emphasis. A Chinese text classifier based on KNN algorithm was developed. The system can preferably implement Chinese automatic text categorization and has a higher quality. We also use this classifier to compare several feature selection methods. In the end, we utilize the experiment results to prove the importance role of feature selection in text categorization.
A New Text Categorization Method Based on HMM and SVM

Chen Donghui,Liu Zhijing

DOI: https://doi.org/10.1109/iccet.2010.5485482

2010-01-01

Abstract:This paper has put forward a new method to improve the performance of text categorization. The new method combines HMM (Hidden Markov Model) and SVM (Support Vector Machines). HMMs are used to as a feature extractor and then a new feature vector is normalized as the input of SVMs, so the trained SVMs can classify unknown texts successfully. The experimental results prove that the method is more effective and high classification accuracy.
Study on SVM Compared with the other Text Classification Methods

Zhijie Liu,Xueqiang Lv,Kun Liu,Shuicai Shi

DOI: https://doi.org/10.1109/ETCS.2010.248

2010-01-01

Abstract:Based on the text information processing, we have made a study on the application of support vector machine in text categorization. Through introducing the basic principle of SVM, we described the process of text classification and further proposed a SVM-based classification model. Finally, experimental data show that F1 value of SVM classifier has reached more than 86.26%, and the classification results comparing to other classification methods have greatly improved, and it also proves that SVM is an effective machine learning method.
An Improved Text Categorization Algorithm Based on VSM

Ji Geng,Yunling Lu,Wei Chen,Zhiguang Qin

DOI: https://doi.org/10.1109/CSE.2014.313

2014-01-01

Abstract:With the advent of the information age, various kinds of information have been spread on the Internet. The amount of junk information affects people's lives seriously. In order to filter the harmful Web pages efficiently and effectively, we have suggested a novel text classification algorithm based on Vector Space Model in this paper. This algorithm has adopted the modularized processing mode to deal with Web pages. In addition, it has introduced the proportion of feature selection and improved the traditional Term Frequency-Inverse Document Frequency weighting method. Furthermore, the simulation of our algorithm and other existing work has been given. The comparison shows that our algorithm enjoying higher accuracy and classification precision, which achieves a better system performance and a better classifying effect.
Sentiment Classification for Chinese Reviews: a Comparison Between SVM and Semantic Approaches

Q Ye,B Lin,YJ Li

DOI: https://doi.org/10.1109/icmlc.2005.1527335

2005-01-01

Abstract:Web content mining is intended to help people to discover valuable information from large amount of unstructured data on the Web. Sentiment classification aims to mining the Web content of product reviews by classifying the reviews into positive or negative opinions. Such kind of classification approaches could help both consumers and sellers in making their decisions. But it is also a complicated task with great challenge. This paper conducted a comparison between the SVM approach and semantic approach for sentiment classification of Chinese reviews and also proposed some improvement for sentiment classification approaches. Experimental result indicated that, compared with previous researches for English reviews, the performance of both approaches for Chinese reviews sentiment classification are acceptable, while the support vector machine approach has better performance than the semantic orientation approach.
Study on Chinese Web Page Classification Based on SVM

NIU Qiang,WANG Zhi-xiao,CHEN Dai,XIA Shi-xiong

DOI: https://doi.org/10.3969/j.issn.1000-7024.2007.08.049

2007-01-01

Abstract:Chinese web page classification has been considered as a hot research area in data mining.SVM is an effective method for learning the classification knowledge from massive data,especially in the situation of high cost in getting labeled classical examples.Based on the analyses of features of Chinese web pages,A Chinese web page classification algorithm based on SVM is presented to ef-fectively organize the rich information on the Internet,including the important aspects of text preprocessing,feature selection and multiple-class algorithm.The experiments show that it not only reduces the size of train set,but also has very high training efficiency.Its precision and recall are also very good.
Method of Chinese Text Categorization Based on Variable Precision Rough Set

Ming-Yan Wang,Ting Liu

DOI: https://doi.org/10.1109/IITAW.2009.12

2009-01-01

Abstract:Text categorization is an important research direction of current information retrieval. The traditional text classification method use the support vector machine (SVM) and the Bayes classification algorithm (etc). On the basis of Rough Set on text categorization, this paper put forward the idea of variable precision rough set model for Chinese text categorization, which use the attribute reduct algorithm based on the importance of attributes as heuristic information to reduct the feature subset of the text, and analyses the influence of error classification rate on text classification. It can increase the flexibility of text categorization and improve the accuracy of text classification by setting different value to find the the best.
A research on text categorization based on the fusion of K-NN and SVM

Qiang Wang,XiaoLong Wang,Yi Guan,Zhiming XU

DOI: https://doi.org/10.3321/j.issn:1002-0470.2005.05.005

2005-01-01

Abstract:This paper presents a new fusion algorithm for automatic text categorization based on the combination of the improved K-NN and SVM. The new algorithm analyses the reliability of classifier with CLA (Classifier's Local Accuracy) technique for the combination of these two methods. The improved K-NN introduces text cluster to describe inside text structure and the improved SVM uses sigmoid function to transform the output of SVM to a probability value. The experimental results prove that the new algorithm combines the merits of the two algorithms and performs better with fewer candidates and higher precision.
SVM Classification:Its Contents and Challenges

Yue Shihong,Li Ping,Hao Peiyi

DOI: https://doi.org/10.1007/s11766-003-0059-5

2003-01-01

Abstract:SVM (support vector machines) have become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. In particular, they exhibit good generalization performance on many real issues and the approach is properly motivated theoretically. There are relatively a few free parameters to adjust and the architecture of the learning machine does not need to be found by experimentation. In this paper, survey of the key contents on this subject, focusing on the most well-known models based on kernel substitution, namely SVM, as well as the activated fields at present and the development tendency, is presented.
Chinese Text Classification System on Regulatory Information Based on SVM

Mingyue Zhang,Xinbo Ai,Yanzhu Hu

DOI: https://doi.org/10.1088/1755-1315/252/2/022133

2019-07-09

IOP Conference Series: Earth and Environmental Science

Abstract:The rapid development of computer technology has brought a large amount of text information. This paper aims to classify the text in view of the increasing number of Chinese texts in the process of supervision and the increasing demand of processing Chinese texts, and to improve the efficiency of information query and management. In this paper, a Chinese text brake classification system based on support vector machine is designed and implemented. The text is represented mathematically by vector space model, and the classifier is trained to classify the text based on the principle of support vector machine. In this paper, the classification performance of the text system is tested and evaluated by using the file of regulatory information. The experimental results show that the classification accuracy of the text system is relatively high and has certain practicability. The system in this paper can improve the efficiency of information inquiry and management and make it possible to manage massive text information.

English Else
Chinese text classification based on character-level CNN and SVM

Huaiguang Wu,Daiyi Li,Ming Cheng

DOI: https://doi.org/10.1504/IJIIDS.2019.102940

2019-11-25

International Journal of Intelligent Information and Database Systems

Abstract:Aiming at the problems of curse of dimensionality, sparse data and long computation time in traditional SVM classification algorithm based on term frequency-inverse document frequency (TF-IDF), we propose a novel hybrid system for Chinese text classification: CSVM, which is independent of the hand-designed features and domain knowledge. Firstly, the encoding words are done by constructing a text vocabulary of size m for the input language, and then quantise each word using 1-of-m encoding. Secondly, we exploit the convolutional neural network (CNN) to extract the morphological features of character vectors from each word, and then through large scale text material training the semantic feature of each word vectors are be obtained the semantic feature of each word vectors. Finally, the text classification is carried out with the SVM multiple classifier. The experimental results show that the CSVM algorithm is more effective than other traditional Chinese text classification algorithm.

English Else
Feature Selection for Support Vector Machines in Text Categorization

Yi Liu,Haiming Lu,Zengxiang Lu,Pu Wang

2003-01-01

Abstract:Support vector machine (SVM) has been successfully applied to text categorization. We find that the decision hyperplane of SVM classifier can also be used for feature selection. When linear kernel is used, the decision rule can be seen as a combination of weighted values of each dimension of the vector to be categorized, each weight indicating the importance of corresponding dimension in the categorization decision. Hence we can only preserve those dimensions with bigger weights. In this way we combine the feature selection into the learning process of SVM training. Empirical experiment result is given to verify our new method.
A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

Jixian Zhang,Qinglin Wang,Yuan Li,Dongmei Li

DOI: https://doi.org/10.1109/CSSS.2012.334

2012-01-01

Abstract:Text classification is an important research direction of text mining and the research of Chinese text automatic classification is also becoming a research focus of intelligent classification. Against the particularity of the Chinese text classification, this paper presents a three-dimensional vector space model on the basis of the vector space model to improve the accuracy and efficiency of text classification. Experimental results show that the accuracy rate increased to 98.8125% which proves that the algorithm is effective.
Applying Title Category Semantic Recognition for Text Categorization

Wang Qiang,Yi Guan,Wang Xiao-long

2007-01-01

Abstract:This paper presents a new algorithm using title category semantic recognition for text categorization.The algorithm generates feature space based on its category,picks up category semantic words of the title to produce candidate category and finally classifies it under these candidate categories.The experimental results firmly prove that the new algorithm performs better with fewer candidates and higher precision.Further research introduces category space representation efficiency to verify the validity of the new algorithm and proves that it can achieve great improvement in text representation.
Chinese Language and Literature Online Resource Classification Algorithm Based on Improved SVM

Xiaowen Li

DOI: https://doi.org/10.1155/2022/4373548

2022-01-22

Scientific Programming

Abstract:With the rapid development of network technology and the rapid growth of all kinds of online information resources, a large number of Chinese language and literature resources have emerged on the Internet. Online Chinese language and literature resources are becoming more and more important sources for people to obtain important information. However, existing search engines tend to provide a lot of irrelevant content when searching for information. Therefore, how to quickly and effectively obtain useful resource information and classify Chinese language and literature resources from a large number of information resources is the focus of this paper. This article mainly aims at the current development situation, by consulting a large amount of data, understanding the research status of improved SVM algorithm at home and abroad, showing the idea and advantages of SVM through the algorithm and experimental process, and further improving the SVM algorithm. The improved SVM proposed in this paper greatly improves the efficiency of classification and facilitates the rapid search of information with high matching degree among various online resources of Chinese language and literature.

computer science, software engineering
Multi-labeled Chinese Text Categorization Based on the Boosting Algorithms

Zhan Wang,Minghu Jiang

DOI: https://doi.org/10.1109/icnc.2009.669

2009-01-01

Abstract:This paper proposes approaches for multilabeled text categorization based on the Boosting Algorithms. We discussed the performances of various feature selection methods for multi-labeled TC. Besides the multilabeled categorization, we also make efforts on ranking the labels assigned to the texts.
Research on Chinese Text Classification Based on WAE and SVM

Chen Xin,Qiu Zhanzhi

DOI: https://doi.org/10.1109/icnlp52887.2021.00008

2021-03-01

Abstract:For Internet information explosion, the user is in urgent need to quickly screening in huge amounts of information is concerned about the problems on effective information, focus on using machine learning and deep learning algorithms for Chinese text classification research, this paper proposes a comprehensive method of WAE and SVM on the Chinese text classification. In this paper, the text classification process, whether to introduce the WAE theme model to participate in the text classification of two scenarios. Experiments show that adding WAE topic model before SVM classification algorithm can improve classification accuracy and reduce classification time.
An Automatic Chinese-Text Classifier Based on Vector Space Model

ZHU Huayu,Sun Zhengxing,ZHANG Fuyan

DOI: https://doi.org/10.3969/j.issn.1000-3428.2001.02.006

2001-01-01

Abstract:This paper presents a Chinese-text classifier based on vector space model. Some key techniqes implemented in this classifier,such as feature extraction, dimension reduction, hierarchical classification and classifier training, are discussed in details. As experiment results show, the developed system can reach both high precision and high recall on average.
A research on web resources automatic classification using SVMs

Wei Cai,Yongcheng Wang,ZhongHang Yin,Tao Zou

DOI: https://doi.org/10.1109/wcica.2002.1020803

2002-01-01

Abstract:With the rapid growth of Web information, text categorization has become important research field for the management of Internet information. Most of the existing methods are based on traditional statistics, which provides that conclusion only for the situation where sample size is tending to infinity. So they may not work well in practical case with limited samples and easily lead to the problem of over-fitting. These papers theoretical analyze the reason of over-fitting and introduce its condition as well as the method to solve it. At last we introduce SVMs, a method to avoid over-fitting, which is based on statistical learning theory matching the limited number of Internet news examples.

Chinese Text Categorization Algorithm Based on SVM

Fast Qualitative Analysis of Textile Fiber in Near Infrared Spectroscopy Based on Support Vector Machine

Research on Chinese Text Automatic Categorization Based on VSM

A New Text Categorization Method Based on HMM and SVM

Study on SVM Compared with the other Text Classification Methods

An Improved Text Categorization Algorithm Based on VSM

Sentiment Classification for Chinese Reviews: a Comparison Between SVM and Semantic Approaches

Study on Chinese Web Page Classification Based on SVM

Method of Chinese Text Categorization Based on Variable Precision Rough Set

A research on text categorization based on the fusion of K-NN and SVM

SVM Classification:Its Contents and Challenges

Chinese Text Classification System on Regulatory Information Based on SVM

Chinese text classification based on character-level CNN and SVM

Feature Selection for Support Vector Machines in Text Categorization

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

Applying Title Category Semantic Recognition for Text Categorization

Chinese Language and Literature Online Resource Classification Algorithm Based on Improved SVM

Multi-labeled Chinese Text Categorization Based on the Boosting Algorithms

Research on Chinese Text Classification Based on WAE and SVM

An Automatic Chinese-Text Classifier Based on Vector Space Model

A research on web resources automatic classification using SVMs