Design and Implementation of an Education-oriented Automatic Weboage Classification System

强庆华,王强,王继成,武港山

DOI: https://doi.org/10.3969/j.issn.1000-3428.2002.08.044

2002-01-01

Abstract:This paper proposes a framework of education-oriented automatic Webpage classification system,focuses on the extraction ofmetadata and selection and quantification of feature. The classification is based on decision tree, using C4.5 algorithm. ;;;;

What problem does this paper attempt to address?

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Deng Li,Du Xin,Shen Ji-zhong

DOI: https://doi.org/10.1631/fitee.1900240

IF: 2.526

2020-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Precise web page classification can be achieved by evaluating features of web pages, and the structural features of web pages are effective complements to their textual features. Various classifiers have different characteristics, and multiple classifiers can be combined to allow classifiers to complement one another. In this study, a web page classification method based on heterogeneous features and a combination of multiple classifiers is proposed. Different from computing the frequency of HTML tags, we exploit the tree-like structure of HTML tags to characterize the structural features of a web page. Heterogeneous textual features and the proposed tree-like structural features are converted into vectors and fused. Confidence is proposed here as a criterion to compare the classification results of different classifiers by calculating the classification accuracy of a set of samples. Multiple classifiers are combined based on confidence with different decision strategies, such as voting, confidence comparison, and direct output, to give the final classification results. Experimental results demonstrate that on the Amazon dataset, 7-web-genres dataset, and DMOZ dataset, the accuracies are increased to 94.2%, 95.4%, and 95.7%, respectively. The fusion of the textual features with the proposed structural features is a comprehensive approach, and the accuracy is higher than that when using only textual features. At the same time, the accuracy of the web page classification is improved by combining multiple classifiers, and is higher than those of the related web page classification algorithms.
Research on Deep Web Classification Based on Domain Feature Text

WU Chun-ming,XIE De-ti

DOI: https://doi.org/10.3969/j.issn.1002-137x.2012.04.040

2012-01-01

Computer Science

Abstract:Automatic Deep Web classification is the basis of building Deep Web data intergration system.An approach was proposed to classify the Deep Web based on domain feature text.Using the ontology knowledge,the concepts which express the same semantics were firstly extracted from different texts.Then the definition of domain correlation was given as the quantitative criteria for feature text selection,in order to avoid the subjectivity and uncertainty of manual selection.In the process of the interface vector space model construction,an improved weighting method named W-TFIDF was proposed to evaluate the different roles of feature text.At last,a KNN algorithm was used to classify these interface vectors.Comparative experiments indicate that the feature text selected by our method is accurate and effective,and the new weighting method can improve the classification precision significantly and shows good stability in KNN classification.
Study and System Implementation of Chinese Web-page Classification

DUAN Jun-Feng,HUANG Wei-Tong,LU Yu-Chang

2007-01-01

Computer Science

Abstract:Web-page classification has become a hotspot in the fields of Web mining and text mining in recent years. Studies towards Chinese Web-page are more and more. A detailed design and implementation of a Chinese Web-page classification system is introduced,and some methods on Web-page preprocessing and feature processing are proposed. Experimental results show that the proposed methods can improve the effectiveness of Chinese Web-page classification from 81.5% to 94.9%.
A multiclass classification framework for document categorization

Qi Qiang,Qinming He

DOI: https://doi.org/10.1007/11669487_42

2006-01-01

Abstract:With a great amount of textual information are available on the Internet and corporate intranets, it has become a necessary to categorize large documents. As we known, text classification problem is representative multiclass problem. This paper describes a framework, which we call Strong-to-Weak- to-Strong (SWS). It transforms a “strong” learning algorithm to a “weak” algorithm by decreasing its iterative numbers of optimization while preserving its other characteristics like geometric properties and then makes use of the kernel trick for “weak” algorithms to work in high dimensional spaces, finally improves the performances of text classification. We analyzed the particular properties of learning with text and identified why this approach is appropriate for this task. Empirical results show that our approach is competitive with the other methods.
A Web Page Classification Algorithm and Its Application in E-government System.

Boyi Xu,Jing Wang,Hongming Cai

DOI: https://doi.org/10.1109/fskd.2010.5569410

2010-01-01

Abstract:With the widespread of Internet application, more and more enterprises build their Web sites and provide business information through Web pages. Web page classification could be used to assign the enterprise Web pages to one or more predefined business categories. On the purpose of Internet-based enterprises administration in E-government system, algorithms and application related to web page classification are discussed. Firstly, the requirement for enterprises administration in E-government system is analyzed. Furthermore, Web page classification module, as well as modules of other function modules, are designed and realized in the enterprise administration system. Next, web page classification algorithm is studied in detail. An algorithm which combines the Unsupervised Clustering method and the Support Vector Machine method is implemented in the web page classification module. Finally the efficiency of the proposed algorithm is tested in the E-government system. The result shows that the algorithm of web page classification provides a good approach to facilitate Internet-related information analysis, and the E-government is useful for the government department standardizing their job procedure.
Design and Implementation of Intelligent Information System Based on Web

陈康,奚伟鹏,蒋凯,武港山

DOI: https://doi.org/10.3969/j.issn.1001-3695.2004.06.058

2004-01-01

Abstract:Because of the fast increase of Web information and continuous enhancement of people’s requirement for information,it’s more and more difficult to get requisite information.For solving these problems,this paper introduces the design and implementation of an intelligent Web information system.And it introduces the framework and the main functional modules of the system in detail.
Web Page Classification Based on Extracting Hierarchy from Web Site

DENG Jian-shuang,ZHENG Qi-lun,PENG Hong

2006-01-01

Journal of Computer Applications

Abstract:Web page classification was one of the hot study problems in the domain of Internet Search currently. Now there were the classifiers based on text and the hyperlinks. But all these methods of classification only used the information of the pages without the information that was provided from the whole web site. In the article, there was a new arithmetic that simplifies the topology structure of the Web site and extracted the connotative hierarchy of the classification to build the classified tree, through which we could achieve the multi-level classification. This method has been applied to the system of intelligent searching and mining of electronic business successfully.
Chinese Web-page Classification Study

Weitong Huang,Lu-Xiong Xu,Junfeng Duan,Yuchang Lu

DOI: https://doi.org/10.1109/icca.2007.4376621

2007-01-01

Abstract:In recent years, web-page classification has been a hotspot in the field of web mining. And researches towards Chinese web-page classification become more and more. In this paper, we introduce the details of a Chinese web-page classification system that we implemented. Experiments show that our web-page preprocessing and feature selection method is effective. The classification accuracy acquired on a Chinese web-page dataset is satisfying.
Design and Implementation of Web Page Classification Tool Based on Word Vector.

Yunzu Song,Xiangzhan Yu,Jianning Huo,Haijie Wang

DOI: https://doi.org/10.1145/3444370.3444579

2020-01-01

Abstract:With the continuous development of the Internet, the number of web pages is growing rapidly. How to find the webpage information people need in a total number of web pages has become a difficult challenge. In many web pages, manual classification is obviously unrealistic. In view of the difficulty in obtaining tools or software that can be used for automatic classification of web pages [1,11,12,13] on the Internet, this topic designs and implements a web page classification tool based on word vector. With this tool, we can classify a large number of uncategorized pages based on some of the pages that have been classified.
Semantics-based Hyperlink Classification,Design and Implementation

奚伟鹏,李昕,武港山

DOI: https://doi.org/10.3969/j.issn.1001-3695.2004.11.056

2004-01-01

Abstract:The research on hyperlink is playing an important role in Web mining.Propose a framework for automatic semantics-based hyperlink classification,and describe the design and implementation detailedly.In the work,the relevant features,which implicate the hyperlink′s semantic content,will be extracted and quantified automatically.An approach inspired by decision tree technology,using C4.5 algorithm,is applied to make classification.The features selected and decision rules generated is based on machine learning on large numbers of hand tagged training samples.Typing the hyperlink from the semantic point of view,our research is promising to be great helpful in more effectively automatic processing on the Web resources.
Research and Implementation of Function-oriented Web Service Classification System

WANG Hua-lan,SHI Yan-qi,WANG Hong-bing

DOI: https://doi.org/10.3969/j.issn.1000-1220.2013.01.008

2013-01-01

Abstract:A novel method based on support vector machine is presented to conduct service classification with a medium or big category set.It uses the descriptive information of categories in a large-scale taxonomy as sample data,so as to disengage from the dependence on sample service documents,and the functional information of the new service document is extracted for classification.A new feature selection method using semantic hierarchy relationship between words to determine the main concepts of the category is introduced to enable efficient classification using this new type of sample data.The semantic hierarchy relationship between words is built according to the semantic similarity between words which is calculated by semantic similarity methods based on WordNet.We demonstrate the effectiveness of our classification method through extensive experiments.
Research on Web Pages Automatic Classification Based on Internet News Corpus

CAI Wei,WANG Ying-lin,YIN Zhong-hang

IF: 8.1

2007-01-01

Information Sciences

Abstract:Web pages contain more abundant contents than pure text ,such as hyperlinks,html tags and metadata et al.So that Web page categorization is different from pure text. According to Internet Chinese news pages, a practical algorithm for extracting subject concepts from web page without thesaurus was proposed, when incorporated these category-subject concepts into knowledge base, Web pages was classified by hybrid algorithm, with experiment corpus extracting from Xinhua net. Experimental result shows that the categorization performance is improved using Web page feature.
An Efficient Centroid Based Chinese Web Page Classifier

Liu Hui,Peng Ran,Ye Shaozhi,Li Xing

2003-01-01

Abstract:In this paper, we present an efficient centroid based Chinese web page classifier that has achieved satisfactory performance on real data and runs very fast in practical use. It not only is clear designed, but also has some creative features: Chinese word segmentation and noise filtering technology in preprocessing module; combined 2 χ Statistics feature selection method; adaptive factors to improve categorization performance. Another advantage of this system is its optimized implementation. Finally we show performance results of experiments on a corpus from Peking University of China, and some discussions.
ABCF: an Adaptive Balanced Multimodal Website Classification Framework

Zhiyuan Liu,Wei Liu,Xinyang Tong,Qi Shen,Qiang Zheng,Hengrui Hu,Hong Liu,Xiaojie Wang

DOI: https://doi.org/10.1109/cscwd61410.2024.10580593

2024-01-01

Abstract:Websites are a crucial medium for conveying multimedia information. However, malicious websites can lurk among them, posing a threat to the security of users’ sensitive data and personal privacy. Hence, it is significant to identify and categorize such harmful sites. Various solutions have been proposed by researchers for this task, including extracting features from URLs and analyzing web page content using classification algorithms. To tackle these challenges, we suggest the Adaptive Balanced multimodal website Classification Framework (ABCF), which is designed for web page classification tasks. The framework includes a FAModule and FEAModule for better multimodal data fusion on websites. We also employ incremental learning to continuously improve our model and adapt to the changing network environment. Experiments on three website datasets confirm the effectiveness of our modules in capturing website features and demonstrate the superiority of our model compared to past malicious website classification systems. Code will be released at github.com/lzyy2435/ABCF/.
A Web Site Classification Approach Based on Its Topological Structure.

Ji-bin Zhang,Zhi-ming Xu,Kun-li Xiu,Qi-shu Pan

2010-01-01

Abstract:Automatic web site classification has a wide application prospect; however, there are few researches on it. Different from pure texts, web sites are the combination of a large number of web pages via hyperlinks, so text classification methods are not suitable to classify them directly. This paper proposes a web site classification approach based on its topological structure. Given a web site, firstly we represent its topological structure as a directed graph, and from which we extract a strongly connected sub-graph including the site’s home page. Secondly, we use an improved PageRank algorithm on the sub-graph to select some topic-relevant resources, and represent them as a topic vector of the site. Finally we use an SVM classifier to classify the site in term of its topic vector. Some experiments are conducted for web site classification. Experimental results show our approach achieved better performance than traditional super page-based web site classification approach.
An Efficient Centroid Based Chinese Web

Liu Hui,Peng Ran,Ye Shaozhi,Li Xing

2004-01-01

Abstract:In this paper, we present an efficient centroid based Chinese web page classifier that has achieved satisfactory performance on real data and runs very fast in practical use. Except for its clear design, this classifier has some creative features: Chinese word segmentation and noise filtering technology in preprocessing module; combined 2 χ Statistics feature selection method; adaptive factors to improve categorization performance. Another advantage of this system is its optimized implementation. Finally we show performance results of experiments on a corpus from Peking University of China, and some discussions.
The Implementation of Automatic Classification System Based on New Subject Extraction & Noise Reduction Method

CAI Wei,WANG Ying-lin,YIN Zhong-hang

IF: 8.1

2009-01-01

Information Sciences

Abstract:Based on research&develop text automatic classification system a lot of years,authors pre-sent a new classifier scheme using hybrid algorithms. According to Internet news's character,we pre-sent a new method to extract subject from Internet news by string match without thesaurus,as a sup-plement for "thesaurus+match" mode; noise reduction is one of hardest problem to improve classifica-tion accuracy,we find multi-category noise while we develop this system,and present an algorithm to remove multi-category noise based on statistics of frequency. We develop an Interuet news automatic classification system using all methods mentioned above,and tested it using 10,0000 piece of Internet news corpus provided by ChinaInforBank. Classification result is well,close to practical level.
Classification of Sensitive Web Documents

Hui Gao,Yan Fu,Jian-Ping Li

DOI: https://doi.org/10.1109/icacia.2008.4770027

2008-01-01

Abstract:Web document classification is the process of grouping web documents into one or more predefined categories based on their content. It is an important component of web monitor system that can assist people to reduce the dissemination of harmful information. This paper proposes a combined approach for building a decision tree with the multilayer neural network as its categorically value function, and presented a complete approach for automated news categorization. The experimental evaluation demonstrates that this approach provides better classification accuracy than single traditional text categorization methods.
Preprocessing and Feature Preparation in Chinese Web Page Classification

Weitong Huang,Luxiong Xu,Yanmin Liu

DOI: https://doi.org/10.1109/iccet.2009.72

2009-01-01

Abstract:A detailed design and implementation of a Chinese web-page classification system is described in this paper, and some methods on Chinese web-page preprocessing and feature preparation are proposed. Experimental results on a Chinese web-page dataset show that methoss we designed can improve the performance from 75.82% to 81.88%.
The Automatic Classification Of Web Pages Based On Neural Network

Yizhong Zhang,Mingsheng Zhao,Youshou Wu

2001-01-01

Abstract:The web pages classification is certainly important. A technique of extracting field information as common knowledge may be also needed. Compound word processing in keyword extraction from web pages is also one of important factors. In this method, the tour fields are systematically defined at first and the information related to the field is extracted. A new method of extracting feature was considered, which can incorporate three items of information: text, HTML tags and hyperlinks properly.Accordingly, this paper presents a neural network algorithm (Self-organizing feature map) to study on automatic classification of web pages. The proposed approach is based on a new set of features combined with a self-organized neural network classifier. The set of features corresponds to the contents, is selected by using a statistical reduction procedure, and provides text keywords, hyperlink and HTML tags information. The final set of features is then utilized as input vector into a proper neural network to achieve the classification goal. Web pages are classified as different classes.A series of experiments were conducted to evaluate performance of our approach. The results have shown it is quite promising.

Design and Implementation of an Education-oriented Automatic Weboage Classification System

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Research on Deep Web Classification Based on Domain Feature Text

Study and System Implementation of Chinese Web-page Classification

A multiclass classification framework for document categorization

A Web Page Classification Algorithm and Its Application in E-government System.

Design and Implementation of Intelligent Information System Based on Web

Web Page Classification Based on Extracting Hierarchy from Web Site

Chinese Web-page Classification Study

Design and Implementation of Web Page Classification Tool Based on Word Vector.

Semantics-based Hyperlink Classification,Design and Implementation

Research and Implementation of Function-oriented Web Service Classification System

Research on Web Pages Automatic Classification Based on Internet News Corpus

An Efficient Centroid Based Chinese Web Page Classifier

ABCF: an Adaptive Balanced Multimodal Website Classification Framework

A Web Site Classification Approach Based on Its Topological Structure.

An Efficient Centroid Based Chinese Web

The Implementation of Automatic Classification System Based on New Subject Extraction & Noise Reduction Method

Classification of Sensitive Web Documents

Preprocessing and Feature Preparation in Chinese Web Page Classification

The Automatic Classification Of Web Pages Based On Neural Network