The Research of Automatic Indexing Method for Web Information

Chen Guiju,Guo Chunxia

2010-01-01

Abstract:The paper has a brief introduction to the principle and some methods of automatic indexing,and describes three automatic indexing methods for webpage currently used,which are respectively based on knowledge base,UCL and genetic algorithm.The author carries out analysis and makes a comparison to the above methods at last.

What problem does this paper attempt to address?

Method research and system design of automatic acquire recruitment information based on Internet

Xiao-hu Mei,Baoshan Luo,Yao Feng,Yi Ding

DOI: https://doi.org/10.1109/COMPCOMM.2016.7925212

2016-10-01

Abstract:Web crawler is an automated and methodological traversing and indexing tool of web pages, assembling web content locally for subsequent search purposes. This paper aimed at improving the employment rate and teaching quality in Higher Vocational Colleges, researched and developed a web crawler which is specifically designed to gain recruitment information from the recruitment website, and has carried on an analysis to the obtained employment information. These information can not only be used to help students find jobs, but also can provide abundant data source for a variety of applications aimed at education and vocation, such as career recommendation, career prediction, extraction of enterprise demand for talents' professional ability, created a new way of improving the employment rate and the quality of teaching in Higher Vocational Colleges.

Computer Science,Education
News-oriented Automatic Chinese Keyword Indexing

Sujian Li,Houfeng Wang,Shiwen Yu,Chengsheng Xin

DOI: https://doi.org/10.3115/1119250.1119263

2003-01-01

Abstract:In our information era, keywords are very useful to information retrieval, text clustering and so on. News is always a domain attracting a large amount of attention. However, the majority of news articles come without keywords, and indexing them manually costs highly. Aiming at news articles' characteristics and the resources available, this paper introduces a simple procedure to index keywords based on the scoring system. In the process of indexing, we make use of some relatively mature linguistic techniques and tools to filter those meaningless candidate items. Furthermore, according to the hierarchical relations of content words, keywords are not restricted to extracting from text. These methods have improved our system a lot. At last experimental results are given and analyzed, showing that the quality of extracted keywords are satisfying.
Research on Indexing Page Collection Selection Method for Search Engine.

Liyun Ru,Zhichao Li,Yingying Wu,Shaoping Ma

DOI: https://doi.org/10.1007/978-1-4614-6880-6_30

2014-01-01

Journal of Computer Research and Development

Abstract:With the rapid development of the Internet, the number of web pages has grown explosively. There are also many pages with similar content and low-quality pages. In terms of search engine, indexing such pages is no significant effect for retrieval results but increases the search engine’s indexing and retrieval burden. This paper presents a page selection algorithm, building indexing page collection from massive web data for search engine. On the one hand, a web signature-based clustering algorithm is used to filter the similar pages to compress the size of the indexing page collection; on the other hand, it combines a variety of features of the page dimensions and user dimensions, to ensure the quality of the collection. Experiments show that the size of indexing page collection selected by the proposed algorithm is only one-third of the entire page collection, and can meet the vast majority of user click needs, with a strong practical.
Auto-Indexing Based on Chinese Characters Coding on Words Platform

JIAO Hui,LIU Qian,JIA Hui-bo

DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.15.053

2007-01-01

Computer Engineering and Applications Journal

Abstract:Auto-indexing is one of the key techniques of information retrieval based on contents.At present the research on Chinese auto-indexing mainly focuses on automatic segmentation which is a predisposal problem.This paper presents a kind of Chinese characters coding method on words platform,and establishes a new Chinese text format in computer which makes words the smallest information unit.Based on this method,auto-indexing does not rely on segmentation as before.Thereby the efficiency and quality of auto-indexing would be improved.
The Design of Intelligent Chinese Web Topic Information Gather System IRobot

马亮,陈群秀,王俊,徐国伟

DOI: https://doi.org/10.3969/j.issn.1003-0077.2002.05.004

2002-01-01

Abstract:This paper introduces the design of intelligent Chinese Web topic information gather system IRobot in detail. According to the new features of Web topic informationgather, this system do relevance predication to the URLs to be gathered,together with the relevance scoring to the pages gathered. Especially in relevant predication, new issues about topic information are taken into account thoroughly. All the factors together improve the performance of system. Compared to other research results in this field, IRobot perform better in precision,efficiency and stability, also it can provide us a list of most important Web resources in topic field searched.
The Test of Automatic Indexing on the Subject Index of Book

Pan Xuelian,Hou Hanqing,Xu Yangwei

DOI: https://doi.org/10.3969/j.issn.1002-1027.2008.03.006

2008-01-01

Abstract:The article introduces a new system which can be used to index automatically on the subject index of the book.This algorithm is better than those of the currently used indexing software,because it can carefully and selectively generate
The Introduction of Scorpion and Automatic Indexing Research

Ye Xiaohui,Wang Sufang,Yang Hua,Shao Wei

2009-01-01

Abstract:Scorpion is a research project by OCLC for automatic indexing and cataloging of electronic resources using the Dewey Decimal Classification System.The paper introduces most of Scorpion's research work up to date,including verification of whether the Dewey Decimal Classification System can be used in automatic topic recognition,experiments for Scorpion Dewey Classification Database setup and evaluations,improvement and quality evaluation of Scorpion result sets and so on.It also analyses some core technologies of the project.At last,the author gives a brief evaluation on Scorpion's research work and its latest progresses in automatic indexing.
STATE OF THE ART OF INFORMATION RETRIEVAL ON THE WEB

Ji-cheng WANG,Rong XIAO,Zheng-Xing SUN,Fu-yan ZHANG

2001-01-01

Journal of Computer Research and Development

Abstract:A mass of distributed and dynamic information on the Web has resulted in “information overload”. With the flood of information, it has become an important research issue to search the Web based on traditional information retrieval technology. However, various systems and ambiguous terminology of information retrieval on the Web bring much trouble to users in application and researchers in development as well. Moreover, there are few publications which roundly analyze technologies up to the minute in this field. The state of the art of information retrieval on the Web is surveyed in this paper. First categorized are the systems of sorts in a hierarchical taxonomy and each layer is examined thoroughly. Then analyzed are the general mechanism and several critical new technologies involved in information retrieval on the Web, including results ranking based on hyperlinks, online clustering of retrieval results, concept search, relevance feedback and so on. The paper ends with the authors' achievement and future work.
An Internet Information Retrieval System Based on Agents

WEI Zizhong,Zhang Yaoxue

DOI: https://doi.org/10.3969/j.issn.1000-7024.2001.02.007

2001-01-01

Abstract:On the basis of analyzing the pros and cons of traditional Search Engines and off-line browsing applications, a scheme based on agents for Intemet information retrieval is presented. According to the scheme,a system named WebClone integrating the functions of automatic downloading, full-text search and off-line browsing is implemented. The system can be used to facihtate the information retrieving and sharing process on the internet.
New Automatic Categorization Algorithm for Chinese Homepages

ZHANG Li,LI Xing,LU Dajin

DOI: https://doi.org/10.3321/j.issn:1000-0054.2000.01.012

2000-01-01

Abstract:Current abundant resources can be accessed on the Internet, but there is no effective method to organize the information. Through analysising of the characteristics of Chinese text and Chinese homepages, a new automatic categorization method for Chinese homepages was presented. This method correlates the Chinese characters, the term frequency, and the hypertext markup language (HTML) tag information in the homepage to calculate an adjustable term frequency weighting parameter. An expert database is built using both in set and out set sample training. Experiments show that the method's recognition rate is about 80%.
Research and Implementation on University Information Resources Search

HU Jun,LI Xing

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.24.006

2006-01-01

Abstract:Campus Network is an importantplatform of university information resources(UIR),which differs from Internet in many aspects.New methods and algorithms is used to build a good UIR search engine.Based on the analyses of the differences between campus network and Internet,corresponding solutions such as multiple metrics ranking algorithm is proposed.A real UIR search engine is conducted and the experimental results show that UIR search engine has many advantages compared with the general Internet search engine.
Research on Design Principles of Website Evaluation Index System

刘虹,孙建军,郑彦宁,潘云涛

2013-01-01

Abstract:Based on relevant literatures of website evaluation index system,the paper summarized the design principles of current website evaluation index system in four aspects,the definition of indexes,the result of evaluation,the effectiveness of evaluation process and the index system.Meanwhile,the paper proposes the existing problems of current evaluation index system and the development direction of future research.
An Investigation of the Academic Information Finding and Re-finding Behavior on the Web

Hsiao-Tieh Pu,Xin-Yu Jiang

DOI: https://doi.org/10.6182/jlis.2014.12(2).117

2014-01-01

Abstract:Academic researchers often need and re-use relevant information found after a period of time. This preliminary study used various methods, including experiments, interviews, search log analysis, sequential analysis, and observation to investigate characteristics of academic information finding and re-finding behavior. Overall, the participants in this study entered short queries either in finding or re-finding phases. Comparatively speaking, the participants entered greater number of queries, modified more queries, browsed more web pages, and stayed longer on web pages in the finding phase. On the other hand, in the re-finding phase, they utilized personal information management tools to re-find instead of finding again using search engine, such as checking browsing history; moreover, they tend to input less number of queries and stayed shorter on web pages. In short, the participants interacted more with the retrieval system during the finding phase, while they increased the use of personal information management tools in the re-finding phase. As to the contextual clues used in re-finding phase, the participants used less clues from the target itself, instead, they used indirect clues more often, especially location-related information. Based on the results of sequential analysis, the transition states in the re-finding phase was found to be more complex than those in the finding phase. Web information finding and re-finding behavior is an important and novel area of research. The preliminary results would benefit research on Web information re-finding behavior, and provide useful suggestions for developing personal academic information management systems. (Article content in Chinese with English extended abstract)
An Index System for Quality Synthesis Evaluation of BtoC Business Website.

Meimei Chen,Bingyong Tang,Sheng Cheng,Li Zhou,Chen Wang

DOI: https://doi.org/10.1145/1089551.1089569

2005-01-01

Abstract:It is important for successful electronic business to have a hi-quality business website. So we need an accurate and effective index system to evaluate and analyses the quality of the business website. In this paper, the evaluation index system following the 'grey box' principle is proposed which considers both efficiency of business website and performance of electronic business system. Using R-Hierarchical clustering method to extract the typical indexes from sub-indexes is theoretically proved to have a rationality and effectiveness. Finally, the evaluation method is briefly discussed.
An Evaluation Model on Information Coverage of Search Engines

孟涛,闫宏飞,李晓明

DOI: https://doi.org/10.3321/j.issn:0372-2112.2003.08.012

2003-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:Search engines usually get web pages by using links between them. With already massive and ever increasing of web pages, they can only crawl and index a portion of the whole web pages. A model to evaluate their information coverage percentages is presented. We analyze main factors why crawlers can't cover all web information, and put up three kinds of benchmarks to measure the coverage of a search engine. The paper gives out an evaluation model for two of three benchmarks as follows: First, sampling WWW to get many web pages, which are used to check the coverage percentage of quantity through generating random IPs or breadth first search. Second, selecting high-qualified pages as samples of important pages, by HITS or PageRank algorithms. Finally, we submit the samples to page database of search engines, and get the coverage percentage. In our research work, we get experimental data from WebInfoMall system of Peking University and compute the coverage percentages of quantity and quality. Using different sampling approaches and algorithms, we get the same results, which can prove our model is right and all the results are exact.
Applied Research of Knowledge in the Field of Artificial Intelligence in the Intelligent Retrieval of Teaching Resources

XuJing Bai,JiaJun Li

DOI: https://doi.org/10.1155/2021/9924435

2021-06-14

Scientific Programming

Abstract:In the development process of education informatization, digital teaching resources continue to grow, and how to manage and organize massive teaching resources has become a key issue for teaching staff. An efficient and accurate search system is an important part of the teaching resource service system. The use of intelligent search engines can search teaching resources comprehensively and efficiently, and the artificial intelligence search engine provides a reliable and convenient solution for the design and development of intelligent search systems. The article analyzes the design principles and technical standards of the intelligent search system, expounds the system’s functional architecture and database design, and introduces the realization process and principles of the search system. By analyzing the characteristics of basic education resources and existing automatic abstracting methods, this paper proposes to integrate the calculated feature word weights in the field of basic education into the algorithm for calculating the weights of abstract sentences and simultaneously examine the sentence position, sentence length, and other texts. There is an automatic summarization algorithm for surface statistics. This article also introduces the search design ideas and implementation steps based on artificial intelligence, makes a scientific evaluation and summary of the actual situation of the automatic abstract system running in the basic education resource search engine, and looks forward to the next improvement work.

computer science, software engineering
An Intelligent Platform For Information Retrieval

Fang Li,Xuanjing Huang

DOI: https://doi.org/10.1007/978-3-540-70934-3_5

2007-01-01

Abstract:Information Retrieval (IR) has played a very important role in our modern life. However, the results of search engines are not satisfactory for human intelligent activities. The platform proposed in this paper tried to solve the problems from three aspects: One is to provide domain specific IR, which consists of task oriented searching and topic related filtering, The second is to provide open-domain, concept-based retrieval to reduce irrelevant pages and overcome ambiguous keywords. The third is to provide the exact answer by question answering. The intelligent platform will facilitate searching ability on the Web. It will be easier for users to locate the interest information by keywords or questions. Researches described in the paper are developed at Shanghai Jiaotong universities and Fudan university. The experiments have showed a promising result from each aspect. The integration of these three aspects is one of the challenges of IR in the near future.
The Research of Web Mining

孙茂松,沈达阳

DOI: https://doi.org/10.3969/j.issn.1002-137X.2000.02.021

2000-01-01

Computer Science

Abstract:The application of knowledge mining technology,is the key to improve the information searching ability of World Wide Web. Atming at different types of information,the paper introduces several Web mining technologies,which are applied in ParaSite,DRS and WebKB respectively,after comparing their characteristics,an idea of building common Web mining systsem is presented.
Investigation and Analysis of Academic Information Retrieval System Based on Electronic Resources of Nanjing Uuniversity Library

Cheng Ying,Sun Jianjun,Zhang Min

DOI: https://doi.org/10.13663/j.cnki.lj.2011.09.021

2011-01-01

Library journal

Abstract:In this paper,the elements of 51 Chinese and English academic information retrieval systems are investigated and analyzed,respectively from aspects of update cycle,peer review,service types,service mode,help,personalized service,stimulation,retrieval methods,browsing/navigation,search fields,search techniques,recall/precision,relevance feedback,sorting/grouping,format/display,output of result,item identification/mark,classification/subject description,hyperlinks,and meta retrieval etc.The results reveal that ① the elements of Chinese and English academic information retrieval systems are similar,but Chinese database need to do more;② improving the analysis and design of output of retrieval systems;③ expanding the application of meta retrieval;④ extending the depth and breadth of personalized service;⑤ providing value-added services.
An Evaluation System for Algorithms of Automated Text Categorization on Chinese

XU Wei,DONG Yuan,ZHANG Su-Qin

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.08.048

2007-01-01

Computer Science

Abstract:Automated text categorization on Chinese helps people make more effective use of the growing Chinese information on the Internet.Current algorithms have different performance according to the environment.Evaluation to the algorithms tells the feature of certain algorithm.At present,there is no evaluation system form algorithms of automated text categorization on Chinese.This paper introduces such a evaluating system.An open research platform based on it is also introduced,with results of some algorithms.

The Research of Automatic Indexing Method for Web Information

Method research and system design of automatic acquire recruitment information based on Internet

News-oriented Automatic Chinese Keyword Indexing

Research on Indexing Page Collection Selection Method for Search Engine.

Auto-Indexing Based on Chinese Characters Coding on Words Platform

The Design of Intelligent Chinese Web Topic Information Gather System IRobot

The Test of Automatic Indexing on the Subject Index of Book

The Introduction of Scorpion and Automatic Indexing Research

STATE OF THE ART OF INFORMATION RETRIEVAL ON THE WEB

An Internet Information Retrieval System Based on Agents

New Automatic Categorization Algorithm for Chinese Homepages

Research and Implementation on University Information Resources Search

Research on Design Principles of Website Evaluation Index System

An Investigation of the Academic Information Finding and Re-finding Behavior on the Web

An Index System for Quality Synthesis Evaluation of BtoC Business Website.

An Evaluation Model on Information Coverage of Search Engines

Applied Research of Knowledge in the Field of Artificial Intelligence in the Intelligent Retrieval of Teaching Resources

An Intelligent Platform For Information Retrieval

The Research of Web Mining

Investigation and Analysis of Academic Information Retrieval System Based on Electronic Resources of Nanjing Uuniversity Library

An Evaluation System for Algorithms of Automated Text Categorization on Chinese