Web Pages Information Retrieval Based on Keywords Cluster and Node Instance

DENG Jian-Shuang,ZHENG Qi-Lun,PENG Hong,LIN Xu-Dong
DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.04.058
2007-01-01
Computer Science
Abstract:Many Web information retrieval methods are related to special Web sites, for example, the method based on extracting rules and the one based on training page samples. These methods can do well in a Web site but fail in the others without adding new rules or inputting new training pages manually. Furthermore, if the template of the Web site is changed, it has to redesign the extracting rules or re-inputting the training pages. It is hard to be maintained and used to extract information from large number of different Web sites. In the paper, there is a new method which can extract the useful information from the different sites automatically based on the keywords of a certain topic and the distance of the nodes. Experimental evaluation on a large of Web pages from different Web sites indicates that this method correctly and automatically extracts the information ignoring which Web sites the pages come from. This method has been applied to the system of intelligent searching and mining of electronic business successfully.
What problem does this paper attempt to address?