An Automatic Discovery Technology of Deep Web Data Sources Based on Semantic

FANG Wei,HU Peng-yu,ZHAO Peng-peng,CUI Zhi-ming

DOI: https://doi.org/10.3969/j.issn.1000-7180.2007.09.018

2007-01-01

Abstract:To expediently utilize the rich ,oriented topic and high quality information of Deep Web, this problem on Deep Web data sources discovery has been focused by more and more people. Nowadays, topic filtering strategy based on

What problem does this paper attempt to address?

An Ontology-based Approach to Topic-specific Web Resource Discovery

Liu Jun,Ling Yun,Wang Xun

DOI: https://doi.org/10.3969/j.issn.0252-3116.2006.05.020

2006-01-01

Abstract:This paper summarizes the merits and flaws of the traditional approaches to topic-specific web resource discovery, which include page content-based approach, page link-based approach and the approach of using reinforcement learning. In addition, the paper introduces a method of using a dictionary to build Ontology, which can reduce much time of users. On this basis, an Ontology-based approach to topic-specific web resource discovery is put forward, which shows great advantages through experiments.
DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Shi Long,Qiang Baohua,Wu Chunming

DOI: https://doi.org/10.3969/j.issn.1000-386x.2013.08.015

2013-01-01

Abstract:With the rapid development of Internet technology,a large number of Web databases have mushroomed and the number remains in a fast-growing trend.In order to effectively organise and utilise the information which hides deeply in Web databases,it is necessary to classify and integrate them according to domains.Since the query interface of Webpage is the unique channel to access the Web database,the classification of Deep Web data source can be realised by classifying the query interfaces.In this paper,a classification method based on text VSM of query interface is proposed.The basic idea is to build a vector space model(VSM) by using query interface text information firstly.Then the typical data mining classification algorithm is employed to train one or more classifiers,thus to classify the domains the query interfaces belonging to is implemented.Experimental result shows that the approach proposed in the paper has excellent classification performance.
Wih - The Web Information Collecting System

Zhanghong Chen,Qinming He,ShenKang Wang

2001-01-01

Abstract:The exploding of information on the Internet requires new tool to deal with the information collecting work. While machine understanding relies heavily on the semantic of the web. Without semantically enriched content, the Web cannot reach its full potential. This paper describes a system to add semantic to semistructured data, which is the most common form on the web. We developed a script language to describe the semantic of the data and a processor to grab information according to the script. Since the system works on the web client side and does not need support by web servers, it can deal with the large amount of existing webs.
Research on Deep Web Classification Based on Domain Feature Text

WU Chun-ming,XIE De-ti

DOI: https://doi.org/10.3969/j.issn.1002-137x.2012.04.040

2012-01-01

Computer Science

Abstract:Automatic Deep Web classification is the basis of building Deep Web data intergration system.An approach was proposed to classify the Deep Web based on domain feature text.Using the ontology knowledge,the concepts which express the same semantics were firstly extracted from different texts.Then the definition of domain correlation was given as the quantitative criteria for feature text selection,in order to avoid the subjectivity and uncertainty of manual selection.In the process of the interface vector space model construction,an improved weighting method named W-TFIDF was proposed to evaluate the different roles of feature text.At last,a KNN algorithm was used to classify these interface vectors.Comparative experiments indicate that the feature text selected by our method is accurate and effective,and the new weighting method can improve the classification precision significantly and shows good stability in KNN classification.
A survey of search technologies in Deep Web

ZHAO Zhi-hong,HUANG Lei,LIU Feng,CHEN Zhen-yu

2009-01-01

Abstract:Search technology are widely used to help users rapidly gathering useful information from WWW. Against the limitations of traditional search technologies, a brief survey of the recent research work of search technologies in Deep Web was provided and presentsed, a search engine framework was presented on the aspects of key techniques.
Research on Web Mining Technique Facing Electronic Business and Application

DONG De-min,HE Qin-ming

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.01.029

2006-01-01

Abstract:Enterprise and organize face a series of problems to capture information of web.Technique of solving these problems were summed up including web content mining,web structure mining and web usage mining.And some application of web mining was intro-duced,such as intelligent search engine,enterprise crisis management,client relation management and personalization service system.
Semantic Web-Based Data Service Discovery and Composition

Linhua Zhou,Huajun Chen,Junjian Wang,Yu Zhang

DOI: https://doi.org/10.1109/SKG.2008.75

2008-01-01

Abstract:Modern scientific research is generating daunting amount of data that is commonly required to be combined together to service daily research endeavors. This paper introduces an ontology-based approach to publishing and composing data intensive web service. The approach distinguishes itself by its capability of dynamically evolving service interface and a data service composition graph (DSCG for short) planner for service composition, enabled by richly describing service capability using the semantic web languages. The advantage of the proposed approach is that the data service(DS for short) can adapt itself with client request dynamically, greatly improving its query service capability. Experimental results show that the proposed algorithm is scalable, and provides a better performance on handling time.
The Use of Web Ontology Languages and Other Semantic Web Tools in Drug Discovery.

Huajun Chen,Guotong Xie

DOI: https://doi.org/10.1517/17460441003762709

2010-01-01

Expert Opinion on Drug Discovery

Abstract:IMPORTANCE OF THE FIELD:To optimize drug development processes, pharmaceutical companies require principled approaches to integrate disparate data on a unified infrastructure, such as the web. The semantic web, developed on the web technology, provides a common, open framework capable of harmonizing diversified resources to enable networked and collaborative drug discovery.AREAS COVERED IN THIS REVIEW:We survey the state of art of utilizing web ontologies and other semantic web technologies to interlink both data and people to support integrated drug discovery across domains and multiple disciplines. Particularly, the survey covers three major application categories including: i) semantic integration and open data linking; ii) semantic web service and scientific collaboration and iii) semantic data mining and integrative network analysis.WHAT THE READER WILL GAIN:The reader will gain: i) basic knowledge of the semantic web technologies; ii) an overview of the web ontology landscape for drug discovery and iii) a basic understanding of the values and benefits of utilizing the web ontologies in drug discovery.TAKE HOME MESSAGE:i) The semantic web enables a network effect for linking open data for integrated drug discovery; ii) The semantic web service technology can support instant ad hoc collaboration to improve pipeline productivity and iii) The semantic web encourages publishing data in a semantic way such as resource description framework attributes and thus helps move away from a reliance on pure textual content analysis toward more efficient semantic data mining.
Application and Design of Web Information Extraction System Based on Pattern Discovery

蔡霞,张森,周宇

DOI: https://doi.org/10.3969/j.issn.1671-7848.2003.03.011

2003-01-01

Abstract:It gives the rapid growth of public information sources on the World Wide Web, it is increasingly attractive to extract data from these sources. Current W eb sites present information on various topics in various formats. A great amoun t of effort is often required for a user to manually locate and extract useful d ata from the Web sites.A reference architecture based on pattern d iscovery is developed,which applies PAT trees to pattern discovery.The process r eq uires no human intervention and training example. Experimental result shows that it can achieve high extraction rate over popular search engines.
Semantic Text Mining with Linked Data

Zhaohui Huang,Huajun Chen,Tong Yu,Hao Sheng,Zhaobo Luo,Yuxin Mao

DOI: https://doi.org/10.1109/ncm.2009.131

2009-01-01

Abstract:Linked Data is an open data space that emerges from the publication and interlinking of structured data on the Web using the Semantic Web technologies. How to utilize this wealth of data is currently a focused research theme of the Semantic Web community. In this paper, we aim to utilize Linked Data to generate semantic annotations for frequent patterns extracted from textual documents. First, we extract semantic relations from textual documents and merge them into a set of semantic graphs. Then, we apply a frequent subgraph discovery algorithm on the set of graphs to generate frequent patterns. Finally, we annotate the discovered patterns using Linked Data. Our approach can be applied in such domains as terrorist network analysis and biological network analysis. The efficacy of our approach is demonstrated through an empirical experiment that discovers and validates relationships between political figures from large number of news on the Web.
Towards Next Generation Web Information Retrieval

Wei-Ying Ma,Hongjiang Zhang,Hsiao-Wuen Hon

DOI: https://doi.org/10.1007/978-3-540-30480-7_3

2004-01-01

Abstract:Today search engines have become one of the most critical applications on the Web, driving many important online businesses that connect people to information. As the Web continues to grow its size with a variety of new data and penetrate into every aspect of people’s life, the need for developing a more intelligent search engine is increasing. In this talk, we will briefly review the current status of search engines, and then present some of our recent works on building next generation web search technologies. Specifically, we will talk about how to extract data records from web pages using vision-based approach, and introduce new research opportunities in exploring the complementary properties between the surface Web and the deep Web to mutually facilitate the processes of web information extraction and deep web crawling. We will also present a search prototype that data-mines deep web structure to enable one-stop search of multiple online web databases.
Semantic information based web service discovery

Huiying Gao,Qian Zhu,Xiuxiu Chen

2010-01-01

Abstract:Web service discovery is an important part of Web service applications. With the increase of the Web services, there come the problems that we must face to. The technology of traditional Web service discovery is based on the matching foundation of key words by combining WSDL and UDDI standardization. However, it is short of the description of semantic information, which means a low level of intelligence. Thus, it leads to low exactness and completeness. In the light of this issue, the paper draws the concept of semantic information into the research of Web service discovery. Through WordNet, it expands service description, raises semantic information, and makes semantic match possible. The paper puts forward a model based on semantic for Web service discovery, analyzes the function structure and the relationship between component parts of the model, moreover, it describes the work flow of the model. At the same time, the paper enlarges UDDI information and gives a matching algorithm on the similarity calculation through semantic analysis when finding the matched service.
A Research of Data Mining Technologies on Web Search

GENG Hua,LI Yuan,ZHU Wei,PAN Jin-Gui

2005-01-01

Computer Science

Abstract:WWW is now the largest distributed information system in the world, and how to find useful information is always a hot topic for researchers. Web mining has become an important branch of data mining. This paper mainly discusses mining technologies used in Web searching. The paper begins with talking about popular technologies in Web content mining, and then focuses on algorithms and models on Web structure mining. Then Web usage mining is briefly discussed. In the end the author advances that the technologies in Web content mining, Web structure mining and Web usage mining will be combined to develop intelligent search engines.
Research of Semantic Web Mining

FU Xiao,LUO Bin,CHEN Shi-Fu

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.03.054

2005-01-01

Computer Science

Abstract:This paper gives an overview of the main ideas and the research progress of Semantic Web Mining. Seman- tic Web Mining utilizes the semantic data extracted from the traditional Web or uses the semantic structure of the Se- mantic Web directly to help Web Mining. It combines two fast-developing research areas Semantic Web and Web Mining. This idea is to improve, on the one hand, the results of Web Mining by exploiting the new semantic structures in the Web; and to make use of Web Mining, on the other hand, for building up the Semantic Web. In this paper, how to extract semantics from the Web is introduced firstly. Then exploiting Semantics for Web Mining an mining the Semantic Web directly is discussed.
Research on Topic Oriented Search Engine Based on Data Mining Technology

陈勇,张佳骥,吴立德,刘海娟

DOI: https://doi.org/10.3969/j.issn.1003-3114.2011.05.013

2011-01-01

Abstract:A novel topic-oriented text retrieval approach is proposed in this paper. In this approach,data mining techniques are used to extract multi-level semantic features from texts, generating multi-precision representation on text. Features extracted from text include both single word features and multi-word features. With this approach, more significant feature in text can be discovered and used. Extracted features are closed to the essence of texts. Experiments show that multi-level features can be used to create a topic-oriented text retrieval system.
Semantic Web Service Discovery Based on LDA Clustering.

Heng Zhao,Jing Chen,Lei Xu

DOI: https://doi.org/10.1007/978-3-030-30952-7_25

2019-01-01

Abstract:In recent years, with the exponential growth of Web services, how to find the best Web services quickly, accurately and efficiently from the large Web services becomes an urgent problem in Web service discovery. Based on the previous work, we propose a semantic Web service discovery method based on LDA clustering. Firstly, the OWL-S Web service documents are parsed to obtain the document word vectors. Then these vectors are extended to make the documents more abundant of semantic information. Moreover, these vectors are modeled, trained and inferred to get the Document-Topic distribution, and the Web service documents are clustered. Finally, we search the Web service request records or the Web services clusters to find Web services that meet the requirements. Based on the data sets of OWLS-TC4 and hRESTS-TC3_release2, the experimental results show that our method (LDA plus semantic) has higher accuracy (13.48% and 9.97%), recall (37.39% and 24.26%), F-value (30.46% and 23.58%) when compared with VSM method and LDA method.
Research on Cross-media Science and Technology Information Data Retrieval

Yang Jiang,Zhe Xue,Ang Li

DOI: https://doi.org/10.48550/arXiv.2204.04887

2022-04-11

Information Retrieval

Abstract:Since the era of big data, the Internet has been flooded with all kinds of information. Browsing information through the Internet has become an integral part of people's daily life. Unlike the news data and social data in the Internet, the cross-media technology information data has different characteristics. This data has become an important basis for researchers and scholars to track the current hot spots and explore the future direction of technology development. As the volume of science and technology information data becomes richer, the traditional science and technology information retrieval system, which only supports unimodal data retrieval and uses outdated data keyword matching model, can no longer meet the daily retrieval needs of science and technology scholars. Therefore, in view of the above research background, it is of profound practical significance to study the cross-media science and technology information data retrieval system based on deep semantic features, which is in line with the development trend of domestic and international technologies.
Web mining: knowledge discovery on the Web

Wang Jicheng,Huang Zhen Yuan,Wu Gangshan,Zhang Fuyan

DOI: https://doi.org/10.1109/ICSMC.1999.825222

1999-01-01

Abstract:With the flood of information on the World Wide Web, Web mining is a new research issue which is drawing great interest from many communities. Currently, there is no agreement about Web mining; it needs more discussion among researchers in order to define exactly what it is. Meanwhile, the development of Web mining systems will in turn promote its research. In this paper, we present a preliminary discussion about Web mining, including its definition, the relationship between information mining and information retrieval on the Web, and the taxonomy and the function of Web mining. In addition, a prototype system called WebTMS (Web Text Mining System) has been designed. WebTMS is a multi-agent system which combines text mining and multi-dimensional document analysis to help users mine HTML documents on the Web effectively
Manufacturing Deep Web Service Management: Exploring Semantic Web Technologies

Zhang Wenyu,Yin Jianwei,Cai Ming,Wu Jian,Lin Lanfen

DOI: https://doi.org/10.1109/mie.2012.2193293

IF: 8.36

2012-01-01

IEEE Industrial Electronics Magazine

Abstract:Since the wide adoption of database and Web service technologies in cross-enterprise manufacturing collaboration, leveraging deep Web contents through service discovery has become one of the most advanced trends in the manufacturing field. However, the effective service discovery and knowledge retrieval from manufacturing deep Web services is still a critical issue because of the underlying intricate structures of deep Web pages. This motivates us to seek a different way to manage manufacturing deep Web services by semantically annotating them to reflect their hidden, dynamic, and heterogeneous contents. In this article, a novel ontology-based approach that uses semantic Web paradigm is proposed, and its implementation in real applications is validated.
ON DISCOVERY AND COMPOSITION OF RESOURCE ONTOLOGY-BASED WEB SERVICES

Wang Zhen,Sun Fuchun,Liu Zhiyou

DOI: https://doi.org/10.3969/j.issn.1000-386X.2012.03.051

2012-01-01

Abstract:In this paper we introduce the semantic Web technology to Web services research,propose a discovery and composition method for Web services which is based on resource ontology.By analysing the relationship between resources,a Web service discovery method based on searching father and son resource class is established.By analysing the input and output relationship between resource and services,a Web service composition methods of step-by-step searching is established as well.Compared with the Web discovery and composition method based on keyword and Web services semantics,the proposed method is fairly good in meeting the requirements of services recall and precision rates,has quite high quality and efficiency on service combination,and fits the Web services closely related to the resources a great deal.

An Automatic Discovery Technology of Deep Web Data Sources Based on Semantic

An Ontology-based Approach to Topic-specific Web Resource Discovery

DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Wih - The Web Information Collecting System

Research on Deep Web Classification Based on Domain Feature Text

A survey of search technologies in Deep Web

Research on Web Mining Technique Facing Electronic Business and Application

Semantic Web-Based Data Service Discovery and Composition

The Use of Web Ontology Languages and Other Semantic Web Tools in Drug Discovery.

Application and Design of Web Information Extraction System Based on Pattern Discovery

Semantic Text Mining with Linked Data

Towards Next Generation Web Information Retrieval

Semantic information based web service discovery

A Research of Data Mining Technologies on Web Search

Research of Semantic Web Mining

Research on Topic Oriented Search Engine Based on Data Mining Technology

Semantic Web Service Discovery Based on LDA Clustering.

Research on Cross-media Science and Technology Information Data Retrieval

Web mining: knowledge discovery on the Web

Manufacturing Deep Web Service Management: Exploring Semantic Web Technologies

ON DISCOVERY AND COMPOSITION OF RESOURCE ONTOLOGY-BASED WEB SERVICES