Adaptive agriculture deep web sources discovery

He Huang,Rujing Wang
2010-01-01
Abstract:Deep Web sources are very sparely distributed makes the problem of discovering them especially challenging. Some researchers have proposed focused crawling and Link-Learning algorithms to solve the problem. However, for the narrow domain, such as farm product supply- demand, farm product prices and agriculture videos, these methods still fail to meet the requirements. In this paper, we propose an adaptive Deep Web sources discovery algorithm to address this problem. For the given domain, our proposed algorithm continuously learns the most promising query from the previous queries, and then submits the query to the search engine to discover new interface Web pages. We experimentally evaluate the effectiveness of the proposed method on farm product supply-demand domain compared with other methods and experiment results are very promising. And we have exploited this method to automatically discover Deep Web of agriculture domain for our vertical agriculture search engine "Sounong".
What problem does this paper attempt to address?