The Design and Implementation of Parallel Meta Search System

Xie Chongfeng,Li Xing

1999-01-01

Abstract:Meta Search is an information query tool that is based on multiple search engines. This paper mainlyintroduces the fabric and main points of software implementation of parallel Meta Search system. In the end, it also presents the test result of the system.

What problem does this paper attempt to address?

Design, Implementation of the Parallel C Language Based on C/S Mode in Distributed Systems

Xiaohui Zou

DOI: https://doi.org/10.1109/tmee.2011.6199258

2011-01-01

Abstract:In this paper, we designed Parallel C Language, a kind of parallel programming Language, to implement parallel computing in distributed systems. It is to add some special identification statements on ANSI C Language. The parallel computing is based on C/S mode, incorporating multithread and RPC(remote procedure call). Multithread is used to cut tasks and concurrent the subtasks, and RPC is used to deploy and execute the subtasks on remote server nodes. The allocation of remote server nodes is dependent on load balancing mechanism. We also implemented the Pre-compiler of this Parallel C Language program, which parses the Parallel C Language program into several RPC application files. The other RPC application files are constructed by RPCGEN. The result of test shows that using this Parallel C Language to program in distributed systems reduces the codes size and makes full use of the system resources and improves efficiency.
Software System Design and Implementation Based on Principle of Modularized Serial Processing Model

HUANG Xin,CHEN Qi

DOI: https://doi.org/10.3969/j.issn.1000-7024.2005.12.088

2005-01-01

Abstract:People are looking for ways of designing and implementing software systems that are clearer,more reusable and more extensible all through the time.The principle of modularized serial processing modal was explained,and the detailed methods of design and imple-mentation were produced based on this thought,which explained the feasibility and realization of this model.Then,this idea was cry-stallized by presenting a real project,where this model was applied to the design and implementation of SVGS.
Research on social network based on meta-search engine

Yang Shen,Liu Zi-tao,Cheng Luo,Ye Li

DOI: https://doi.org/10.1109/WISA.2009.21

2009-01-01

Abstract:In order to solve the problem that we can only collect data from one single data source at some fixed time after mining the keywords in a rather superficial level, and to take full use of the information returned by search engines to construct the social relationship network based on the semantic link of the searched subject, we do the regular research by using the ROST Content Mining System which helps to undergo the process of page monitoring, content analysis and social network mining based on the pages returned from the four search engines (Google, Baidu, Sougou and Youdao). In the mining process, we adopt the cross-page framework adaptive algorithm which helps to solve the instability problem of the HTML framework codes, to extract information from the acquired web pages. Then we extract the cooccurrence set of high-frequency characteristic words to create the tridimensional social network graph by adopting the progressive search algorithm in the meta-search engine to extend the attribute set of the keywords. Finally, we conducted three typical case studies. They are the comparison of the coverage rate between Google and the meta-search engine, the dynamic changes in real-time network based on the meta-search engine and the progressive mining of effective content in meta-search engine, which all showed the advantages of the method in which we proposed the meta-search engine, as we could have more data sources, stronger real-time dynamic monitoring capacity, and deeper progressive searching ability. So we propose this meta-search engine method which can be used in social network study, aiming to develop the quality of the social network based on content mining, observe the hiding relationships in deeper levels and widen the research scope of content mining. © 2009 IEEE.
Implementation of large-scale distributed information retrieval system

Liang Sun,Gen Cai Chen

DOI: https://doi.org/10.1109/ICII.2001.983029

2001-01-01

Abstract:Parallel and distributed IR holds great potential for tackling the performance and scale issues associated with the large and growing document collections currently available online. We surveyed a number of techniques for exploiting modern parallel architectures. We can easily implement a parallel system that works on both multiprocessor and distributed architectures with relatively little modification. We also present some challenges on parallel and distributed IR, and the future work for tackling these issues
Research on Search Engines and Meta Search Engine

LIU Lu,LI Xian-guo

DOI: https://doi.org/10.3969/j.issn.1007-757x.2006.11.017

2006-01-01

Abstract:In this paper, we firstly discuss the principlesand architectures of traditional search engines, pointing out defects ofthem. Then, introduce the definition, operation principle, category and development trend of meta search engine. Based onthat, we put forward a new improved user-orientedmeta search engine. The results of experiments show this improved enginecanenhance search efficiency and quality.
A Survey of Meta Search Engine

张卫丰,徐宝文,周晓宇,李东,许蕾

DOI: https://doi.org/10.3969/j.issn.1002-137X.2001.08.006

2001-01-01

Computer Science

Abstract:With the explosive increase of the network information,it is more and more difficult for people to look up information. The occurrence of the Web search engines overcomes this problem in some degree. However, because different search engines use different mechanisms, scope and algorithms, the repetition of the search results for the same query is no more than 34 %. If wish to get relativly fullscale ,accurate search results,multi-search engines should be used and the meta search engines occur. In this paper ,the meta search engines are surveyed. At first ,the history ,the principles and the elements of the meta search engines are discussed. Then,the related creteria of the meta search engines are analyzed and several typical meta search engines are compared. Finally,on this base,the trend of the meta search engine is introduced.
The Design of Integrated Monitoring Software Used for Online Steel-measuring System

Qun-qing YANG,Rui-zhong LI,Zhan-qin XIANG,Fu-zai LV

DOI: https://doi.org/10.3969/j.issn.1001-4551.2005.09.003

2005-01-01

Abstract:The designing method of integrated monitoring software used in online measuring system was introduced.And the main method on integration,configuration technology,was also introduced chiefly.The characters of integration was verified in different area of online measuring system.
Design and Implementation of Cross-Search Retrieval System

Li Guangjian,Liu Xiaojuan,Huang Yongwen

DOI: https://doi.org/10.3969/j.issn.1000-4254.2006.07.016

2006-01-01

Library journal

Abstract:This paper mainly discusses the design idea of the Cross - Search retrieval system, as well as its architecture and functional modules. The key problems solved in the system are the interconnection of different target system applying different protocols, the unified format transforming of result records from multi - sources and the synchronized retrievals. It has given an ideal solution and implementation for retrieving multi - databases simultaneously.
Design and Implementation of "search Meizhou" Search Engine System

WU Xi-hong

DOI: https://doi.org/10.3969/j.issn.1006-642x.2011.02.006

2011-01-01

Abstract:The search engine is applied more widely in the development of the information technology,and specific search engine technology is the development trend.In order to adapt to the need of development,the paper puts forward the functional framework of a search engine system which searches information on Meizhou,then discusses the design and implementation methods of searching engine modules,member modules and wikipedia modules.The result from the use of system can provide great convenience for Meizhou netizens to get fast search information effectively.
Improvement of Schedule for User-Oriented Web Mete Search Engine

刘璐,李先国

DOI: https://doi.org/10.3969/j.issn.1002-2279.2008.03.038

2008-01-01

Microprocessors

Abstract:In this paper,we've firstly discussed on the principles and architectures of traditional search engines,and we still pointed out defects among them.At last,we introduced definition,operation principles and category,and trend of development of meta search engine.Based on that,we put forward a new user oriented Meta Search Engine,and have realized it primarily.Experiments show the improvement of efficiency and quality of this approach.
Research On Optimization Computing Service Platform Architecture

Wei Jiang,Zhijiang Shao,Zhongguang Zhang

DOI: https://doi.org/10.1109/WCICA.2006.1712631

2006-01-01

Abstract:The development of network technology and parallel computation provides dramatically opportunity for complicate Optimization Computing Research. This paper brings forward the concept of Optimization Computing Service, which is the theoretic foundation for designing the framework of Optimization Computing Service Platform-MetaSolver. MetaSlover consist of User Interface, Storage Service. Monitor, Dispatcher, Executor etc. Multiple solvers and multiple tasks could be scheduled and executed cooperatively and efficiently based on dynamic load balance algorithm and its implementation is detailed. Numerical experiments conducted on MetaSolver, which are applied to different fields, demonstrates that the Optimization Computing Service Platform is feasible and effective.
Design and implementation of Metta, a metasearch engine for biomedical literature retrieval intended for systematic reviewers

Neil R Smalheiser,Can Lin,Lifeng Jia,Yu Jiang,Aaron M Cohen,Clement Yu,John M Davis,Clive E Adams,Marian S McDonagh,Weiyi Meng

DOI: https://doi.org/10.1186/2047-2501-2-1

2014-01-10

Health Information Science and Systems

Abstract:BackgroundIndividuals and groups who write systematic reviews and meta-analyses in evidence-based medicine regularly carry out literature searches across multiple search engines linked to different bibliographic databases, and thus have an urgent need for a suitable metasearch engine to save time spent on repeated searches and to remove duplicate publications from initial consideration. Unlike general users who generally carry out searches to find a few highly relevant (or highly recent) articles, systematic reviewers seek to obtain a comprehensive set of articles on a given topic, satisfying specific criteria. This creates special requirements and challenges for metasearch engine design and implementation.MethodsWe created a federated search tool that is connected to five databases: PubMed, EMBASE, CINAHL, PsycINFO, and the Cochrane Central Register of Controlled Trials. Retrieved bibliographic records were shown online; optionally, results could be de-duplicated and exported in both BibTex and XML format.ResultsThe query interface was extensively modified in response to feedback from users within our team. Besides a general search track and one focused on human-related articles, we also added search tracks optimized to identify case reports and systematic reviews. Although users could modify preset search options, they were rarely if ever altered in practice. Up to several thousand retrieved records could be exported within a few minutes. De-duplication of records returned from multiple databases was carried out in a prioritized fashion that favored retaining citations returned from PubMed.ConclusionsSystematic reviewers are used to formulating complex queries using strategies and search tags that are specific for individual databases. Metta offers a different approach that may save substantial time but which requires modification of current search strategies and better indexing of randomized controlled trial articles. We envision Metta as one piece of a multi-tool pipeline that will assist systematic reviewers in retrieving, filtering and assessing publications. As such, Metta may find wide utility for anyone who is carrying out a comprehensive search of the biomedical literature.
Comparative study on Chinese meta-search engine and foreign meta-search engine

Yan Yiping,Yue Quan

DOI: https://doi.org/10.3969/j.issn.1001-0424.2005.11.006

2005-01-01

Abstract:In this paper,some representative Chinese meta-search engines and foreign metasearch engines have been selected,and a comparative study on their retrieval function and search results etc.has been carried out.Based on the research,the authors point out some primary problems of meta-search engine,and propose some suggestions on the development of meta-search engine.
Deep Development of Traditional Search Engine Technology Metasearch Engine

黄于蓝,王洪,徐端颐,贾惠波

DOI: https://doi.org/10.3969/j.issn.1000-3428.2002.01.002

2002-01-01

Abstract:On the basis of analyzing the problems of traditional search engines, this article introduces metasearch engine, a new tool using multiple search engines simultaneously according to a same query. Metasearch engine has evolved from the traditional search engine technology. This article explains its structure and composition in details, compares it with the existing metasearch tools completely and evaluates its searching efficiency thoroughly. The results show that the metasearch engine performs better than the traditional tools in internet resource searching.
Design and Implementation of Web-based Full-text Search Engine

CHEN Kang,XU Ting,DAI Wenjun,WU Gangshan

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.20.020

2005-01-01

Abstract:This paper introduces the design and implementation of a Web-based full-text search engine.It gives the design of the system’s framework and the implementation of function modules in detail,and in the end,it gives the test result of the system.
Data Caching Mechanism in Meta Search System

Xie Chongfeng,Li Xing,Dang Meimei

1999-01-01

Abstract:Aimed at the requirement of information query system. this paper analyse the shortcomings of traditional Meta Search system. then put forward a new data caching mechanism based on queue. Finally, factors which effect the performance of caching system are analysed
Distributed Information Searching System

QU Yan,LU Zengxiang,LI Yanda

DOI: https://doi.org/10.3321/j.issn:1000-0054.2000.01.034

2000-01-01

Abstract:A distributed information searching system is designed for the “China Public Multimedia Information Net”. The system consists of several search engines which cooperate with each other. Compared with a centralized structure, the distributed structure has several advantages including high speed, efficient usage of network bandwidth, less security problems, etc. Several principles are introduced such as database miniaturization and localization. The entire structure and the main modules are explained in detail. The system uses feedback of the users to judge the information quality, select search engines and update databases. This method enables the system to track the users needs, to improve system performance.
Design and implementation for literature search and impact-based summaries.

Chong Chen,Feng Li,Xianling Mao,Jing He,Hongfei Yan

DOI: https://doi.org/10.1109/ISKE.2010.5680861

2010-01-01

Abstract:Based on the PARADISE ' (Platform for Applying, Researching and Developing Intelligent Search Engine), we construct a literature search engine with a collection of papers in computer network area. Besides retrieval, the system also provides comments and impact-based summaries of a paper. The comments are extracted from the citing papers and the summary is obtained from the paper sentences impacting on the citing papers. The functions give users a comprehensive knowledge about the paper they want. We first illustrate how to get candidate comment sentences from the citing papers and generate the citation contexts. Then a KL-divergence-based model is introduced to score the similarity between the sentences in the original paper and the citation contexts. The higher the score is, the more likely academic impact the sentence has. The top rank sentences are combined together as the paper's summary. The comment sentences are also selected for users to compare the details of related paper work. The experiment exposes the effect of the proposed implementation. ©2010 IEEE.
Research and Implementation of Subject-Oriented Vertical Search Engine System

SHI Quan,WANG Heng-shan,XIAO Yang-hua,DING Wei-ping

DOI: https://doi.org/10.19304/j.cnki.issn1000-7180.2011.07.001

2011-01-01

Abstract:A general search engine usually suffers from returning to users too much unrelated information.To avoid these problems of general search engine,a subject-oriented vertical search engine is proposed in this paper followed by the introduction of the crawling strategy and the architecture of this vertical search engine.Some distinctive characteristics of this search engine include: the system runs its core modules on multiples threads;a topic-related determination algorithm based on VSM is implemented in the system.The search engine system as well as its core algorithms is built upon lucene.Net.Experimental results show that the accuracy and recall rate of this system are higher than general search engine.Therefore,it is practically valuable and can be applied into more real applications.
A Content-Based Distributed FTP Search Engine:Design and Implementation

Xu Jun,Wang Chaokun,Li Rui,Wang Jianmin,Liu Zhang

2011-01-01

Journal of Computer Research and Development

Abstract:With the development of the Internet,FTP is regarded as the main pattern of sharing files.FTP and HTTP have many different features,like compartmentalization and obturation.It means that it is more difficult for FTP sites to do the indexing work.At present,the indexing work on FTP sites is spread out around filename and it makes users hard to obtain the required information.We put forward a system called iSearch,which is a distributed FTP search engine that based on content.It can index document contents and has many characteristics including incremental indexing,plug-in configuration,loading-balance,inquiring distribution and so on.At the same time,it provides a more stable and accurate inquiring service by reducing the cost of network transmission in the process,indexing more file information,making full use of the user feedback and support a more stable query service.

The Design and Implementation of Parallel Meta Search System

Design, Implementation of the Parallel C Language Based on C/S Mode in Distributed Systems

Software System Design and Implementation Based on Principle of Modularized Serial Processing Model

Research on social network based on meta-search engine

Implementation of large-scale distributed information retrieval system

Research on Search Engines and Meta Search Engine

A Survey of Meta Search Engine

The Design of Integrated Monitoring Software Used for Online Steel-measuring System

Design and Implementation of Cross-Search Retrieval System

Design and Implementation of "search Meizhou" Search Engine System

Improvement of Schedule for User-Oriented Web Mete Search Engine

Research On Optimization Computing Service Platform Architecture

Design and implementation of Metta, a metasearch engine for biomedical literature retrieval intended for systematic reviewers

Comparative study on Chinese meta-search engine and foreign meta-search engine

Deep Development of Traditional Search Engine Technology Metasearch Engine

Design and Implementation of Web-based Full-text Search Engine

Data Caching Mechanism in Meta Search System

Distributed Information Searching System

Design and implementation for literature search and impact-based summaries.

Research and Implementation of Subject-Oriented Vertical Search Engine System

A Content-Based Distributed FTP Search Engine:Design and Implementation