Data Caching Mechanism in Meta Search System

Xie Chongfeng,Li Xing,Dang Meimei

1999-01-01

Abstract:Aimed at the requirement of information query system. this paper analyse the shortcomings of traditional Meta Search system. then put forward a new data caching mechanism based on queue. Finally, factors which effect the performance of caching system are analysed

What problem does this paper attempt to address?

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

Peng Liu,Lei Fang,Michael C. Huang

DOI: https://doi.org/10.1007/s11390-014-1459-0

2014-01-01

Abstract:Chip multiprocessor presents brand new opportunities for holistic on-chip data and coherence management solutions. An intelligent protocol should be adaptive to the fine-grain accessing behavior. And in terms of storage of metadata, the size of conventional directory grows as the square of the number of processors, making it very expensive in large-scale systems. In this paper, we propose a metadata cache framework to achieve three goals: 1) reducing the latency of data access and coherence activities, 2) saving the storage of metadata, and 3) providing support for other optimization techniques. The metadata is implemented with compact structures and tracks the dynamically changing access pattern. The pattern information is used to guide the delegation and replication of decoupled data and metadata to allow fast access. We also use our metadata cache as a building block to enhance stream prefetching. Using detailed execution-driven simulation, we demonstrate that our protocol achieves an average speedup of 1.12X compared with a shared cache protocol with 1/5 of the storage of metadata.
The Design and Implementation of Parallel Meta Search System

Xie Chongfeng,Li Xing

1999-01-01

Abstract:Meta Search is an information query tool that is based on multiple search engines. This paper mainlyintroduces the fabric and main points of software implementation of parallel Meta Search system. In the end, it also presents the test result of the system.
Intelligent Edge Caching for Metaverse Applications Based on Grover Search

Guoquan Wu,Jianhang Tang,Yang Zhang,Bo Wang,Wenchao Jiang,Zehui Xiong,Yixiong Feng

DOI: https://doi.org/10.1109/aiot63253.2024.00046

2024-01-01

Abstract:Metaverse is envisaged as an evolving Internet paradigm that allows people to play, work, and socialize in a shared and virtual ecosystem with immersive and seamless experiences. However, multiple users simultaneously request massive resources for avatar physics emulation and graphical rendering. How to provide high-quality and low-latency meta-verse services for massive concurrent users is a crucial problem. In this work, an intelligent Grover search-based edge caching (GEC) algorithm is proposed for metaverse applications, where quantum theory is used to generate caching solutions with low time complexity. Metaverse scenes can be divided into massive environment panoramic frames and dynamic objects. An edge server is deployed to render and cache the common environment panoramic frames, while the dynamic objects are rendered on head-mounted displays (HMDs). Based on the quantum theory, the panoramic frames are split into several tiles and represented by qubits. The optimal caching results are obtained by performing unitary transformations for the tiles’ features. Finally, we provide extensive simulation experiments by a real- world metaverse dataset. The numerical results reveal that the GEC algorithm can reduce 11.09% of the service time and increase 13.34% of the cache hit rate on average by comparing it with two benchmark caching algorithms.
A Caching System for XML Queries Using Frequent Query Patterns

Yijun Bei,Gang Chen,Tianlei Hu,Jinxiang Dong

DOI: https://doi.org/10.1109/CSCWD.2007.4281408

2007-01-01

Abstract:In this paper, we present an optimization framework for querying XML data by caching frequent query patterns. In this framework, frequent query patterns are mined online from user queries, and these query results are cached for future use. The mining process of frequent query patterns is launched automatically when user queries meet predefined requirements. To deal with queries that are similar to but not exactly same as the cached ones, a novel technique named query rewriting is adopted. This technique is able to handle four kinds of similar queries namely exact matching, exact containment, semantic matching and semantic containment. A cache replacement scheme that utilizes both the query pattern support and query pattern accessing time is employed to perform a fine-grained region purging. Experiments are carried out on the XMARK datasets. The results show that the proposed methods are both effective and efficient in improving the performance of XML queries.
A Cached Information Retrieval System and the Performance Analysis

冯红伟,张阳,李多,胡正国

DOI: https://doi.org/10.3969/j.issn.1001-3695.2001.07.036

2001-01-01

Abstract:For the short text retrieval,the traditional,such as the relational data base and the full-text search,are not effcient.In this paper we designed a client/server system to achieve the high performance of the short text searching.At the end of the paper,we measured the performance of the system and compared it with that of the system which using the standard I/O.And a variable,buffer-update- rate,is defined to indicate the rationality of the buffer size.
DartCache:a HashMap-Based Distributed Cache

XIE Cheng-Chao,CHEN Hua-Jun,ZHANG Yu

DOI: https://doi.org/10.3969/j.issn.1002-137X.2006.08.041

2006-01-01

Computer Science

Abstract:With the development of modern enterprise application, the scalability and performance issue begins to play a more and more important role. Within the layered enterprise application architecture, database is usually the bottleneck of system. Cache technology can significantly improve the system performance and scalability by caching the data in application layer. Based on the experience of previous Cache development, we design DartCache, a HashMap based distributed cache system. The experiments have shown a significant improvement of performance and scalability with the implementation of DartCache.
A New Semantic Cache Management Method in Mobile Databases

Shengfei Shi,Jianzhong Li,Chaokun Wang

DOI: https://doi.org/10.3844/jcssp.2005.351.354

2005-01-01

Abstract:In mobile database systems, caching is a crucial way to improve the performance because a new query can be partially answered locally when the client is continuously moving around. Semantic caching has been paid much attention in traditional database systems. However, the methods of semantic cache management proposed in those systems are not suitable for mobile computing environment. Moreover, although many improved semantic caching strategies for mobile computing application have been proposed in recent years, few papers discussed semantic cache coherence control, which is very important in mobile computing environment. In this paper, we propose some new semantic cache model and management algorithms, which can significantly reduce the unnecessary uplink requests and downlink broadcasts compared to previous schemes. Simulation experiments are carried out to evaluate the proposed strategy.
An Overview of Analysis Methods and Evaluation Results for Caching Strategies

Gerhard Hasslinger,Mahshid Okhovatzadeh,Konstantinos Ntougias,Frank Hasslinger,Oliver Hohlfeld

DOI: https://doi.org/10.1016/j.comnet.2023.109583

2023-08-05

Abstract:We survey analytical methods and evaluation results for the performance assessment of caching strategies. Knapsack solutions are derived, which provide static caching bounds for independent requests and general bounds for dynamic caching under arbitrary request pattern. We summarize Markov- and time-to-live-based solutions, which assume specific stochastic processes for capturing web request streams and timing. We compare the performance of caching strategies with different knowledge about the properties of data objects regarding a broad set of caching demands. The efficiency of web caching must regard benefits for network wide traffic load, energy consumption and quality-of-service aspects in a tradeoff with costs for updating and storage overheads.

Data Structures and Algorithms
Cache Associativity on the Performance of Database Systems :Problems,and Optimization Strategies

FENG Ke,CHEN Gang,DONG Jin-Xiang

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.03.021

2005-01-01

Computer Science

Abstract:In this paper,we studied the impact of cache associativity on the performance of database systems,and pre- sented a new optimization technique,which can reduce the cache conflict miss during the data access significantly. This technique is very simple,and requires only a trivial modification on current database systems. We have already implemented this technique in Postgres, MySQL, two famous open-source database systems, and also CoreBase, a database system developed by ourselves. Experiment results have shown that,the query performance of all above sys- tems were improved greatly.
Caching Salon: From Classical to Learning-Based Approaches

Yangchao Zhao,Xu Zhang,Kai Yang,Qilin Fan,Dongchao Guo,Yongqiang Lyu,Hao Yin,Zhan Ma

DOI: https://doi.org/10.1109/SOSE.2019.00046

2019-01-01

Abstract:As a key technology in content delivery, content caching can not only reduce the load on the origin server to save the traffic costs for content providers, but also can enhance users' Quality-of-Experience (QoE) by placing popular objects in close proximity. In reality, Content Delivery Network (CDN) providers always try to design their caching strategies carefully to improve the hit ratio of requests. With the development of learning-based methods and their great successes in many fields, researchers are also trying to explore learning-based caching approaches in recent years. In this paper, we first review the classical caching approaches, most of which are based on recency, frequency and content size. Then we summarize the recent learning-based methods in content caching field. Finally, we discuss the potential content caching strategies in the future, and point out some open issues. Through the studies in this article, we wish it can be used as a reference for interested parties.
A Query Optimizing Scheme in the SESQ System

张志强,邢春晓,周立柱,孙静,钱乾

2004-01-01

Abstract:The explosion of information on the Web turns the search for interested information from the Web into a great challenge. The system called Web data engine-SESQ (Search Extract Storage Query) is designed to solve this problem by using the specific domain ontology to search, extract, store and query the domain Web data. In contrast with traditional database systems and search engines, SESQ is different in data model, query expression, data storage schema, and the use of index. So a new query processing scheme is needed to tackle these features. In SESQ, a query optimizing scheme based on the underlying storage schema is proposed. It is proved that the scheme is very efficient by experiments because, it could predict the data that will not make any contribution to the final query result.
Comparative study on Chinese meta-search engine and foreign meta-search engine

Yan Yiping,Yue Quan

DOI: https://doi.org/10.3969/j.issn.1001-0424.2005.11.006

2005-01-01

Abstract:In this paper,some representative Chinese meta-search engines and foreign metasearch engines have been selected,and a comparative study on their retrieval function and search results etc.has been carried out.Based on the research,the authors point out some primary problems of meta-search engine,and propose some suggestions on the development of meta-search engine.
Measurement And Analysis Of Mobile Web Cache Performance

Yun Ma,Xuanzhe Liu,Shuhui Zhang,Ruirui Xiang,Yunxin Liu,Tao Xie

DOI: https://doi.org/10.1145/2736277.2741114

2015-01-01

Abstract:The Web browser is a killer app on mobile devices such as smartphones. However, the user experience of mobile Web browsing is undesirable because of the slow resource loading. To improve the performance of Web resource loading, caching has been adopted as a key mechanism. However, the existing passive measurement studies cannot comprehensively characterize the performance of mobile Web caching. For example, most of these studies mainly focus on client-side implementations but not server-side configurations, suffer from biased user behaviors, and fail to study "miscached" resources. To address these issues, in this paper, we present a proactive approach for a comprehensive measurement study on mobile Web cache performance. The key idea of our approach is to proactively crawl resources from hundreds of websites periodically with a fine-grained time interval. Thus, we are able to uncover the resource update history and cache configurations at the server side, and analyze the cache performance in various time granularities. Based on our collected data, we build a new cache analysis model and study the upper bound of how high percentage of resources could potentially be cached and how effective the caching works in practice. We report detailed analysis results of different websites and various types of Web resources, and identify the problems caused by unsatisfactory cache performance. In particular, we identify two major problems - Redundant Transfer and Miscached Resource, which lead to unsatisfactory cache performance. We investigate three main root causes: Same Content, Heuristic Expiration, and Conservative Expiration Time, and discuss what mobile Web developers can do to mitigate those problems.
A Survey of Meta Search Engine

张卫丰,徐宝文,周晓宇,李东,许蕾

DOI: https://doi.org/10.3969/j.issn.1002-137X.2001.08.006

2001-01-01

Computer Science

Abstract:With the explosive increase of the network information,it is more and more difficult for people to look up information. The occurrence of the Web search engines overcomes this problem in some degree. However, because different search engines use different mechanisms, scope and algorithms, the repetition of the search results for the same query is no more than 34 %. If wish to get relativly fullscale ,accurate search results,multi-search engines should be used and the meta search engines occur. In this paper ,the meta search engines are surveyed. At first ,the history ,the principles and the elements of the meta search engines are discussed. Then,the related creteria of the meta search engines are analyzed and several typical meta search engines are compared. Finally,on this base,the trend of the meta search engine is introduced.
INFORMATION RETRIEVAL WITH MULTIPLE QUERIES

Yunjie Xu

2001-01-01

Abstract:Information overload becomes an immediate issue as the Internet prospers. To improve information retrieval effectiveness, we propose a sum-cosine procedure which is a meta-search procedure that integrates retrieval results from multiple queries. Based on this procedure, we also give its theoretical justification. We show that it improves performance through better estimation of user's information need and a solid integration method. We also show that meta-search with multiple queries is essentially a special form of relevance feedback. Our empirical evidence is fully consistent with theoretical analysis.
Research on Search Engines and Meta Search Engine

LIU Lu,LI Xian-guo

DOI: https://doi.org/10.3969/j.issn.1007-757x.2006.11.017

2006-01-01

Abstract:In this paper, we firstly discuss the principlesand architectures of traditional search engines, pointing out defects ofthem. Then, introduce the definition, operation principle, category and development trend of meta search engine. Based onthat, we put forward a new improved user-orientedmeta search engine. The results of experiments show this improved enginecanenhance search efficiency and quality.
An integration approach of data mining with web cache pre-fetching

Yingjie Fu,Haohuan Fu,Puion Au

DOI: https://doi.org/10.1007/978-3-540-30566-8_11

2004-01-01

Abstract:Web caching plays a very important role for improving the performance of many Web-Based systems. As web cache capacity is limited, most web cache systems are using replacement algorithm to wash out the outdated data. Our web cache prediction method is based on the fact that, many clients usually have some kinds of regular procedures to access web files, such that the regular-procedure knowledge can be mined or learned by web cache system and files can be pre-fetched accordingly.
Adaptive Cache for Database Query

QIU Lin-feng,CAO Xue-cheng,BAI Wen-yang

DOI: https://doi.org/10.3778/j.issn.1002-8331.2008.22.047

2008-01-01

Computer Engineering and Applications Journal

Abstract:In tradition,databases manage their caches in a relatively mechanical way and the cache can’t tune itself in dynamic environments.Semantic caching can make the database understand the query and provide the information needed in the dynamic tuning.Query cache is a kind of the semantic cache,between the SQL parser and the query executor.This paper does some research on the self-management of the database query cache,in order to improve the database performance.First some concepts of the database cache and the autonomic computing are introduced.Then,the formal definition of the query cache and the adaptive model are given.The experiment is done based on MySQL and the result is obvious.
A New Query Processing Scheme In A Web Data Engine

Zq Zhang,Cx Xing,Lz Zhou,Jh Feng

DOI: https://doi.org/10.1007/3-540-36233-9_7

2002-01-01

Abstract:The explosion of information on the web turns the search for interested information from the web into a great challenge. In this paper, we present a system called Web Data Engine-SESQ (Search Extract Store Query) that is designed to solve this problem by integrating database techniques with search engine techniques. In contrast with traditional database systems and searching engines, SESQ is different in data model, query expression, data storage schema and the use of index.
Research on Web Caching Techniques

顾铁成,杨书慧,陆桑璐,陈道蓄

DOI: https://doi.org/10.3969/j.issn.1002-137X.2002.12.015

2002-01-01

Computer Science

Abstract:This paper discusses the role of Web caching, analyses some major topics in Web caching research, such asWeb cache's architectures,design techniques,deployment policies and,inter-caohe communication protocols for dis-tributed cache servers ,and multimedia proxy caching systems. Besides, some open problems in this field are also pre-sented.

Data Caching Mechanism in Meta Search System

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

The Design and Implementation of Parallel Meta Search System

Intelligent Edge Caching for Metaverse Applications Based on Grover Search

A Caching System for XML Queries Using Frequent Query Patterns

A Cached Information Retrieval System and the Performance Analysis

DartCache:a HashMap-Based Distributed Cache

A New Semantic Cache Management Method in Mobile Databases

An Overview of Analysis Methods and Evaluation Results for Caching Strategies

Cache Associativity on the Performance of Database Systems :Problems,and Optimization Strategies

Caching Salon: From Classical to Learning-Based Approaches

A Query Optimizing Scheme in the SESQ System

Comparative study on Chinese meta-search engine and foreign meta-search engine

Measurement And Analysis Of Mobile Web Cache Performance

A Survey of Meta Search Engine

INFORMATION RETRIEVAL WITH MULTIPLE QUERIES

Research on Search Engines and Meta Search Engine

An integration approach of data mining with web cache pre-fetching

Adaptive Cache for Database Query

A New Query Processing Scheme In A Web Data Engine

Research on Web Caching Techniques