Abstract:There is more and more commercial and research interest in location-based web search, i.e. finding web content whose topic is related to a particular place or region. In this type of search, location information should be indexed as well as text information. However, the index of conventional text search engine is set-oriented, while location information is two-dimensional and in Euclidean space. This brings new research problems on how to efficiently represent the location attributes of web pages and how to combine two types of indexes. In this paper, we propose to use a hybrid index structure, which integrates inverted files and R*-trees, to handle both textual and location aware queries. Three different combining schemes are studied: (1) inverted file and R*-tree double index, (2) first inverted file then R*-tree, (3) first R*-tree then inverted file. To validate the performance of proposed index structures, we design and implement a complete location-based web search engine which mainly consists of four parts: (1) an extractor which detects geographical scopes of web pages and represents geographical scopes as multiple MBRs based on geographical coordinates; (2) an indexer which builds hybrid index structures to integrate text and location information; (3) a ranker which ranks results by geographical relevance as well as non-geographical relevance; (4) an interface which is friendly for users to input location-based search queries and to obtain geographical and textual relevant results. Experiments on large real-world web dataset show that both the second and the third structures are superior in query time and the second is slightly better than the third. Additionally, indexes based on R*-trees are proven to be more efficient than indexes based on grid structures.

A Blocking Inverted File Structure for Search Engine

Effective Storage Structure of Inverted Index

Real-time Text Search Based on Parallel Computing Platform KD-60

A Two-Tier Distributed Full-Text Indexing System

Exploring Large-Scale Small File Storage for Search Engines

Hybrid Index Structures for Location-Based Web Search

An improved model of distributed search engine

Block-based Web Search

A Content-Based Distributed FTP Search Engine:Design and Implementation

Processing Long Queries Against Short Text

A space-efficient indexing algorithm for boolean query processing

An Effective Directory Index Framework Taking Advantages of Hash Table and B+-Tree

Efficient Search in P2P File Sharing System

Data acquisition strategy for FTP search engine

Active Block Layout

A Method of Net Flow Index Retrieval and Compression based on Inverted List

On the Design and Implementation of the Retrieval System of a Large-Scale Search Engine

Optimized top-k processing with global page scores on block-max indexes.

Active block layout: a high performance disk layout mechanism.

Efficient Data Blocking and Skipping Framework Applying Heuristic Rules

An Efficient Blockchain Transaction Retrieval System