Abstract:As a core task in location-based services (LBS) (e.g., navigation maps), query and point of interest (POI) matching connects users' intent with real-world geographic information. Recently, pre-trained models (PTMs) have made advancements in many natural language processing (NLP) tasks. Generic text-based PTMs do not have enough geographic knowledge for query-POI matching. To overcome this limitation, related literature attempts to employ domain-adaptive pre-training based on geo-related corpus. However, a query generally contains mentions of multiple geographic objects, such as nearby roads and regions of interest (ROIs). The geographic context (GC), i.e., these diverse geographic objects and their relationships, is therefore pivotal to retrieving the most relevant POI. Single-modal PTMs can barely make use of the important GC and therefore have limited performance. In this work, we propose a novel query-POI matching method Multi-modal Geographic language model (MGeo), which comprises a geographic encoder and a multi-modal interaction module. MGeo represents GC as a new modality and is able to fully extract multi-modal correlations for accurate query-POI matching. Besides, there is no publicly available benchmark for this topic. In order to facilitate further research, we build a new open-source large-scale benchmark Geographic TExtual Similarity (GeoTES). The POIs come from an open-source geographic information system (GIS). The queries are manually generated by annotators to prevent privacy issues. Compared with several strong baselines, the extensive experiment results and detailed ablation analyses on GeoTES demonstrate that our proposed multi-modal pre-training method can significantly improve the query-POI matching capability of generic PTMs, even when the queries' GC is not provided. Our code and dataset are publicly available at <a class="link-external link-https" href="https://github.com/PhantomGrapes/MGeo" rel="external noopener nofollow">this https URL</a>.

Query Parsing Task for GeoCLEF2007 Report.

Domain-specific Cross-Language Relevant Question Retrieval.

Mesa: A Map Service To Support Fuzzy Type-Ahead Search Over Geo-Textual Data

Msra Columbus At Geoclef 2006

MSRA Columbus at GeoCLEF2007.

GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview.

Quda: Natural Language Queries for Visual Data Analytics

GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark

CUHK Experiments with ImageCLEF 2005.

QueryAgent: A Reliable and Efficient Reasoning Framework with Environmental Feedback-based Self-Correction

Multi-lingual Geoparsing based on Machine Translation

ECLIPSE: Semantic Entropy-LCS for Cross-Lingual Industrial Log Parsing

MGeo: Multi-Modal Geographic Pre-Training Method

SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval

Analysis and evaluation of query reformulations in different task types

Finding "abstract Fields" of Web Pages and Query Specific Retrieval - THUIR at TREC 2004 Web Track

Exploring LDA-Based Document Model for Geographic Information Retrieval

ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022

TASKS: A Real-Time Query System for Instant Error-Tolerant Spatial Keyword Queries on Road Networks

ObjectNLQ @ Ego4D Episodic Memory Challenge 2024

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation