Abstract:As a core task in location-based services (LBS) (e.g., navigation maps), query and point of interest (POI) matching connects users' intent with real-world geographic information. Recently, pre-trained models (PTMs) have made advancements in many natural language processing (NLP) tasks. Generic text-based PTMs do not have enough geographic knowledge for query-POI matching. To overcome this limitation, related literature attempts to employ domain-adaptive pre-training based on geo-related corpus. However, a query generally contains mentions of multiple geographic objects, such as nearby roads and regions of interest (ROIs). The geographic context (GC), i.e., these diverse geographic objects and their relationships, is therefore pivotal to retrieving the most relevant POI. Single-modal PTMs can barely make use of the important GC and therefore have limited performance. In this work, we propose a novel query-POI matching method Multi-modal Geographic language model (MGeo), which comprises a geographic encoder and a multi-modal interaction module. MGeo represents GC as a new modality and is able to fully extract multi-modal correlations for accurate query-POI matching. Besides, there is no publicly available benchmark for this topic. In order to facilitate further research, we build a new open-source large-scale benchmark Geographic TExtual Similarity (GeoTES). The POIs come from an open-source geographic information system (GIS). The queries are manually generated by annotators to prevent privacy issues. Compared with several strong baselines, the extensive experiment results and detailed ablation analyses on GeoTES demonstrate that our proposed multi-modal pre-training method can significantly improve the query-POI matching capability of generic PTMs, even when the queries' GC is not provided. Our code and dataset are publicly available at <a class="link-external link-https" href="https://github.com/PhantomGrapes/MGeo" rel="external noopener nofollow">this https URL</a>.

Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese Geographic Re-Ranking

GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark

GeoDecoder: Empowering Multimodal Map Understanding

A Coarse-to-Fine Model for Geolocating Chinese Addresses

GSAM: A Deep Neural Network Model for Extracting Computational Representations of Chinese Addresses Fused with Geospatial Feature

A Local Information Perception Enhancement–Based Method for Chinese NER

ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its Applications in Baidu Maps

GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding

Few-shot learning for name entity recognition in geological text based on GeoBERT

MGeo: Multi-Modal Geographic Pre-Training Method

A Multi-Modal Geographic Pre-Training Method

GeoBERT: Pre-Training Geospatial Representation Learning on Point-of-Interest

A Hierarchy-Aware Geocoding Model Based on Cross-Attention within the Seq2Seq Framework

Learning Geospatial Region Embedding with Heterogeneous Graph

GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model

Geo-BERT Pre-training Model for Query Rewriting in POI Search.

Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval

mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval

A deep neural network model for Chinese toponym matching with geographic pre-training model

SE-KGE : A Location-Aware Knowledge Graph Embedding Model for Geographic Question Answering and Spatial Semantic Lifting.

ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localization