Cheng Wei Yifan Zhang Xinru Zhao Ziyi Zeng Zhiyun Wang Jianfeng Lin Qingfeng Guan Wenhao Yu a School of Geography and Information Engineering,China University of Geosciences,Wuhan,Chinab Meituan,Beijing,Chinac National Engineering Research Center for Geographic Information System,China University of Geosciences,Wuhan,ChinaCheng Wei is a master student in the School of Geography and Information Engineering,China University of Geosciences,Wuhan,China (CUG). His research interests include GeoAI and natural language processing techniques. His contribution includes conceptualization,methodology,data curation,software,visualization,writing – original draft,writing – review and editing,validation and supervision.Yifan Zhang is a Ph.D. student in the School of Geography and Information Engineering China University of Geosciences,Wuhan,China (CUG). His research interests include GeoAI and map generalization. His contribution includes methodology,data curation,software,writing – original draft,writing – review and editing and supervision.Xinru Zhao is a master student in the School of Geography and Information Engineering,China University of Geosciences,Wuhan,China (CUG). Her research interests include GeoAI and deep learning. Her contribution includes data curation and validation.Ziyi Zeng is a Ph.D. student in the School of Geography and Information Engineering China University of Geosciences,Wuhan,China (CUG). Her research interests include GeoAI and LLMs. Her contribution includes data curation and validation.Zhiyun Wang is an undergraduate student in the School of Geography and Information Engineering,China University of Geosciences,Wuhan,China (CUG). Her research interests include GeoAI and deep learning. Her contribution includes data curation and validation.Jianfeng Lin is the leader of the cycling data mining team at Meituan,Beijing,China. His research interests include artificial intelligence and multimodal learning. His contribution includes supervision and project administration.Qingfeng Guan is a professor at China University of Geosciences,Wuhan,China (CUG). His research interests include high-performance spatial computing,spatial computational intelligence,spatiotemporal big data. His contribution includes supervision and project administration.Wenhao Yu received the B.S. and Ph.D. degrees in Geoinformatics from the Wuhan University,Wuhan,China,in 2010 and 2015,respectively. He is a professor at China University of Geosciences,Wuhan,China (CUG). His research interests include spatial data mining,map generalization,and LLMs. His contribution includes conceptualization,writing – original draft,writing – review and editing,supervision,validation,project administration and funding acquisition.

Abstract:Large Language Models (LLMs) excel in natural language-relevant tasks like text generation and question answering Q&A. To further expand their application, efforts focus on enabling LLMs to utilize real-world tools. However, their tool-use ability in professional GIS remains under explored due to two main challenges. Firstly, LLMs are usually trained on general-domain corpora, lacking sufficient and comprehensive GIS-specific data to align with professional knowledge, including understanding the functions of GIS tools. Secondly, researchers often need to combine multiple GIS tools to solve geospatial tasks. To address these challenges, we propose a trainable method to enable LLMs to master GIS tools. We curated a comprehensive set of resources: instruction-response data (GeoTool, 1950 instructions) to enhance the understanding of LLMs for GIS tools, instruction-solution data (GeoSolution, 3645 instructions) to improve their ability to generate tool-use solutions for geospatial tasks, and annotated instruction-solution evaluation data (GeoTask, 300 instructions) for evaluating LLMs' GIS tool-use proficiency. Using the collected training data (GeoTool and GeoSolution), we fine-tuned a professional-domain LLM called GeoTool-GPT based on an open-source general-domain LLM, the LLaMA-2-7b model. The experiment based on evaluation data validates our method's effectiveness in enhancing the tool-use ability of general-domain LLMs in the professional GIS domain, with the performance of our model closely approaching that of GPT-4.

GeoCode-GPT: A Large Language Model for Geospatial Code Generation Tasks

GeoCode-GPT: A Large Language Model for Geospatial Code Generation Tasks

Can Large Language Models Generate Geospatial Code?

Evaluation of Code LLMs on Geospatial Code Generation

GeoLLM: Extracting Geospatial Knowledge from Large Language Models

GeoTool-GPT: a trainable method for facilitating Large Language Models to master GIS tools

An LLM Agent for Automatic Geospatial Data Analysis

CodeJudge: Evaluating Code Generation with Large Language Models

Enabling Geospatial Analysis for Public through Natural Language, with Large Language Models

On the Effectiveness of Large Language Models in Domain-Specific Code Generation

GEE-OPs: An Operator Knowledge Base for Geospatial Code Generation on the Google Earth Engine Platform Powered by Large Language Models

Geo-FuB: A Method for Constructing an Operator-Function Knowledge Base for Geospatial Code Generation Tasks Using Large Language Models

GPT, large language models (LLMs) and generative artificial intelligence (GAI) models in geospatial science: a systematic review

GeoGPT: An assistant for understanding and processing geospatial tasks

A Survey on Large Language Models for Code Generation

GeoGalactica: A Scientific Large Language Model in Geoscience

A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends

GeoGPT: Understanding and Processing Geospatial Tasks through An Autonomous GPT

UrbanGPT: Spatio-Temporal Large Language Models

CityGPT: Empowering Urban Spatial Cognition of Large Language Models

A Survey on Evaluating Large Language Models in Code Generation Tasks