LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction

Songwei Li,Jie Feng,Jiawei Chi,Xinyuan Hu,Xiaomeng Zhao,Fengli Xu
2024-08-23
Abstract:Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus on spatiotemporal patterns, paying less attention to the underlying intentions that govern movements. Recent advancements in large language models (LLMs) offer a promising alternative research angle for integrating commonsense reasoning into mobility prediction. However, it is a non-trivial problem because LLMs are not natively built for mobility intention inference, and they also face scalability issues and integration difficulties with spatiotemporal models. To address these challenges, we propose a novel LIMP (LLMs for Intent-ware Mobility Prediction) framework. Specifically, LIMP introduces an "Analyze-Abstract-Infer" (A2I) agentic workflow to unleash LLM's commonsense reasoning power for mobility intention inference. Besides, we design an efficient fine-tuning scheme to transfer reasoning power from commercial LLM to smaller-scale, open-source language model, ensuring LIMP's scalability to millions of mobility records. Moreover, we propose a transformer-based intention-aware mobility prediction model to effectively harness the intention inference ability of LLM. Evaluated on two real-world datasets, LIMP significantly outperforms baseline models, demonstrating improved accuracy in next-location prediction and effective intention inference. The interpretability of intention-aware mobility prediction highlights our LIMP framework's potential for real-world applications. Codes and data can be found in <a class="link-external link-https" href="https://github.com/tsinghua-fib-lab/LIMP" rel="external noopener nofollow">this https URL</a> .
Computation and Language
What problem does this paper attempt to address?
The paper attempts to address the issue in human mobility prediction where existing models primarily focus on spatiotemporal patterns while neglecting the complex and often implicit human intentions behind them. This oversight leads to insufficient accuracy in predicting the next location, especially in understanding the intentions driving each movement. To tackle these issues, the authors propose a new framework called LIMP (Large Language Model-enhanced Intention-aware Mobility Prediction), which aims to improve the inference and prediction accuracy of mobility intentions by integrating the commonsense reasoning capabilities of large language models (LLMs). Specifically, the LIMP framework includes the following key components: 1. **"Analyze-Abstract-Infer" (A2I) Agent Workflow**: This workflow guides LLMs to analyze salient features, abstract high-level insights, and ultimately infer the most likely intentions, simulating the reasoning process of human expert annotators. 2. **Efficient Fine-tuning Scheme**: This scheme transfers the reasoning capabilities of large commercial LLMs (e.g., GPT-4) to smaller-scale open-source language models (e.g., Llama 3), ensuring that LIMP can handle millions of mobility records while remaining cost-effective. 3. **Transformer-based Intention-aware Mobility Prediction Model**: This model effectively integrates the intention information inferred from LLMs to improve the accuracy of the next location prediction. Through evaluations on two real-world datasets, the LIMP framework significantly outperforms baseline models across multiple metrics, particularly excelling in the accuracy of next location prediction and the effectiveness of intention inference. This indicates that the LIMP framework has great potential in practical applications, especially in fields such as urban planning, traffic management, and public safety.