Abstract:The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model heterogeneous LBSN data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs) in commonsense reasoning, embedding, and multi-agent collaboration, in this work, we synergize LLM agents and knowledge graph for socioeconomic prediction. We first construct a location-based knowledge graph (LBKG) to integrate multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to identify relevant meta-paths in the LBKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged for better socioeconomic prediction. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.

Estimating Socioeconomic Proxy Variables Using Multimodal Deep Learning Models

Predicting Multi-level Socioeconomic Indicators from Structural Urban Imagery

A multi-glimpse deep learning architecture to estimate socioeconomic census metrics in the context of extreme scope variance

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Combining satellite imagery and machine learning to predict poverty

Learning Economic Indicators by Aggregating Multi-Level Geospatial Information

MuseCL: Predicting Urban Socioeconomic Indicators via Multi-Semantic Contrastive Learning

A multimodal fusion framework for urban scene understanding and functional identification using geospatial data

An Investigation on Deep Learning Approaches to Combining Nighttime and Daytime Satellite Imagery for Poverty Prediction

Predicting household socioeconomic position in Mozambique using satellite and household imagery

Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN

Poverty rate prediction using multi-modal survey and earth observation data

Multimodal deep learning for finance: integrating and forecasting international stock markets

Using satellites and artificial intelligence to measure health and material-living standards in India

Predicting Socio-Economic Levels of Urban Regions Via Offline and Online Indicators

Deep hybrid model with satellite imagery: how to combine demand modeling and computer vision for behavior analysis?

Transfer Learning from Deep Features for Remote Sensing and Poverty Mapping

Scalable multimodal assessment of the micro-neighborhood using orthogonal visual inputs

Estimating Socioeconomic Status via Temporal-Spatial Mobility Analysis -- A Case Study of Smart Card Data

Heterogeneous Sensor Data Fusion by Deep Multimodal Encoding

A Multimodal Data Fusion Model for Accurate and Interpretable Urban Land Use Mapping with Uncertainty Analysis