Abstract:As cities continue to burgeon, Urban Computing emerges as a pivotal discipline for sustainable development by harnessing the power of cross-domain data fusion from diverse sources (e.g., geographical, traffic, social media, and environmental data) and modalities (e.g., spatio-temporal, visual, and textual modalities). Recently, we are witnessing a rising trend that utilizes various deep-learning methods to facilitate cross-domain data fusion in smart cities. To this end, we propose the first survey that systematically reviews the latest advancements in deep learning-based data fusion methods tailored for urban computing. Specifically, we first delve into data perspective to comprehend the role of each modality and data source. Secondly, we classify the methodology into four primary categories: feature-based, alignment-based, contrast-based, and generation-based fusion methods. Thirdly, we further categorize multi-modal urban applications into seven types: urban planning, transportation, economy, public safety, society, environment, and energy. Compared with previous surveys, we focus more on the synergy of deep learning methods with urban computing applications. Furthermore, we shed light on the interplay between Large Language Models (LLMs) and urban computing, postulating future research directions that could revolutionize the field. We firmly believe that the taxonomy, progress, and prospects delineated in our survey stand poised to significantly enrich the research community. The summary of the comprehensive and up-to-date paper list can be found at <a class="link-external link-https" href="https://github.com/yoshall/Awesome-Multimodal-Urban-Computing" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to systematically review and summarize the latest advancements in cross-domain data fusion in urban computing using deep learning. Specifically: 1. **Importance of Cross-Domain Data Fusion**: - With the acceleration of urbanization, urban computing has become a critical field that addresses sustainable development issues by integrating data from different sources (such as geographic, traffic, social media, environmental, etc.) and modalities (such as spatiotemporal, visual, textual, etc.). - Cross-domain data fusion is crucial for solving various urban challenges (such as traffic congestion, energy consumption, environmental pollution, etc.). 2. **Shortcomings of Existing Research**: - Previous research has mainly focused on traditional machine learning methods, but the rise of deep learning technologies in recent years has rendered these traditional methods less applicable. - Existing review literature has failed to comprehensively cover the latest data fusion methods and technologies, especially new paradigms like contrastive learning and generative learning. 3. **Proposed New Review Framework**: - A new classification system is proposed to systematically organize existing research from three dimensions: data sources, fusion methods, and application scenarios. - Data Sources: Including geographic data, traffic data, social media data, demographic data, and environmental data. - Fusion Methods: Divided into feature-based, alignment-based, contrastive-based, and generative-based fusion methods. - Application Scenarios: Covering urban planning, transportation, economy, public safety, society, environment, and energy fields. 4. **Future Research Directions**: - The potential application of large language models (LLMs) in urban computing is explored, and several future research directions are proposed, such as data privacy protection, open benchmark testing, application diversification, and efficiency optimization. Through this review, the authors hope to provide researchers and relevant stakeholders with a comprehensive and updated resource to promote the development of the urban computing field.

Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook

A Survey on an Emerging Area: Deep Learning for Smart City Data

Urban big data fusion based on deep learning: An overview.

Deep Learning for LiDAR-only and LiDAR-fusion 3D Perception: a Survey

Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Review

A Comprehensive Survey on Deep Learning Multi-Modal Fusion: Methods, Technologies and Applications

A Survey of Data Fusion in Smart City Applications

Research on the Application and Challenges of Deep Learning in Urban Big Data Fusion

Multi-Modal 3D Object Detection in Autonomous Driving: A Survey

Deep learning application in smart cities: recent development, taxonomy, challenges and research prospects

Enhancing Transportation Systems Via Deep Learning: A Survey

AI and Deep Learning for Urban Computing

Deep learning-based remote and social sensing data fusion for urban region function recognition

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

A Survey on Deep Learning for Multimodal Data Fusion

AI-Based Sensor Information Fusion for Supporting Deep Supervised Learning

Geospatial Data Fusion: Combining Lidar, SAR, and Optical Imagery with AI for Enhanced Urban Mapping

Deep Spatio-Temporal Multiple Domain Fusion Network for Urban Anomalies Detection

Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review

Multi-modal 3D Object Detection in Autonomous Driving: A Survey and Taxonomy