Abstract:Street-view imagery has been densely covering cities. They provide a close-up perspective of the urban physical environment, allowing a comprehensive perception and understanding of cities. There has been a significant amount of effort to represent the urban physical environment based on street view imagery, and this representation has been utilized to study the relationships between the physical environment, human dynamics, and socioeconomic environments. However, there are two key challenges in representing the urban physical environment of streets based on street-view images for downstream tasks. First, current research mainly focuses on the proportions of visual elements within the scene, neglecting the spatial adjacency between them. Second, the spatial dependency and spatial interaction between streets have not been adequately accounted for. These limitations hinder the effective representation and understanding of urban streets. To address these challenges, we propose a dynamic graph representation framework based on dual spatial semantics. At the intra-street level, we consider the spatial adjacency relationships of visual elements. Our method dynamically parses visual elements within the scene, achieving context-specific representations. At the inter-street level, we construct two spatial weight matrices by integrating the spatial dependency and the spatial interaction relationships. It could account for the hybrid spatial relationships between streets comprehensively, enhancing the model's ability to represent human dynamics and socioeconomic status. Furthermore, aside from these two modules, we also provide a spatial interpretability analysis tool for downstream tasks. A case study of our research framework shows that our method improves vehicle speed and flow estimation by 2.4% and 6.4%, respectively. This not only indicates that street-view imagery provides rich information about urban transportation but also offers a more accurate and reliable data-driven framework for urban studies. The code is available at: (https://github.com/yemanzhongting/HybridGraph).

Collaboratively Modeling Buildings from Large-Scale Street-Side and Remote Sensing Images

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Integrating geospatial data and street‐view imagery to reconstruct large‐scale 3D urban building models

Modeling Of Buildings For Collaborative Design In A Virtual Environment

Multi-Drone Collaborative Trajectory Optimization for Large-Scale Aerial 3D Scanning

Efficient Modeling and Real-Time Rendering of Massive Urban Pipelines Based on GPU

Procedural Modeling of Urban Zone by Optimization

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

Building-Road Collaborative Extraction from Remote Sensing Images via Cross-Task and Cross-Scale Interaction

Automated 3D Building Modeling Based on Urban Aerial Stereopair

Research on Construction of Large-Scale 3D City Models Based on Skyline Prototype System

Research on modeling 3D building technology

Intelligent City 3D Modeling Model Based on Multisource Data Point Cloud Algorithm

Collaborative 3D Scene Reconstruction in Large Outdoor Environments Using a Fleet of Mobile Ground Robots

Fast Building Instance Proxy Reconstruction for Large Urban Scenes

Fusing Spaceborne Sar Interferometry And Street View Images For 4d Urban Modeling

City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

An unsupervised, open-source workflow for 2D and 3D building mapping from airborne LiDAR data

On procedural urban digital twin generation and visualization of large scale data

Multi-level Urban Street Representation with Street-View Imagery and Hybrid Semantic

A Comprehensive Automated 3D Approach for Building Extraction, Reconstruction, and Regularization from Airborne Laser Scanning Point Clouds