Abstract:Street-view imagery has been densely covering cities. They provide a close-up perspective of the urban physical environment, allowing a comprehensive perception and understanding of cities. There has been a significant amount of effort to represent the urban physical environment based on street view imagery, and this representation has been utilized to study the relationships between the physical environment, human dynamics, and socioeconomic environments. However, there are two key challenges in representing the urban physical environment of streets based on street-view images for downstream tasks. First, current research mainly focuses on the proportions of visual elements within the scene, neglecting the spatial adjacency between them. Second, the spatial dependency and spatial interaction between streets have not been adequately accounted for. These limitations hinder the effective representation and understanding of urban streets. To address these challenges, we propose a dynamic graph representation framework based on dual spatial semantics. At the intra-street level, we consider the spatial adjacency relationships of visual elements. Our method dynamically parses visual elements within the scene, achieving context-specific representations. At the inter-street level, we construct two spatial weight matrices by integrating the spatial dependency and the spatial interaction relationships. It could account for the hybrid spatial relationships between streets comprehensively, enhancing the model's ability to represent human dynamics and socioeconomic status. Furthermore, aside from these two modules, we also provide a spatial interpretability analysis tool for downstream tasks. A case study of our research framework shows that our method improves vehicle speed and flow estimation by 2.4% and 6.4%, respectively. This not only indicates that street-view imagery provides rich information about urban transportation but also offers a more accurate and reliable data-driven framework for urban studies. The code is available at: (https://github.com/yemanzhongting/HybridGraph).

A shape-based heuristic for the detection of urban block artifacts in street networks

A graph-based algorithm to define urban topology from unstructured geospatial data

A distance-based tool-set to track inconsistent urban structures through complex-networks

Novel Framework for 3D Road Extraction Based on Airborne LiDAR and High-Resolution Remote Sensing Imagery

Untangling urban data signatures: unsupervised machine learning methods for the detection of urban archetypes at the pedestrian scale

Towards Detecting Building Facades with Graffiti Artwork Based on Street View Images

Towards the automated large-scale reconstruction of past road networks from historical maps

Network-scape metric analysis: a new approach for the pattern analysis of urban road networks

A Human-Centered Evaluation of Street Attractiveness: a Methodological Innovation Integrating Multi-Sourced Urban Data

Machine learning-based characterisation of urban morphology with the street pattern

Automated Plane Detection and Extraction from Airborne Laser Scanning Data of Dense Urban Areas

A typology of street patterns

Multi-level Urban Street Representation with Street-View Imagery and Hybrid Semantic

Knowledge and topology: A two layer spatially dependent graph neural networks to identify urban functions with time-series street view image

Planarity and Street Network Representation in Urban Form Analysis

An Approach for Simulating the Street Spatial Patterns

A topography-aware approach to the automatic generation of urban road networks

Studying Geometric Graph Properties of Road Networks Through an Algorithmic Lens

A topology-based approach to identifying urban centers in America using multi-source geospatial big data

StreetGen : In base city scale procedural generation of streets: road network, road surface and street objects

Urban visual intelligence: Uncovering hidden city profiles with street view images