Abstract:Street-view imagery has been densely covering cities. They provide a close-up perspective of the urban physical environment, allowing a comprehensive perception and understanding of cities. There has been a significant amount of effort to represent the urban physical environment based on street view imagery, and this representation has been utilized to study the relationships between the physical environment, human dynamics, and socioeconomic environments. However, there are two key challenges in representing the urban physical environment of streets based on street-view images for downstream tasks. First, current research mainly focuses on the proportions of visual elements within the scene, neglecting the spatial adjacency between them. Second, the spatial dependency and spatial interaction between streets have not been adequately accounted for. These limitations hinder the effective representation and understanding of urban streets. To address these challenges, we propose a dynamic graph representation framework based on dual spatial semantics. At the intra-street level, we consider the spatial adjacency relationships of visual elements. Our method dynamically parses visual elements within the scene, achieving context-specific representations. At the inter-street level, we construct two spatial weight matrices by integrating the spatial dependency and the spatial interaction relationships. It could account for the hybrid spatial relationships between streets comprehensively, enhancing the model's ability to represent human dynamics and socioeconomic status. Furthermore, aside from these two modules, we also provide a spatial interpretability analysis tool for downstream tasks. A case study of our research framework shows that our method improves vehicle speed and flow estimation by 2.4% and 6.4%, respectively. This not only indicates that street-view imagery provides rich information about urban transportation but also offers a more accurate and reliable data-driven framework for urban studies. The code is available at: (https://github.com/yemanzhongting/HybridGraph).

Visual-perception-driven Urban Three-dimensional Scene Data Scheduling Method

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Perception-motivated Visualization for 3D City Scenes.

3D urban landscape rendering and optimization algorithm for smart city

Real-time Visualization of Urban with Gigantic Amount of Detailed Buildings

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

A Method on City 3D Visualization on Internet

A Processing and Scheduling Method for Vector Rendering in Global 3D GIS

Data Caching and Scheduling Algorithm in 3-D Terrain Visualization

Optimization of the Virtual Scene Layout Based on the Optimal 3D Viewpoint

Constructing rules and scheduling technology for 3D building models

Selective Scene Transfer in Web Based Real-Time Graphic Applications

Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior

Rendering of Virtual Environments Based on Polygonal & Point-Based Models

Research on 3D Visualization of Real Scene in Subway Engineering Based on 3D Model

An Efficient Graph-Based Spatio-Temporal Indexing Method for Task-Oriented Multi-Modal Scene Data Organization

Interactive Expressive Illustration of 3D City Scenes

3D Traffic Scenes Construction and Simulation Based on Scene Stages

Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization

Multi-level Urban Street Representation with Street-View Imagery and Hybrid Semantic

Method for Geometric Data Management and Real-time Rendering of Large-scale Forest Scene