Abstract:Street-view imagery has been densely covering cities. They provide a close-up perspective of the urban physical environment, allowing a comprehensive perception and understanding of cities. There has been a significant amount of effort to represent the urban physical environment based on street view imagery, and this representation has been utilized to study the relationships between the physical environment, human dynamics, and socioeconomic environments. However, there are two key challenges in representing the urban physical environment of streets based on street-view images for downstream tasks. First, current research mainly focuses on the proportions of visual elements within the scene, neglecting the spatial adjacency between them. Second, the spatial dependency and spatial interaction between streets have not been adequately accounted for. These limitations hinder the effective representation and understanding of urban streets. To address these challenges, we propose a dynamic graph representation framework based on dual spatial semantics. At the intra-street level, we consider the spatial adjacency relationships of visual elements. Our method dynamically parses visual elements within the scene, achieving context-specific representations. At the inter-street level, we construct two spatial weight matrices by integrating the spatial dependency and the spatial interaction relationships. It could account for the hybrid spatial relationships between streets comprehensively, enhancing the model's ability to represent human dynamics and socioeconomic status. Furthermore, aside from these two modules, we also provide a spatial interpretability analysis tool for downstream tasks. A case study of our research framework shows that our method improves vehicle speed and flow estimation by 2.4% and 6.4%, respectively. This not only indicates that street-view imagery provides rich information about urban transportation but also offers a more accurate and reliable data-driven framework for urban studies. The code is available at: (https://github.com/yemanzhongting/HybridGraph).

Extracting map information from trajectory and social media data

A User Study on the Capability of Three Geo-Based Features in Analyzing and Locating Trajectories

Mining Trajectory Data and Geotagged Data in Social Media for Road Map Inference.

Integrated Use of Spatial and Semantic Relationships for Extracting Road Networks from Floating Car Data

Exploring Multi-Scale Spatiotemporal Twitter User Mobility Patterns with A Visual-Analytics Approach

Social Media Meets Big Urban Data: A Case Study of Urban Waterlogging Analysis

Inferring Demographics from Human Trajectories and Geographical Context.

From Taxi Gps Traces to Social and Community Dynamics: A Survey

An Automatic Road Network Construction Method Using Massive GPS Trajectory Data

Big Trajectory Data Mining: A Survey of Methods, Applications, and Services

A Scalable Framework for Spatiotemporal Analysis of Location-based Social Media Data

Geoinformation Harvesting from Social Media Data: A Community Remote Sensing Approach

Interactive Visual Discovering of Movement Patterns from Sparsely Sampled Geo-tagged Social Media Data.

A Map-matching Algorithm with Extraction of Multi-group Information for Low-frequency Data

A New Approach To Urban Road Extraction Using High-Resolution Aerial Image

Multi-level Urban Street Representation with Street-View Imagery and Hybrid Semantic

Regions are Who Walk Them: a Large Pre-trained Spatiotemporal Model Based on Human Mobility for Ubiquitous Urban Sensing

Understanding People Lifestyles: Construction of Urban Movement Knowledge Graph from GPS Trajectory

A framework to detect and understand thematic places of a city using geospatial data

Extraction and Analysis of City's Tourism Districts Based on Social Media Data

MovementFinder: Visual analytics of origin-destination patterns from geo-tagged social media