Abstract:With the rise of GeoAI research, streetscape imagery has received extensive attention due to its comprehensive coverage, abundant information, and accessibility. However, obtaining a holistic spatial–temporal scene representation is difficult because places are often composed of multiple images from different angles, times and locations. This problem also exists in other types of geo-tagged imagery. To solve it, we propose a purely visual, robust, and reliable method for urban function identification at the street scale. We introduce a method based on a two-layer spatially dependent graph neural network structure, which handles sequential street view imagery as input (typically available in services such as Google Street View, Baidu Maps, and Mapillary), with full consideration of the spatial dependencies among road networks. In this paper, we construct an urban topological map network using OpenStreetMap data in Wuhan, China, and compute a semantic representation of the scene as a whole at the street scale using a large-scale pre-trained model. We construct the graph network with streets as nodes based on 28,693 mapping relationships constructed from 75,628 street view images and 5,458 streets. Only 5.3% of the node labels were required to obtain 10 categories of functions for all nodes in the study area. The results demonstrate that by using appropriate spatial weights, street encoder, and graph structure, our novel method achieves high accuracy of P@1 46.2%, P@3 73.0%, P@5 82.4%, and P@10 89.9%, fully demonstrating the effectiveness of the introduced approach. We also use the model to sense urban spatial–temporal renewal by computing time series street images. The model is also applicable to the prediction of other attributes, where only a small number of labels are required to obtain valid and reliable scene perception results. The example data and code is shared at: https://github.com/yemanzhongting/Knowledge-and-Topology.

KnowSite: Leveraging Urban Knowledge Graph for Site Selection.

Knowledge-driven Site Selection Via Urban Knowledge Graph

Structured Knowledge Base As Prior Knowledge To Improve Urban Data Analysis

Location Based Link Prediction for Knowledge Graph

UrbanKG: An Urban Knowledge Graph System

Hierarchical Knowledge Graph Learning Enabled Socioeconomic Indicator Prediction in Location-Based Social Network

Improving Location Recommendation with Urban Knowledge Graph

NeuralKG: an Open Source Library for Diverse Representation Learning of Knowledge Graphs

CrowdGeoKG: Crowdsourced Geo-Knowledge Graph

PKGM: A Pre-trained Knowledge Graph Model for E-commerce Application

Large Scale Pre-Trained Knowledge Graph Model and E-Commerce Application

Geometric Feature Enhanced Knowledge Graph Embedding and Spatial Reasoning

Developing Knowledge Graph Based System for Urban Computing

Know, Know Where, Knowwheregraph: A Densely Connected, Cross-Domain Knowledge Graph and Geo-Enrichment Service Stack for Applications in Environmental Intelligence

Knowledge and topology: A two layer spatially dependent graph neural networks to identify urban functions with time-series street view image

RouteKG: A knowledge graph-based framework for route prediction on road networks

Urban Knowledge Graph Aided Mobile User Profiling

GIS Enabled Service Site Selection: Environmental Analysis and Beyond

Knowledge Graph semantic enhancement of input data for improving AI

A Semantic-Spatial Aware Data Conflation Approach for Place Knowledge Graphs

SEEK: Segmented Embedding of Knowledge Graphs