Abstract:With the rise of GeoAI research, streetscape imagery has received extensive attention due to its comprehensive coverage, abundant information, and accessibility. However, obtaining a holistic spatial–temporal scene representation is difficult because places are often composed of multiple images from different angles, times and locations. This problem also exists in other types of geo-tagged imagery. To solve it, we propose a purely visual, robust, and reliable method for urban function identification at the street scale. We introduce a method based on a two-layer spatially dependent graph neural network structure, which handles sequential street view imagery as input (typically available in services such as Google Street View, Baidu Maps, and Mapillary), with full consideration of the spatial dependencies among road networks. In this paper, we construct an urban topological map network using OpenStreetMap data in Wuhan, China, and compute a semantic representation of the scene as a whole at the street scale using a large-scale pre-trained model. We construct the graph network with streets as nodes based on 28,693 mapping relationships constructed from 75,628 street view images and 5,458 streets. Only 5.3% of the node labels were required to obtain 10 categories of functions for all nodes in the study area. The results demonstrate that by using appropriate spatial weights, street encoder, and graph structure, our novel method achieves high accuracy of P@1 46.2%, P@3 73.0%, P@5 82.4%, and P@10 89.9%, fully demonstrating the effectiveness of the introduced approach. We also use the model to sense urban spatial–temporal renewal by computing time series street images. The model is also applicable to the prediction of other attributes, where only a small number of labels are required to obtain valid and reliable scene perception results. The example data and code is shared at: https://github.com/yemanzhongting/Knowledge-and-Topology.

Enhancing public opinion monitoring for social hot events with a time series neural network-based logic map

Embedding and Predicting the Event at Early Stage

E-Map: A Visual Analytics Approach for Exploring Significant Event Evolutions in Social Media

The Identification and Analysis of the Centers of Geographical Public Opinions in Flood Disasters Based on Improved Naïve Bayes Network

Detecting Urban Events by Considering Long Temporal Dependency of Sentiment Strength in Geotagged Social Media Data

Event-Aware Multimodal Mobility Nowcasting

Social Media Event Prediction using DNN with Feedback Mechanism

Predicting Hot Events in the Early Period Through Bayesian Model for Social Networks

Calendar Graph Neural Networks for Modeling Time Structures in Spatiotemporal User Behaviors

Public Opinion Analysis Based on Probabilistic Topic Modeling and Deep Learning

Messages Are Never Propagated Alone: Collaborative Hypergraph Neural Network for Time-Series Forecasting.

STGSN — A Spatial–Temporal Graph Neural Network framework for time-evolving social networks

Time Series Forecasting Based on Complex Network Analysis

A Unified View on Neural Message Passing with Opinion Dynamics for Social Networks

An Analysis of Emotional Tendency Under the Network Public Opinion: Deep Learning

CEP3: Community Event Prediction with Neural Point Process on Graph

Mining Spatiotemporal Mobility Patterns Using Improved Deep Time Series Clustering

Modeling the Popularity of Events on Web by Sparsity and Mutual-Excitation Guided Graph Neural Network

Knowledge and topology: A two layer spatially dependent graph neural networks to identify urban functions with time-series street view image

Who Should I Engage with At What Time? A Missing Event Aware Temporal Graph Neural Network

Opinion Formation Forecasts in Social Networks: A Graph Convolutional Neural Network Approach