Abstract:Spatial scene similarity plays a crucial role in spatial cognition, as it enables us to understand and compare different spatial scenes and their relationships. However, understanding spatial scenes is a complex task. While existing literature has contributed to spatial scene representation learning, these methods primarily focus on comprehending the spatial relationships among objects, often neglecting their semantic features. Furthermore, there is a lack of scene representation learning methods that can seamlessly handle different types of spatial objects (e.g., points, polylines, and polygons) in a scene. Moreover, since expert knowledge is required for the annotation process of spatial scene understanding, publicly available high-quality annotation data has a limited size which usually leads to suboptimal results. To address these issues, we propose a novel multi-scale spatial scene encoding model called SpatialScene2Vec. SpatialScene2Vec utilizes a point location encoder to seamlessly encode the spatial information of different types of spatial objects. A point feature encoder is employed to encode the semantic features of these objects. A spatial scene embedding is generated by integrating the spatial embeddings and feature embeddings of spatial objects within this scene. Furthermore, to address the limited labeled data problem, we propose a self-supervised learning framework to train the SpatialScene2Vec model in which a contrastive loss is used for spatial scene similarity evaluation. In addition, we introduce a novel spatial scene data augmentation method to generate positive scene augmentations by leveraging the unique characteristics of spatial scenes and random sampling points based on the shapes of polyline/polygon objects within the current spatial scenes. We conduct experiments on real-world datasets for spatial scene retrieval tasks, including vector data types of points, polylines, and polygons. Results show that SpatialScene2Vec outperforms well-established encoding methods such as Space2Vec due to the advantages of the integrated multi-scale representations and the proposed spatial scene data augmentation method, with significant improvements and robustness.

Spatial Scene Similarity Assessment Based on Deep Learning

DeepSSN: A deep convolutional neural network to assess spatial scene similarity

SpatialScene2Vec: A self-supervised contrastive representation learning method for spatial scene similarity evaluation

A Behaviorally Evidence-based Method for Computing Spatial Comparisons of Image Scenarios

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Study on Spatial Geometric Similarity Based on Conformal Geometric Algebra.

Multi-feature based spatial scene matching model and its application

Spatial Information Considered Network for Scene Classification

Semantic Scene Mapping with Spatio-temporal Deep Neural Network for Robotic Applications

Decoupling Semantic Similarity from Spatial Alignment for Neural Networks

Scene-Aware Deep Networks for Semantic Segmentation of Images.

Exploring Deep 3D Spatial Encodings for Large-Scale 3D Scene Understanding

Research On Spatial Transformation In Image Based On Deep Learning

Scene Categorization by Deeply Learning Gaze Behavior in a Semisupervised Context

Spatial-Content Image Search In Complex Scenes

Image Retrieval by Geological Proximity Using Deep Neural Network.

Spatial Scenes Matching with on Relaxation Labeling Approach

Learning Region Similarities via Graph-based Deep Metric Learning

A Novel Approach for Scene Classification from Remote Sensing Images Using Deep Learning Methods

Semantic-embedded Similarity Prototype for Scene Recognition

Model2Scene: Learning 3D Scene Representation via Contrastive Language-CAD Models Pre-training