Abstract:Effectively and efficiently retrieving images from remote sensing databases is a critical challenge in the realm of remote sensing big data. Utilizing hand-drawn sketches as retrieval inputs offers intuitive and user-friendly advantages, yet the potential of multi-level feature integration from sketches remains underexplored, leading to suboptimal retrieval performance. To address this gap, our study introduces a novel zero-shot, sketch-based retrieval method for remote sensing images, leveraging multi-level feature extraction, self-attention-guided tokenization and filtering, and cross-modality attention update. This approach employs only vision information and does not require semantic knowledge concerning the sketch and image. It starts by employing multi-level self-attention guided feature extraction to tokenize the query sketches, as well as self-attention feature extraction to tokenize the candidate images. It then employs cross-attention mechanisms to establish token correspondence between these two modalities, facilitating the computation of sketch-to-image similarity. Our method significantly outperforms existing sketch-based remote sensing image retrieval techniques, as evidenced by tests on multiple datasets. Notably, it also exhibits robust zero-shot learning capabilities and strong generalizability in handling unseen categories and novel remote sensing data. The method's scalability can be further enhanced by the pre-calculation of retrieval tokens for all candidate images in a database. This research underscores the significant potential of multi-level, attention-guided tokenization in cross-modal remote sensing image retrieval. For broader accessibility and research facilitation, we have made the code and dataset used in this study publicly available online. Code and dataset are available at

Mental Retrieval of Remote Sensing Images Via Adversarial Sketch-Image Feature Learning

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

SceneSketcher-v2: Fine-Grained Scene-Level Sketch-Based Image Retrieval Using Adaptive GCNs

Mental Retrieval Of Large-Scale Satellite Images Via Learned Sketch-Image Deep Features

Sketch Based Image Retrieval Via Image-Aided Cross Domain Learning

Instance-Level Coupled Subspace Learning for Fine-Grained Sketch-Based Image Retrieval.

Scene-level Sketch-Based Image Retrieval with Minimal Pairwise Supervision

Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval.

A Novel Visual-Region-Descriptor-based Approach to Sketch-based Image Retrieval

Multi-colour Sketch-Based Image Retrieval with an Explicable Feature Embedding

Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval.

Zero-Shot Sketch-Based Remote-Sensing Image Retrieval Based on Multi-Level and Attention-Guided Tokenization

Enhancing Sketch-Based Image Retrieval Via Deep Discriminative Representation.

Retrieving Aerial Scene Images with Learned Deep Image-Sketch Features

Zero-shot sketch-based remote sensing image retrieval based on multi-level and attention-guided tokenization

Sketch Me That Shoe

Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval

Sketch-Based Aerial Image Retrieval

A Three-Layered Graph-Based Learning Approach for Remote Sensing Image Retrieval.

Dark-Aware Network for Fine-Grained Sketch-Based Image Retrieval

Single Color Sketch-Based Image Retrieval in HSV Color Space