Abstract:Transformer has been widely applied in image processing tasks as a substitute for convolutional neural networks (CNNs) for feature extraction due to its superiority in global context modeling and flexibility in model generalization. However, the existing transformer-based methods for semantic segmentation of remote sensing (RS) images are still with several limitations, which can be summarized into two main aspects: 1) the transformer encoder is generally combined with CNN-based decoder, leading to inconsistency in feature representations; and 2) the strategies for global and local context information utilization are not sufficiently effective. Therefore, in this article, a global-local transformer segmentor (GLOTS) framework is proposed for the semantic segmentation of RS images to acquire consistent feature representations by adopting transformers for both encoding and decoding, in which a masked image modeling (MIM) pretrained transformer encoder is adopted to learn semantic-rich representations of input images and a multiscale global-local transformer decoder is designed to fully exploit the global and local features. Specifically, the transformer decoder uses a feature separation-aggregation module (FSAM) to utilize the feature adequately at different scales and adopts a global-local attention module (GLAM) containing global attention block (GAB) and local attention block (LAB) to capture the global and local context information, respectively. Furthermore, a learnable progressive upsampling strategy (LPUS) is proposed to restore the resolution progressively, which can flexibly recover the fine-grained details in the upsampling process. The experiment results on the three benchmark RS datasets demonstrate that the proposed GLOTS is capable of achieving better performance with some state-of-the-art methods, and the superiority of the proposed framework is also verified by ablation studies. The code will be available at https://github.com/lyhnsn/GLOTS.

TransOSV: Offline Signature Verification with Transformers

TransVOS: Video Object Segmentation with Transformers

2C2S: A two-channel and two-stream transformer based framework for offline signature verification

DeepHSV: User-Independent Offline Signature Verification Using Two-Channel CNN

Writer-independent online signature verification based on 2D representation of time series data using triplet supervised network

Cut and Compare: End-to-end Offline Signature Verification Network

Exploring Transformers for On-Line Handwritten Signature Verification

Vision Graph Convolutional Network for Writer-Independent Offline Signature Verification

SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification

Rethinking Transformers for Semantic Segmentation of Remote Sensing Images.

Adaptive Spatial Tokenization Transformer for Salient Object Detection in Optical Remote Sensing Images.

Relative position matrix and multi-scale feature fusion for writer-independent online signature verification

Leveraging Expert Models for Training Deep Neural Networks in Scarce Data Domains: Application to Offline Handwritten Signature Verification

Attention-based Multiple Siamese Networks with Primary Representation Guiding for Offline Signature Verification

Multi-Path Siamese Convolution Network for Offline Handwritten Signature Verification

Offline Signature Verification Based on Feature Disentangling Aided Variational Autoencoder

Pre-training-driven Multimodal Boundary-aware Vision Transformer

Active Transfer Learning for Persian Offline Signature Verification

A Vision Transformer Architecture for Open Set Recognition

Reperceive Global Vision of Transformer for Remote Sensing Images Weakly Supervised Object Localization

Transformer Transforms Salient Object Detection and Camouflaged Object Detection