Abstract:Recently, Hyperspectral Image (HSI) classification methods based on Transformers have developed rapidly. However, these methods still face challenges in handling the widely varying scales and diverse spatial distribution patterns commonly found in HSI. To address these issues, this paper proposes a simple yet novel HSI classification framework named the Spectral View Attention Transformer (SVAFormer). Built on the Transformer mechanism, this framework enhances the integration of spectral and spatial features by allowing the Spectral Token, corresponding to the pixel to be classified, to access spatial neighborhood information from multiple perspectives and levels. Specifically, the framework employs random masking techniques to provide Spectral Tokens with spatial neighborhood information from different viewpoints, enabling the model to handle diverse land-cover distribution patterns. Additionally, the framework introduces a Spectral Token Aware Pooling Layer between adjacent Transformer Blocks, which preserves the central role of Spectral Tokens while progressively expanding the spatial scale represented by each token. This reduces the Transformer’s focus on spatially fragmented information and enables Spectral Tokens to concentrate on spatial neighborhood information at various levels and scales. The key characteristic of this framework is its ability to effectively handle land-cover features of different scales and shapes by strengthening the fusion of spectral and spatial characteristics. Experimental results on multiple public datasets demonstrate that our framework outperforms previous state-of-the-art methods. For the sake of reproducibility, the source code of SVAFormer will be publicly available at https://github.com/chenning0115/SVAFormer.

Harnessing the Power of SVD: an SVA Module for Enhanced Signal Classification

Accelerate Training By Dwt In Speaker Identification Using Svms

Audio-Visual Speech Enhancement with Deep Multi-modality Fusion

Support Vector Data Description with Model Selection for Condition Monitoring

Unraveling Complexity: an Exploration into the Large-Scale Multi-Modal Signal Processing

sVAD: A Robust, Low-Power, and Light-Weight Voice Activity Detection with Spiking Neural Networks

VAE-based Deep SVDD for anomaly detection

An Attention Based Speaker-Independent Audio-Visual Deep Learning Model for Speech Enhancement

VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention

An Interpretable Explanation Approach for Signal Modulation Classification

Sparse Attention Vectors: Generative Multimodal Model Features Are Discriminative Vision-Language Classifiers

SVAFormer: Integrating Random and Hierarchical Spectral View Attention for Hyperspectral Image Classification

Boosting VLAD with Supervised Dictionary Learning and High-Order Statistics.

Improving the Classification Effectiveness of Intrusion Detection by Using Improved Conditional Variational AutoEncoder and Deep Neural Network

VSCA: A Sentence Matching Model Incorporating Visual Perception

Signal-Transformer: A robust and interpretable method for rotating machinery intelligent fault diagnosis under variable operating conditions

MVL-Tra: Multi-view LFM signal source classification using Transformer

Speech enhancement aided end-to-end multi-task learning for voice activity detection

SVVAD: Personal Voice Activity Detection for Speaker Verification

Enhance Via Decoupling - Improving Multi-Label Classifiers with Variational Feature Augmentation.

Anomaly detection using improved deep SVDD model with data structure preservation