Abstract:The continual progression and expanding applications of hyperspectral image (HSI) technology necessitate the development of lightweight HSI classification models that are capable of lifelong learning. However, the computationally-demanding task of training and updating HSI classification models, exacerbated by the substantial number of trainable parameters in feature extractors, remains a substantial challenge. This article proposes an attention-based reservoir computing (ARC) model to overcome these hurdles. The ARC model utilizes a cross-slicing operation to generate multidirectional inputs, treating the HSI dataset as a spatial sequence for processing within a reservoir. For every target pixel, four spatial sequences from various directions are introduced into the reservoir, generating four corresponding outputs. A voting mechanism then evaluates these outputs to yield the final prediction. In addition, we design an attention-based leaky function for reservoir computing (RC) to capture the spatial correlation inherent in HSI data accurately. The attention-based leaky function enables the reservoir state to weigh less on the pixels outside the region of interest (ROI) and have a longer memory for pixels inside the ROI. The ARC was tested on widely used HSI datasets: Indian Pines, PaviaU, and Salinas. It demonstrated competitive lightweight classification performance against state-of-the-art lightweight models by maintaining comparable training time while achieving superior accuracy. Furthermore, the model's lifelong learning accuracy also showed superior performance compared to existing lifelong learning models, with a one thousand times reduction of parameter-to-be-updated. This work makes the ARC model an effective contender for HSI classification tasks, excelling in both lightweight classification and lifelong learning capacities. The source codes are available publicly at: https://github.com/Waterman-Ann/ARC.

Do We Need Learnable Classifiers? A Hyperspectral Image Classification Algorithm Based on Attention-Enhanced ResBlock-in-ResBlock and ETF Classifier

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

ReSC-net: Hyperspectral Image Classification Based on Attention-Enhanced Residual Module and Spatial-Channel Attention

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Objective evaluation-based efficient learning framework for hyperspectral image classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

A Joint Network of Edge-Aware and Spectral–Spatial Feature Learning for Hyperspectral Image Classification

Hyperspectral image classification based on spectral and spatial information using ResNet with channel attention

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism

A Universal Knowledge Embedded Contrastive Learning Framework for Hyperspectral Image Classification

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN

Spatial–Spectral Split Attention Residual Network for Hyperspectral Image Classification

Lightweight and Lifelong Hyperspectral Image Classification via Attention-Based Reservoir Computing

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Hyperspectral image classification using spectral-spatial LSTMs

Deep Learning for Hyperspectral Image Classification: An Overview