Abstract:Target detection based on hyperspectral images refers to the integrated use of spatial information and spectral information to accomplish the task of localization and identification of targets. There are two main methods for hyperspectral target detection: supervised and unsupervised methods. Supervision method refers to the use of spectral differences between the target to be tested and the surrounding background to identify the target when the target spectrum is known. In ideal situations, supervised object detection algorithms perform better than unsupervised algorithms. However, the current supervised object detection algorithms mainly have two problems: firstly, the impact of uncertainty in the ground object spectrum, and secondly, the universality of the algorithm is poor. A hyperspectral target detection framework based on 3D–2D CNN and transfer learning was proposed to solve the problems of traditional supervised methods. This method first extracts multi-scale spectral information and then preprocesses hyperspectral images using multiple spectral similarity measures. This method not only extracts spectral features in advance, but also eliminates the influence of complex environments to a certain extent. The preprocessed feature maps are used as input for 3D–2D CNN to deeply learn the features of the target, and then, the softmax method is used to output and obtain the detection results. The framework draws on the ideas of integrated learning and transfer learning, solves the spectral uncertainty problem with the combined similarity measure and depth feature extraction network, and solves the problem of poor robustness of traditional algorithms by model migration and parameter sharing. The area under the ROC curve of the proposed method has been increased to over 0.99 in experiments on both publicly available remote sensing hyperspectral images and measured land-based hyperspectral images. The availability and stability of the proposed method have been demonstrated through experiments. A feasible approach has been provided for the development and application of specific target detection technology in hyperspectral images under different backgrounds in the future.

Unsupervised Deep Hyperspectral Video Target Tracking and High Spectral-Spatial-Temporal Resolution (H³ Benchmark Dataset

SiamHYPER: Learning a Hyperspectral Object Tracker from an RGB-Based Tracker

An Anchor-Free Siamese Target Tracking Network for Hyperspectral Video.

Spectral-Spatial-Temporal Attention Network for Hyperspectral Tracking.

SiamOHOT: A Lightweight Dual Siamese Network for Onboard Hyperspectral Object Tracking Via Joint Spatial-Spectral Knowledge Distillation

Learning a Deep Ensemble Network with Band Importance for Hyperspectral Object Tracking.

Hyperspectral Video Target Tracking based on Pixel-wise Spectral Matching Reduction and Deep Spectral Cascading Texture Features

Hyperspectral Attention Network for Object Tracking

SSTtrack: A Unified Hyperspectral Video Tracking Framework via Modeling Spectral-Spatial-Temporal Conditions

Hyperspectral Video Tracker Based on Spectral Deviation Reduction and a Double Siamese Network

Bae-Net: A Band Attention Aware Ensemble Network For Hyperspectral Object Tracking

Hyperspectral low altitude UAV target tracking algorithm based on deep learning and improved KCF

HHTrack: Hyperspectral Object Tracking Using Hybrid Attention

Material Based Object Tracking in Hyperspectral Videos: Benchmark and Algorithms

BihoT: A Large-Scale Dataset and Benchmark for Hyperspectral Camouflaged Object Tracking

Transformer-Based Band Regrouping With Feature Refinement for Hyperspectral Object Tracking

Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline

Exploring an application-oriented land-based hyperspectral target detection framework based on 3D–2D CNN and transfer learning

Hyperspectral Target Detection via Spectral Aggregation and Separation Network With Target Band Random Mask

WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets for hyperspectral image classification

SSF-Net: Spatial-Spectral Fusion Network with Spectral Angle Awareness for Hyperspectral Object Tracking