Abstract:Hyperspectral salient object detection (HSOD) aims to detect spectrally salient objects in hyperspectral images (HSIs). However, existing methods inadequately utilize spectral information by either converting HSIs into false-color images or converging neural networks with clustering. We propose a novel approach that fully leverages the spectral characteristics by extracting two distinct frequency components from the spectrum: low-frequency Spectral Saliency and high-frequency Spectral Edge. The Spectral Saliency approximates the region of salient objects, while the Spectral Edge captures edge information of salient objects. These two complementary components, crucial for HSOD, are derived by computing from the inter-layer spectral angular distance of the Gaussian pyramid and the intra-neighborhood spectral angular gradients, respectively. To effectively utilize this dual-frequency information, we introduce a novel lightweight Spectrum-driven Mixed-frequency Network (SMN). SMN incorporates two parameter-free plug-and-play operators, namely Spectral Saliency Generator and Spectral Edge Operator, to extract the Spectral Saliency and Spectral Edge components from the input HSI independently. Subsequently, the Mixed-frequency Attention module, comprised of two frequency-dependent heads, intelligently combines the embedded features of edge and saliency information, resulting in a mixed-frequency feature representation. Furthermore, a saliency-edge-aware decoder progressively scales up the mixed-frequency feature while preserving rich detail and saliency information for accurate salient object prediction. Extensive experiments conducted on the HS-SOD benchmark and our custom dataset HSOD-BIT demonstrate that our SMN outperforms state-of-the-art methods regarding HSOD performance. Code and dataset will be available at <a class="link-external link-https" href="https://github.com/laprf/SMN" rel="external noopener nofollow">this https URL</a>.

Perturbed Attention-Assisted Siamese Network for Cross-Spectral Periocular Recognition

High Boost 3-D Attention Network for Cross-Spectral Periocular Recognition

Approximate Multidimensional Discrete Cosine Transform-Based Deep Attention Network for Cross-Spectral Periocular Recognition

Holistic Feature Reconstruction-Based 3-D Attention Mechanism for Cross-Spectral Periocular Recognition

Representation Selective Coupling Via Token Sparsification for Multi-Spectral Object Re-Identification

PerimetryNet: A Multiscale Fine Grained Deep Network for Three-Dimensional Eye Gaze Estimation Using Visual Field Analysis

One shot learning approach for cross spectrum periocular verification

Cross-Sensor Periocular Biometrics in a Global Pandemic: Comparative Benchmark and Novel Multialgorithmic Approach

Enhanced near-infrared periocular recognition through collaborative rendering of hand crafted and deep features

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Near-infrared and visible-light periocular recognition with Gabor features using frequency-adaptive automatic eye detection

Self-Attentive Contrastive Learning for Conditioned Periocular and Face Biometrics

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

SIP-SegNet: A Deep Convolutional Encoder-Decoder Network for Joint Semantic Segmentation and Extraction of Sclera, Iris and Pupil based on Periocular Region Suppression

Cross-Spectral Attention for Unsupervised RGB-IR Face Verification and Person Re-identification

Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection

Fusing discrete cosine transform and multi-level center-symmetric local binary pattern features for periocular recognition

A Bidirectional Conversion Network for Cross-Spectral Face Recognition

Cross-Spectrum Dual-Subspace Pairing for RGB-infrared Cross-Modality Person Re-Identification

A Survey on Periocular Biometrics Research

Boosting Multi-modal Ocular Recognition via Spatial Feature Reconstruction and Unsupervised Image Quality Estimation