Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

Star-Image Centering with Deep Learning II: HST/WFPC2 Full Field of View

Star Image Centering with Deep Learning. II. HST/WFPC2 Full Field of View

Star-Image Centering with Deep Learning: HST/WFPC2 Images

CSST Dense Star Field Preparation: A Framework for Astrometry and Photometry for Dense Star Field Images Obtained by the China Space Station Telescope (CSST)

Image deconvolution and PSF reconstruction with STARRED: a wavelet-based two-channel method optimized for light-curve extraction

Combining statistical learning with deep learning for improved exoplanet detection and characterization

Dim small target detection based on convolutinal neural network in star image

New Star Detector and Descriptor for Deep-sky Image Live Registration

Direct Exoplanet Detection Using Deep Convolutional Image Reconstruction (ConStruct): A New Algorithm for Post-Processing High-Contrast Images

Detection, instance segmentation, and classification for astronomical surveys with deep learning ( deepdisc ): detectron2 implementation and demonstration with Hyper Suprime-Cam data

Point spread function estimation for wide field small aperture telescopes with deep neural networks and calibration data

A New Cosmic-Ray Rejection Routine for HST WFC3/UVIS via Label-free Training of deepCR

Real-Time Convolutional Neural Network-Based Star Detection and Centroiding Method for CubeSat Star Tracker

deep PACO: Combining statistical models with deep learning for exoplanet detection and characterization in direct imaging at high contrast

Machine Learning for Improving Stellar Image-based Alignment in Wide-field Telescopes

STARRED: a two-channel deconvolution method with Starlet regularization

Star Cluster Classification using Deep Transfer Learning with PHANGS-HST

AutoSourceID-Classifier. Star-Galaxy Classification using a Convolutional Neural Network with Spatial Information

Direct Exoplanet Detection using Convolutional Image Reconstruction (ConStruct): A New Algorithm for Post-processing High-contrast Images

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Blind Deconvolution with Principal Components Analysis for Wide-Field and Small-Aperture Telescopes