Abstract:Hyperspectral image (HSI) super-resolution (SR) is a challenging task due to its ill-posed nature, and has attracted extensive attention by the research community. Previous methods concentrated on leveraging various hand-crafted image priors of a latent high-resolution hyperspectral (HR-HS) image to regularize the degradation model of the observed low-resolution hyperspectral (LR-HS) and HR-RGB images. Different optimization strategies for searching a plausible solution, which usually leads to a limited reconstruction performance, were also exploited. Recently, deep-learning-based methods evolved for automatically learning the abundant image priors in a latent HR-HS image. These methods have made great progress for HS image super resolution. Current deep-learning methods have faced difficulties in designing more complicated and deeper neural network architectures for boosting the performance. They also require large-scale training triplets, such as the LR-HS, HR-RGB, and their corresponding HR-HS images for neural network training. These training triplets significantly limit their applicability to real scenarios. In this work, a deep unsupervised fusion-learning framework for generating a latent HR-HS image using only the observed LR-HS and HR-RGB images without previous preparation of any other training triplets is proposed. Based on the fact that a convolutional neural network architecture is capable of capturing a large number of low-level statistics (priors) of images, the automatic learning of underlying priors of spatial structures and spectral attributes in a latent HR-HS image using only its corresponding degraded observations is promoted. Specifically, the parameter space of a generative neural network used for learning the required HR-HS image to minimize the reconstruction errors of the observations using mathematical relations between data is investigated. Moreover, special convolutional layers for approximating the degradation operations between observations and the latent HR-HS image are specifically to construct an end-to-end unsupervised learning framework for HS image super-resolution. Experiments on two benchmark HS datasets, including the CAVE and Harvard, demonstrate that the proposed method can is capable of producing very promising results, even under a large upscaling factor. Furthermore, it can outperform other unsupervised state-of-the-art methods by a large margin, and manifests its superiority and efficiency.

Echocardiographic effects of prostacyclin?

Generating Hypergraph-Based High-Order Representations of Whole-Slide Histopathological Images for Survival Prediction

Impact of color augmentation and tissue type in deep learning for hematoxylin and eosin image super resolution

Towards Real-Time Hyperspectral Multi-Image Super-Resolution Reconstruction Applied to Histological Samples

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Joint Super-resolution and Tissue Patch Classification for Whole Slide Histological Images

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Super resolution of histopathological frozen sections via deep learning preserving tissue structure

Accurate diagnosis achieved via super-resolution whole slide images by pathologists and artificial intelligence

Gigapixel Whole-Slide Images Classification using Locally Supervised Learning

Hyperspectral Image Superresolution via Deep Structure and Texture Interfusion

Deep learning approach for hyperspectral image demosaicking, spectral correction and high-resolution RGB reconstruction

Towards Arbitrary-Scale Histopathology Image Super-resolution: An Efficient Dual-branch Framework via Implicit Self-texture Enhancement

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Thyroid carcinoma detection on whole histologic slides using hyperspectral imaging and deep learning

Deep Unsupervised Fusion Learning for Hyperspectral Image Super Resolution

SSTU: Swin-Spectral Transformer U-Net for Hyperspectral Whole Slide Image Reconstruction

Deep learning for rapid virtual H&E staining of label-free glioma tissue from hyperspectral images

Hierarchical Attention Guided Framework for Multi-resolution Collaborative Whole Slide Image Segmentation

Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Images