Abstract:The trichromatic visualization of hundreds of bands in a hyperspectral image (HSI) has been an active research topic. The visualized image shall convey as much information as possible from the original data and facilitate easy image interpretation. However, most existing methods display HSIs in false color, which contradicts with user experience and expectation. In this paper, we propose a new framework for visualizing an HSI with natural color by the fusion of an HSI and a high-resolution color image via manifold alignment. Manifold alignment projects several data sets to a shared embedding space where the matching points between them are pairwise aligned. The embedding space bridges the gap between the high-dimensional spectral space of the HSI and the RGB space of the color image, making it possible to transfer natural color and spatial information in the color image to the HSI. In this way, a visualized image with natural color distribution and fine spatial details can be generated. Another advantage of the proposed method is its flexible data setting for various scenarios. As our approach only needs to search a limited number of matching pixel pairs that present the same object, the HSI and the color image can be captured from the same or semantically similar sites. Moreover, the learned projection function from the hyperspectral data space to the RGB space can be directly applied to other HSIs acquired by the same sensor to achieve a quick overview. Our method is also able to visualize user-specified bands as natural color images, which is very helpful for users to scan bands of interest.

Semisupervised Manifold Learning For Color Transfer Between Multiview Images

Manifold Alignment Based Color Transfer For Multiview Image Stitching

Learning Visually Aligned Semantic Graph for Cross-Modal Manifold Matching.

L0 Gradient-Preserving Color Transfer

Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation

Manifold Preserving Color Editing Based on Superpixels.

Improved method of image color transfer.

Manifold learning-based map color transfer

Color Transfer Between Images with Auto Selecting Swatches

Constrained Manifold Learning for Hyperspectral Imagery Visualization

Novel Semisupervised High-Dimensional Correspondences Learning Method

A Manifold Alignment Approach for Hyperspectral Image Visualization with Natural Color.

Visualization of Hyperspectral Imaging Data Based on Manifold Alignment

Transferring Colours to Grayscale Images by Locally Linear Embedding.

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Progressive Color Transfer with Dense Semantic Correspondences

Image Stitching with Manifold Optimization

Color Correction for Large-Baseline Multiview Video

Bidirectional-isomorphic Manifold Learning at Image Semantic Understanding & Representation.

Color Transfer for Images: A Survey

Multiview Cross-supervision for Semantic Segmentation