Abstract:Real-world data processing problems often involve various image modalities associated with a certain scene, including RGB images, infrared images, or multispectral images. The fact that different image modalities often share certain attributes, such as edges, textures, and other structure primitives, represents an opportunity to enhance various image processing tasks. This paper proposes a new approach to construct a high-resolution (HR) version of a low-resolution (LR) image, given another HR image modality as guidance, based on joint sparse representations induced by coupled dictionaries. The proposed approach captures complex dependency correlations, including similarities and disparities, between different image modalities in a learned sparse feature domain in lieu of the original image domain. It consists of two phases: coupled dictionary learning phase and coupled super-resolution phase. The learning phase learns a set of dictionaries from the training dataset to couple different image modalities together in the sparse feature domain. In turn, the super-resolution phase leverages such dictionaries to construct an HR version of the LR target image with another related image modality for guidance. In the advanced version of our approach, multistage strategy and neighbourhood regression concept are introduced to further improve the model capacity and performance. Extensive guided image super-resolution experiments on real multimodal images demonstrate that the proposed approach admits distinctive advantages with respect to the state-of-the-art approaches, for example, overcoming the texture copying artifacts commonly resulting from inconsistency between the guidance and target images. Of particular relevance, the proposed model demonstrates much better robustness than competing deep models in a range of noisy scenarios.

Bayesian Dictionary Learning for Hyperspectral Image Super Resolution in Mixed Poisson–Gaussian Noise

Hyperspectral Remote Image Denoising Based on Multitask Nonnegative Dictionary Learning

Double Sparse Dictionary Learning for Image Super Resolution

A self-learning image super-resolution method via sparse representation and non-local similarity

Bayesian nonparametric dictionary learning for compressed sensing MRI.

Panchromatic image based dictionary learning for hyperspectral imagery denoising

Image Super-Resolution Via Dual-Dictionary Learning And Sparse Representation

Noise Prior Knowledge Informed Bayesian Inference Network for Hyperspectral Super-Resolution

Remote Sensing Image Super-resolution Using Dual-Dictionary Pairs Based on Sparse Presentation and Multiple Features

A Nonparametric Bayesian Approach To Joint Multiple Dictionary Learning With Separate Image Sources

Image Super-resolution Reconstruction Algorithm Based on Bayesian Theory

Dictionary Learning Based Noisy Image Super-Resolution Via Distance Penalty Weight Model

Mixed Poisson-Gaussian Noise Model Based Sparse Denoising for Hyperspectral Imagery.

Image Super-Resolution via Sparse Bayesian Modeling of Natural Images

Multimodal Image Super-Resolution Via Joint Sparse Representations Induced by Coupled Dictionaries

A Bayesian Approach for Joint Discriminative Dictionary and Classifier Learning

Hierarchical Sparse Bayesian Learning with Beta Process Priors for Hyperspectral Imagery Restoration.

Pan-sharpening with a Bayesian Nonparametric Dictionary Learning Model.

Sparse Bayesian Dictionary Learning with a Gaussian Hierarchical Model.

Efficient Sparse Representation Based Image Super Resolution Via Dual Dictionary Learning

Robust Bayesian Non-Parametric Dictionary Learning with Heterogeneous Gaussian Noise