Abstract:Reference-based super-resolution (RefSR) aims to recover realistic textures, when a reference (Ref) image and low-resolution (LR) image are given. Because the Ref images are selected randomly, the quality of RefSR will degrade when the Ref image has less similar content with LR input. In this article,we propose a dual camera system to unleash the potential of RefSR. Additionally, we presents a cross attention mechanism to realize a high-quality digital zoom by using two camera modules with different focal lengths. In dual camera system, shorter focal length module produces the wide-view image with the low resolution. On the other hand, the longer focal length module produces the tele-view image via optical zoom. The long-focal image contains more details than short-focal image and can be used to guide short-focal image to reconstruct high-frequency part. Since the two images are taken from the same scene, we can get better image matching correlation in dual camera system. Inspired by the recent work on reference-based image super-resolution (RefSR), we propose a cross attention mechanism to fuse two images with different focal length and generate more feature correlations within them by texture transferring. Besides, we use segmentation information to improve match accuracy. Instead of using a direct matching between different images, the attention module fully utilizes texture of different levels. Additionally, we present a feature restoration module to reconstruct more image details. Extensive experiments show that Our method achieves state-of-the-art results both quantitatively and qualitatively across different datasets.

Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system

Superpixel-Based Linear Reconstruction Method for Dual-Camera Compressed Hyperspectral Imaging System

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

An improved method based on twIst and dual-camera design for hyperspectral image reconstruction

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

Continuous Digital Zoom with Cross Attention for Dual Camera System

Compressive Hyperspectral Imaging With Complementary Rgb Measurements

Hyperspectral Snapshot Compressive Imaging with Non-Local Spatial-Spectral Residual Network

Adaptive local sparse representation for compressive hyperspectral imaging

Adaptive Nonlocal Sparse Representation for Dual-Camera Compressive Hyperspectral Imaging

A Multi-Level Residual Reconstruction Based Image Compressed Sensing Recovery Scheme

Prior Image Guided Snapshot Compressive Spectral Imaging

Compressive Hyperspectral Imaging with Side Information

Learning Deep Subspace Projection Prior for Dual-Camera Compressive Hyperspectral Imaging