Abstract:Reference-based super-resolution (RefSR) aims to recover realistic textures, when a reference (Ref) image and low-resolution (LR) image are given. Because the Ref images are selected randomly, the quality of RefSR will degrade when the Ref image has less similar content with LR input. In this article,we propose a dual camera system to unleash the potential of RefSR. Additionally, we presents a cross attention mechanism to realize a high-quality digital zoom by using two camera modules with different focal lengths. In dual camera system, shorter focal length module produces the wide-view image with the low resolution. On the other hand, the longer focal length module produces the tele-view image via optical zoom. The long-focal image contains more details than short-focal image and can be used to guide short-focal image to reconstruct high-frequency part. Since the two images are taken from the same scene, we can get better image matching correlation in dual camera system. Inspired by the recent work on reference-based image super-resolution (RefSR), we propose a cross attention mechanism to fuse two images with different focal length and generate more feature correlations within them by texture transferring. Besides, we use segmentation information to improve match accuracy. Instead of using a direct matching between different images, the attention module fully utilizes texture of different levels. Additionally, we present a feature restoration module to reconstruct more image details. Extensive experiments show that Our method achieves state-of-the-art results both quantitatively and qualitatively across different datasets.

Low-Light Color Imaging via Dual Camera Acquisition.

Low-Light Color Imaging Via Cross-Camera Synthesis.

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Continuous Digital Zoom with Cross Attention for Dual Camera System

Shoot High-Quality Color Images Using Dual-Lens System with Monochrome and Color Cameras

Cross-Camera Deep Colorization

A Colorization Framework for Monochrome-Color Dual-Lens Systems Using a Deep Convolutional Network

A Dual Sensor Computational Camera for High Quality Dark Videography

Deep Color Transfer for Color-Plus-Mono Dual Cameras

A Mutually Boosting Dual Sensor Computational Camera for High Quality Dark Videography.

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System.

LDRM: Degradation Rectify Model for Low-light Imaging via Color-Monochrome Cameras

Abandoning the Bayer-Filter to See in the Dark

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

End-to-End Computational Imaging Based on Multispectral Fusion

Asymmetric Stereo Color Transfer

Learning to Erase the Bayer-Filter to See in the Dark

Low-Illumination Color Image Enhancement System Based on Single Sensor

Hybrid High Dynamic Range Imaging fusing Neuromorphic and Conventional Images

An Integrated Enhancement Solution for 24-hour Colorful Imaging