Abstract:In this paper, we propose a method which is based on the dual-focal camera facing the same target to expanse the dynamic range of images. Since the spatial resolution of dual-focal camera in this paper is different, down-sampling, up-sampling, and multi-resolution fusion are required in image fusion processing to obtain an ideal high dynamic range image. The current multi-frame high dynamic range algorithm is mainly for similar resolution images. When there are two images with large resolution differences, The effect of ordinary registration algorithms (For example, optical flow registration algorithm) are limited, and the image may appear ghost and color artifacts after registration. Our method uses a convolutional neural network, which composed of two subnets. An image fusion subnet and a style transfer subnet. Because there is only one exposure image in the surrounding field of view, the central field of view is processed separately from the surrounding field of view. In the central field of view, U-Net is used to register the images layer by layer to increase the registration speed and registration accuracy. After the high dynamic range image in the central field of view, the style transfer network is used to transfer the color distribution of the high dynamic range image to the surrounding field of view. As for result, we performed extensive qualitative and quantitative comparisons to show that our method produces excellent results where ghost and color artifacts are significantly reduced compared to existing general multi-frame high dynamic range methods, and is robust across various inputs.

Multi-exposure image fusion based on well-exposedness assessment

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Local detail preserved exposure fusion with realistic brightness

Fast detail-preserving exposure fusion

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

An Extending Dynamic Range Method Based on Digital Image Synthesis

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

A Novel Multi-Exposure Image Fusion Method Based on Adaptive Patch Structure

Low-light Image Pairs Fusion Method Based on Patch-match

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Multi-Exposure Image Fusion Algorithm Based on Improved Weight Function

Multi-Exposure Image Fusion Based on Weighted Average Adaptive Factor and Local Detail Enhancement

Multi-Exposure Image Fusion Based on Exposure Compensation

Perceptual Multi-Exposure Fusion

Multi-Scale Exposure Fusion Via Content Adaptive Edge-Preserving Smoothing Pyramids.

Color-compensated multi-scale exposure fusion based on physical features

Multi-exposure electric power monitoring image fusion method without ghosting based on exposure fusion framework and color dissimilarity feature

Multiple Exposure Fusion for High Dynamic Range Image Acquisition

Multiple-Exposure Image Fusion for HDR Image Synthesis Using Learned Analysis Transformations

An enhanced multi-scale weight assignment strategy of two-exposure fusion

Multi Exposure Fusion for High Dynamic Range Imaging Via Multi-Channel Gradient Tensor