A Pseudo Multi-Exposure Fusion Method Using Single Image

Yuma Kinoshita,Sayaka Shiota,Hitoshi Kiya

DOI: https://doi.org/10.1587/transfun.E101.A.1806

2018-08-01

Abstract:This paper proposes a novel pseudo multi-exposure image fusion method based on a single image. Multi-exposure image fusion is used to produce images without saturation regions, by using photos with different exposures. However, it is difficult to take photos suited for the multi-exposure image fusion when we take a photo of dynamic scenes or record a video. In addition, the multi-exposure image fusion cannot be applied to existing images with a single exposure or videos. The proposed method enables us to produce pseudo multi-exposure images from a single image. To produce multi-exposure images, the proposed method utilizes the relationship between the exposure values and pixel values, which is obtained by assuming that a digital camera has a linear response function. Moreover, it is shown that the use of a local contrast enhancement method allows us to produce pseudo multi-exposure images with higher quality. Most of conventional multi-exposure image fusion methods are also applicable to the proposed multi-exposure images. Experimental results show the effectiveness of the proposed method by comparing the proposed one with conventional ones.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: when shooting dynamic scenes or recording videos, it is difficult to obtain multiple photos with different exposures suitable for multi - exposure image fusion. In addition, traditional multi - exposure image fusion methods cannot be applied to existing single - exposure images or videos. Therefore, this paper proposes a method of generating pseudo - multi - exposure images based on a single image and improves image quality by fusing these pseudo - multi - exposure images.

### Specific problems and solutions:

1. **Alignment problem of dynamic scenes or multi - exposure images**:
- **Problem**: When shooting dynamic scenes or when the camera moves, misalignment may occur between multi - exposure images, resulting in artifacts such as ghosting in the fused image.
- **Solution**: The method proposed in this paper only requires one image, avoiding the problems caused by improper alignment of multiple images.

2. **Application limitations of existing single - exposure images**:
- **Problem**: Traditional multi - exposure image fusion methods are not suitable for existing static single - exposure images or videos.
- **Solution**: By generating pseudo - multi - exposure images from a single image, this method can be applied to existing images and videos.

3. **Image quality improvement**:
- **Problem**: How to improve the dynamic range and local contrast of an image without using multiple images with different exposures.
- **Solution**: Utilize the relationship between exposure values and pixel values, as well as local contrast enhancement techniques, to generate high - quality pseudo - multi - exposure images and fuse them.

### Method overview:

- **Relationship between exposure values and pixel values**: Assume that a digital camera has a linear response function, and simulate images under different exposure conditions by adjusting exposure values.
- **Local contrast enhancement**: Use bilateral filters and local contrast enhancement algorithms (such as dodging and burning) to improve the local details of the image.
- **Pseudo - exposure compensation**: Estimate the luminance distribution under different exposure values according to the luminance information of the original image.
- **Tone mapping**: Map the luminance values of the generated pseudo - multi - exposure images to an appropriate range to prevent pixel value overflow.
- **Image fusion**: Use existing multi - exposure image fusion methods (such as those proposed by Mertens et al., Sakai et al., and Nejati et al.) to fuse the pseudo - multi - exposure images and generate the final high - quality image.

Through the above steps, this method can generate high - quality images without relying on multiple images with different exposures, and is especially suitable for dynamic scenes or cases of existing single - exposure images.