Abstract:The demand to restore all-in-focus images from defocused images and produce photographs focused at different depths is emerging in more and more cases, such as low-end hand-held cameras and surveillance cameras. In this paper, we manage to solve this challenging multi-focusing problem with a single image taken with an uncalibrated conventional camera. Different from all existing multi-focusing approaches, our method does not need to include a deconvolution process, which is quite time-consuming and will cause ringing artifacts in the focused region and low depth-of-field. This paper proposes a novel systematic approach to realize multi-focusing from a single photograph. First of all, with the optical explanation for the local smooth assumption, we present a new point-to-point defocus model. Next, the blur map of the input image, which reflects the amount of defocus blur at each pixel in the image, is estimated by two steps. 1) With the sharp edge prior, a rough blur map is obtained by estimating the blur amount at the edge regions. 2) The guided image filter is applied to propagate the blur value from the edge regions to the whole image by which a refined blur map is obtained. Thus far, we can restore the all-in-focus photograph from a defocused input. To further produce photographs focused at different depths, the depth map from the blur map must be derived. To eliminate the ambiguity over the focal plane, user interaction is introduced and a binary graph cut algorithm is used. So we introduce user interaction and use a binary graph cut algorithm to eliminate the ambiguity over the focal plane. Coupled with the camera parameters, this approach produces images focused at different depths. The performance of this new multi-focusing algorithm is evaluated both objectively and subjectively by various test images. Both results demonstrate that this algorithm produces high quality depth maps and multi-focusing results, outperforming the previous approaches.

Relative Depth Estimation With An Uncalibrated Camera For Image Refocus

Autofocus Algorithm Based on Depth from Defocus

Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Refocusing Images and Videos with a Conventional Compact Camera

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Digital Multi-Focusing from a Single Photograph Taken with an Uncalibrated Conventional Camera

A Saliency-Guided Method for Automatic Photo Refocusing.

Effective Improvement for Depth Estimated Based on Defocus Images

Scribble2focus: An interactive photo refocusing system based on mobile stereo imaging

A Fused Estimation Method of Depth Based on Depth from Stereo and Depth from Focus

Depth Recovery and Refinement from A Single Image Using Defocus Cues

High-precision Refocusing Method with One Interpolation for Camera Array Images.

Optical arbitrary-depth refocusing for large-depth scene in integral imaging display based on reprojected parallax image

A Novel Depth Recovery Approach from Multi-View Stereo Based Focusing

Single Image Multi-focusing Based on Local Blur Estimation

DSR: Direct Self-rectification for Uncalibrated Dual-lens Cameras

User-oriented Stereo Video Refocusing by Computational Cinematographic Model

Depth from Defocus in the Wild.

Depth estimation based on defocus blur using a single image taken by a tilted lens optics camera

Synthetic defocus and look-ahead autofocus for casual videography

Flexible Refocusing Method for Camera Arrays Based on Reprojection