Abstract:Shallow depth-of-field (DoF), focusing on the region of interest by blurring out the rest of the image, is challenging in computer vision and computational photography. It can be achieved either by adjusting the parameters (e.g., aperture and focal length) of a single-lens reflex camera or computational techniques. In this paper, we investigate the latter one, i.e., explore a computational method to render shallow DoF. The previous methods either rely on portrait segmentation or stereo sensing, which can only be applied to portrait photos and require stereo inputs. To address these issues, we study the problem of rendering shallow DoF from an arbitrary image. In particular, we propose a method that consists of a salient object detection (SOD) module, a monocular depth prediction (MDP) module, and a DoF rendering module. The SOD module determines the focal plane, while the MDP module controls the blur degree. Specifically, we introduce a label-guided ranking loss for both salient object detection and depth prediction. For salient object detection, the label-guided ranking loss comprises two terms: (i) heterogeneous ranking loss that encourages the sampled salient pixels to be different from background pixels; (ii) homogeneous ranking loss penalizes the inconsistency of salient pixels or background pixels. For depth prediction, the label-guided ranking loss mainly relies on multilevel structural information, i.e., from low-level edge maps to high-level object instance masks. In addition, we introduce a SOD and depth-aware blur rendering method to generate shallow DoF images. Comprehensive experiments demonstrate the effectiveness of our proposed method.

Bayesian Depth-From-Defocus with Shading Constraints

Depth from Defocus Based on Geometric Constraints

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Depth map enhancement based on color and depth consistency

Fully Self-Supervised Depth Estimation from Defocus Clue

Depth from Defocus in the Wild.

CRF-based depth refinement with hybrid depth information

Effective Improvement for Depth Estimated Based on Defocus Images

Depth from Defocus Via Discriminative Metric Learning

Extracting Depth and Radiance From a Defocused Video Pair

Depth estimation from a single defocused image using multi-scale kernels

Absolute depth estimation from a single defocused image.

Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

Iterative feedback estimation of depth and radiance from defocused images

Study on the Method of Depth Measurement Based on Depth from Defocus

Recovery Of 3d Depth Map From Image Shading For Underwater Applications

Depth and DOF Cues Make A Better Defocus Blur Detector

Depth recovery from a single defocused image based on depth locally consistency

Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus

A Bayesian framework for dense depth estimation based on spatial-temporal correlation

Ranking-Based Salient Object Detection and Depth Prediction for Shallow Depth-of-Field