Abstract:The demand to restore all-in-focus images from defocused images and produce photographs focused at different depths is emerging in more and more cases, such as low-end hand-held cameras and surveillance cameras. In this paper, we manage to solve this challenging multi-focusing problem with a single image taken with an uncalibrated conventional camera. Different from all existing multi-focusing approaches, our method does not need to include a deconvolution process, which is quite time-consuming and will cause ringing artifacts in the focused region and low depth-of-field. This paper proposes a novel systematic approach to realize multi-focusing from a single photograph. First of all, with the optical explanation for the local smooth assumption, we present a new point-to-point defocus model. Next, the blur map of the input image, which reflects the amount of defocus blur at each pixel in the image, is estimated by two steps. 1) With the sharp edge prior, a rough blur map is obtained by estimating the blur amount at the edge regions. 2) The guided image filter is applied to propagate the blur value from the edge regions to the whole image by which a refined blur map is obtained. Thus far, we can restore the all-in-focus photograph from a defocused input. To further produce photographs focused at different depths, the depth map from the blur map must be derived. To eliminate the ambiguity over the focal plane, user interaction is introduced and a binary graph cut algorithm is used. So we introduce user interaction and use a binary graph cut algorithm to eliminate the ambiguity over the focal plane. Coupled with the camera parameters, this approach produces images focused at different depths. The performance of this new multi-focusing algorithm is evaluated both objectively and subjectively by various test images. Both results demonstrate that this algorithm produces high quality depth maps and multi-focusing results, outperforming the previous approaches.

Single-Shot Focus Estimation for Microscopy Imaging with Kernel Distillation

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Machine learning guided rapid focusing with sensor-less aberration corrections.

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

Single-shot autofocusing of microscopy images using deep learning

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Diversity-Aware Label Distribution Learning for Microscopy Auto Focusing

A Deep-Learning-based Workflow to Deal with the Defocusing Problem in High-Throughput Experiments

DeepFocus: A Few-Shot Microscope Slide Auto-Focus Using a Sample Invariant CNN-Based Sharpness Function

Deep Single Image Defocus Deblurring via Gaussian Kernel Mixture Learning

PostFocus: Automated Selective Post-acquisition High-throughput Focus Restoration using Diffusion model for Label-free Time-lapse Microscopy

HH-Net: Image Driven Microscope Fast Auto-Focus with Deep Neural Network

Single image deep defocus estimation and its applications

Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing

Lensfree Auto-Focusing Imaging with Coarse-to-fine Tuning Method

Digital Multi-Focusing from a Single Photograph Taken with an Uncalibrated Conventional Camera

Defocus Deblurring Using Dual-Pixel Data

Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image

Deep Learning for Camera Autofocus

Learning to High-Performance Autofocus Microscopy with Laser Illumination

Fast Autofocus of Microscopy Images Based on Depth-from-Defocus