Abstract:In this paper, we present DM-Calib, a diffusion-based approach for estimating pin- hole camera intrinsic parameters from a single input image. Monocular camera calibration is essential for many 3D vision tasks. However, most existing methods depend on handcrafted assumptions or are constrained by limited training data, re- sulting in poor generalization across diverse real-world images. Recent advance- ments in stable diffusion models, trained on massive data, have shown the ability to generate high-quality images with varied characteristics. Emerging evidence in- dicates that these models implicitly capture the relationship between camera focal length and image content. Building on this insight, we explore how to leverage the powerful priors of diffusion models for monocular pinhole camera calibration. Specifically, we introduce a new image-based representation, termed Camera Im- age, which losslessly encodes the numerical camera intrinsics and integrates seam- lessly with the diffusion framework. Using this representation, we reformulate the problem of estimating camera intrinsics as the generation of a dense Camera Im- age conditioned on an input image. By fine-tuning a stable diffusion model to gen- erate a Camera Image from a single RGB input, we can extract camera intrinsics via a RANSAC operation. We further demonstrate that our monocular calibration method enhances performance across various 3D tasks, including zero-shot metric depth estimation, 3D metrology, pose estimation and sparse-view reconstruction. Extensive experiments on multiple public datasets show that our approach signifi- cantly outperforms baselines and provides broad benefits to 3D vision tasks. Code is available at <a class="link-external link-https" href="https://github.com/JunyuanDeng/DM-Calib" rel="external noopener nofollow">this https URL</a>.

3D Feature Points Calibration Method for Depth-Camera

Camera Calibration Technique Based on Virtual 3D Object

A Simple 3d Face Tracking Method Based On Depth Information

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

Accurate Intrinsic Calibration Of Depth Camera With Cuboids

A Novel Camera Calibration Method Based on Multiple Calibration Planes

Effective camera calibration in free-viewpoint systems

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.

High-accuracy Calibration of Cameras Without Depth of Field and Target Size Limitations.

NMC3D: Non-Overlapping Multi-Camera Calibration Based on Sparse 3D Map

3-D Positioning System Based on Linear CCD Camera

High-accuracy camera calibration method based on coded concentric ring center extraction

A Self-Calibrated Photo-Geometric Depth Camera

Camera Calibration with Long Focal Length Using Building Natural Features

Improved 3D Depth Image Estimation Algorithm for Visual Camera

A Deep-Learning Based High-Accuracy Camera Calibration Method for Large-Scale Scene

A Stable, Efficient, and High-Precision Non-Coplanar Calibration Method: Applied for Multi-Camera-Based Stereo Vision Measurements

Extrinsic Calibration for Large FOV Based on Inverse Depth Parameterized Bundle Adjustment

Depth-Camera Calibration Optimization Method Based on Homography Matrix

Calibration of depth cameras using denoised depth images

Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration