Abstract:Reconstructing 3D objects from a single image is an intriguing but challenging problem. One promising solution is to utilize multi-view (MV) 3D reconstruction to fuse generated MV images into consistent 3D objects. However, the generated images usually suffer from inconsistent lighting, misaligned geometry, and sparse views, leading to poor reconstruction quality. To cope with these problems, we present a novel 3D reconstruction framework that leverages intrinsic decomposition guidance, transient-mono prior guidance, and view augmentation to cope with the three issues, respectively. Specifically, we first leverage to decouple the shading information from the generated images to reduce the impact of inconsistent lighting; then, we introduce mono prior with view-dependent transient encoding to enhance the reconstructed normal; and finally, we design a view augmentation fusion strategy that minimizes pixel-level loss in generated sparse views and semantic loss in augmented random views, resulting in view-consistent geometry and detailed textures. Our approach, therefore, enables the integration of a pre-trained MV image generator and a neural network-based volumetric signed distance function (SDF) representation for a single image to 3D object reconstruction. We evaluate our framework on various datasets and demonstrate its superior performance in both quantitative and qualitative assessments, signifying a significant advancement in 3D object reconstruction. Compared with the latest state-of-the-art method Syncdreamer~\cite{liu2023syncdreamer}, we reduce the Chamfer Distance error by about 36\% and improve PSNR by about 30\% .

3D Image Synthesis Forb-Reps Objects

Accurate Color Synthesis of Three-Dimensional Objects in an Image.

Precise 3d reconstruction from a single image

3D Reconstruction Based on Image Segmentation

New Methods for Projecting a 3D Object Onto a Free-Form Surface

Sketch-based 3-D modeling for piecewise planar objects in single images

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

Arbitrary view generation based on DIBR

An Algorithm to Generate Visual Hulls

Multi-Resolution Surface Description of 3-D Objects by Shape-Adaptive Triangular Meshes

Boundary Aligned Smooth 3D Cross-Frame Field

Data-driven Method for 3D Axis-symmetric Object Reconstruction from Single Cone-beam Projection Data

A B-Spline Surface Interpolation Technique For Reconstructing 3d Objects From Serial Arbitrary Shaped Planar Contours

Single Image Based 3D Symmetric Free-Form Objects Reconstruction

Converting Hybrid Wire-Frames to B-rep Models

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion

FlexiDreamer: Single Image-to-3D Generation with FlexiCubes

Three-Dimensional Reconstruction of A Cylinder Surface Based on Constrained Bundle Adjustment

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Slicing and Support Structure Generation for 3D Printing Directly on B-rep Models

Two Accelerating Techniques for 3D Reconstruction.