Abstract:Deep Implicit Function (DIF) has gained much popularity as an efficient 3D shape representation. To capture geometry details, current mainstream methods divide 3D shapes into local regions and then learn each one with a local latent code via a decoder. Such local methods can capture more local details due to less diversity among local regions than global shapes. Although the diversity of local regions has been decreased compared to global approaches, the diversity in different local regions still poses a challenge in learning an implicit function when treating all regions equally using only a single decoder. What is worse, these local regions often exhibit imbalanced distributions, where certain regions have significantly fewer observations. This leads that fine geometry details could not be preserved well. To solve this problem, we propose a novel Local Pattern-specific Implicit Function, named LP-DIF, to represent a shape with clusters of local regions and multiple decoders, where each decoder only focuses on one cluster of local regions which share a certain pattern. Specifically, we first extract local codes for all regions, and then cluster them into multiple groups in the latent space, where similar regions sharing a common pattern fall into one group. After that, we train multiple decoders for mining local patterns of different groups, which simplifies the learning of fine geometric details by reducing the diversity of local regions seen by each decoder. To further alleviate the data-imbalance problem, we introduce a region re-weighting module to each pattern-specific decoder using a kernel density estimator, which dynamically re-weights the regions during learning. Our LP-DIF can restore more geometry details, and thus improve the quality of 3D reconstruction. Experiments demonstrate that our method can achieve the state-of-the-art performance over previous methods. Code is available at https://github.com/gtyxyz/lpdif.

The Geometry Enhanced Deep Implicit Function Based 3D Reconstruction for Objects in a Real-Scene Image

gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstruction

LP-DIF: Learning Local Pattern-Specific Deep Implicit Function for 3D Objects and Scenes

GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction

GeoRec: Geometry-enhanced Semantic 3D Reconstruction of RGB-D Indoor Scenes

Efficient Implicit Neural Reconstruction Using LiDAR

Learning Deep Implicit Functions for 3D Shapes with Dynamic Code Clouds

3D Face Reconstruction with the Geometric Guidance of Facial Part Segmentation

Explicit 3D Reconstruction from Images with Dynamic Graph Learning and Rendering-Guided Diffusion

FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstruction

Geometry-guided Feature Learning and Fusion for Indoor Scene Reconstruction

Neighborhood-based Neural Implicit Reconstruction from Point Clouds

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

Geometry-Guided Neural Implicit Surface Reconstruction

Hessian-constrained Detail-Preserving 3D Implicit Reconstruction from Raw Volumetric Dataset

Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction

Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering

Local Deep Implicit Functions for 3D Shape

DASI: Learning Domain Adaptive Shape Impression for 3D Object Reconstruction