Abstract:Deep Implicit Function (DIF) has gained much popularity as an efficient 3D shape representation. To capture geometry details, current mainstream methods divide 3D shapes into local regions and then learn each one with a local latent code via a decoder. Such local methods can capture more local details due to less diversity among local regions than global shapes. Although the diversity of local regions has been decreased compared to global approaches, the diversity in different local regions still poses a challenge in learning an implicit function when treating all regions equally using only a single decoder. What is worse, these local regions often exhibit imbalanced distributions, where certain regions have significantly fewer observations. This leads that fine geometry details could not be preserved well. To solve this problem, we propose a novel Local Pattern-specific Implicit Function, named LP-DIF, to represent a shape with clusters of local regions and multiple decoders, where each decoder only focuses on one cluster of local regions which share a certain pattern. Specifically, we first extract local codes for all regions, and then cluster them into multiple groups in the latent space, where similar regions sharing a common pattern fall into one group. After that, we train multiple decoders for mining local patterns of different groups, which simplifies the learning of fine geometric details by reducing the diversity of local regions seen by each decoder. To further alleviate the data-imbalance problem, we introduce a region re-weighting module to each pattern-specific decoder using a kernel density estimator, which dynamically re-weights the regions during learning. Our LP-DIF can restore more geometry details, and thus improve the quality of 3D reconstruction. Experiments demonstrate that our method can achieve the state-of-the-art performance over previous methods. Code is available at https://github.com/gtyxyz/lpdif.

LP-DIF: Learning Local Pattern-Specific Deep Implicit Function for 3D Objects and Scenes

Learning Deep Implicit Functions for 3D Shapes with Dynamic Code Clouds

Local Deep Implicit Functions for 3D Shape

Local Deep Feature Learning Framework for 3D Shape.

Deep Implicit Templates for 3D Shape Representation

3D Shapes Local Geometry Codes Learning with SDF

Latent Partition Implicit with Surface Codes for 3D Representation

Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction

Local Feature Discriminant Projection

D$^2$IM-Net: Learning Detail Disentangled Implicit Fields from Single Images

ImpDet: Exploring Implicit Fields for 3D Object Detection

Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow

IPoD: Implicit Field Learning with Point Diffusion for Generalizable 3D Object Reconstruction from Single RGB-D Images

Geometry-aware Two-scale PIFu Representation for Human Reconstruction

DITTO: Dual and Integrated Latent Topologies for Implicit 3D Reconstruction

DeepMIF: Deep Monotonic Implicit Fields for Large-Scale LiDAR 3D Mapping

LATFormer: Locality-Aware Point-View Fusion Transformer for 3D shape recognition

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation