Abstract:Shape primitives decomposition has been an important and long-standing task in 3D shape analysis. Prior arts heavily rely on 3D point clouds or voxel data for shape primitives extraction, which are less practical in real-world scenarios. This paper proposes to learn shape primitives from multi-view images by introducing implicit surface rendering. It is challenging since implicit shapes have a high degree of freedom, which violates the simplicity property of shape primitives. In this work, a novel regularization term named Implicit Convexity Regularization (ICR) imposed on implicit primitive learning is proposed to tackle this problem. We start with the convexity definition of general 3D shapes, and then derive the equivalent expression for implicit shapes represented by signed distance functions (SDFs). Further, instead of directly constraining the output SDF values which cause unstable optimization, we alternatively impose constraint on second order directional derivatives on line segments inside the shapes, which proves to be a tighter condition for 3D convexity. Implicit primitives constrained by the proposed ICR are combined into a whole object via softmax-weighted-sum operation over all primitive SDFs. Experiments on synthetic and real-world datasets show that our method is able to decompose objects into simple and reasonable shape primitives without the need of segmentation labels or 3D data. Code and data is publicly available in https://github.com/seanywang0408/ICR.

Convex Relaxation with Log-Determinant Divergence-L1 Regularization for 3D Shape Reconstruction

3D Shape Estimation from 2D Landmarks: A Convex Relaxation Approach

Sparse Representation for 3d Shape Estimation: A Convex Relaxation Approach

A Convex Framework for High Resolution 3D Reconstruction.

A Metric Learning Method for Image-based 3D Shape Retrieval

3D Shape Retrieval Based on Laplace Operator and Joint Bayesian Model

Local Deep Feature Learning Framework for 3D Shape.

Reconstructing Recognizable 3D Face Shapes Based on 3D Morphable Models.

A Correspondence Relaxation Approach for 3D Shape Reconstruction

Low-Rank Plus Sparse Reconstruction Using Dictionary Learning for 3D-Mri

LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

Robust Monocular 3D Car Shape Estimation from 2D Landmarks.

Convex Optimization for Nonrigid Stereo Reconstruction.

A Unified Feature Representation and Learning Framework for 3D Shape

Joint Monocular 3d Car Shape Estimation And Landmark Localization Via Cascaded Regression

Learning a discriminative deformation-invariant 3D shape descriptor via many-to-one encoder.

2D-D Lifting for Shape Reconstruction

Learning Shape Primitives Via Implicit Convexity Regularization

3D shape reconstruction with a multiple-constraint estimation approach

Joint 3-D Shape Estimation and Landmark Localization from Monocular Cameras of Intelligent Vehicles