Abstract:Semantic scene reconstruction from point cloud is an essential and challenging task for 3D scene understanding. This task requires not only to recognize each instance in the scene, but also to recover their geometries based on the partial observed point cloud. Existing methods usually attempt to directly predict occupancy values of the complete object based on incomplete point cloud proposals from a detection-based backbone. However, this framework always fails to reconstruct high fidelity mesh due to the obstruction of various detected false positive object proposals and the ambiguity of incomplete point observations for learning occupancy values of complete objects. To circumvent the hurdle, we propose a Disentangled Instance Mesh Reconstruction (DIMR) framework for effective point scene understanding. A segmentation-based backbone is applied to reduce false positive object proposals, which further benefits our exploration on the relationship between recognition and reconstruction. Based on the accurate proposals, we leverage a mesh-aware latent code space to disentangle the processes of shape completion and mesh generation, relieving the ambiguity caused by the incomplete point observations. Furthermore, with access to the CAD model pool at test time, our model can also be used to improve the reconstruction quality by performing mesh retrieval without extra training. We thoroughly evaluate the reconstructed mesh quality with multiple metrics, and demonstrate the superiority of our method on the challenging Scan-Net dataset. Code is available at https://github.com/ashawkey/dimr.

Fan-Meshes: a Geometric Primitive for Point-Based Description of 3D Models and Scenes

Simplification of Fan-Meshes Models for Fast Rendering of Large 3d Point-Sampled Scenes

Adaptive Mesh Reconstruction of Point Cloud with Feature Preserved

Generating Free-Form Grid Truss Structures from 3D Scanned Point Clouds

An Efficient Method to Mesh Point Cloud

A Two-Phase Approach of Progressive Mesh Reconstruction from Unorganized Point Clouds

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Mesh-LOAM: Real-time Mesh-Based LiDAR Odometry and Mapping

A Mesh Reconstruction Algorithm Driven by an Intrinsic Property of a Point Cloud.

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Mesh Reconstruction of Noisy Point Cloud Based on Intrinsic Property

A Divide-and-Conquer Approach to Quad Remeshing

Sharp Feature-Preserving 3D Mesh Reconstruction from Point Clouds Based on Primitive Detection

Scalable point cloud meshing for image-based large-scale 3D modeling

Multiresolution Free Form Object Modeling with Semi-Regular Mesh Reconstruction from Unstructured Point Cloud

LFS-Aware Surface Reconstruction from Unoriented 3D Point Clouds

An Efficient Volumetric Mesh Representation for Real-time Scene Reconstruction using Spatial Hashing

Multiresolution Free Form Object Modeling with Point Sampled Geometry.

Point Scene Understanding Via Disentangled Instance Mesh Reconstruction

Research on Reconstruction of Triangular Mesh Model from Scattered 3D Measured Data

MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model