Abstract:3D representation is essential to the significant advance of 3D generation with 2D diffusion priors. As a flexible representation, NeRF has been first adopted for 3D representation. With density-based volumetric rendering, it however suffers both intensive computational overhead and inaccurate mesh extraction. Using a signed distance field and Marching Tetrahedra, DMTet allows for precise mesh extraction and real-time rendering but is limited in handling large topological changes in meshes, leading to optimization challenges. Alternatively, 3D Gaussian Splatting (3DGS) is favored in both training and rendering efficiency while falling short in mesh extraction. In this work, we introduce a novel 3D representation, Tetrahedron Splatting (TeT-Splatting), that supports easy convergence during optimization, precise mesh extraction, and real-time rendering simultaneously. This is achieved by integrating surface-based volumetric rendering within a structured tetrahedral grid while preserving the desired ability of precise mesh extraction, and a tile-based differentiable tetrahedron rasterizer. Furthermore, we incorporate eikonal and normal consistency regularization terms for the signed distance field to improve generation quality and stability. Critically, our representation can be trained without mesh extraction, making the optimization process easier to converge. Our TeT-Splatting can be readily integrated in existing 3D generation pipelines, along with polygonal mesh for texture optimization. Extensive experiments show that our TeT-Splatting strikes a superior tradeoff among convergence speed, render efficiency, and mesh quality as compared to previous alternatives under varying 3D generation settings.

Scaling Mesh Generation via Compressive Tokenization

Generating Large Convex Polytopes Directly on Point Clouds

Scalable Parallel Quadrilateral Mesh Generation Coupled with Mesh Partitioning

Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scale

A General Framework for Parallel Planar Mesh Generation

Scalable generation of large-scale unstructured meshes by a novel domain decomposition approach.

PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance

Piecewise Compression of Large Mesh

Mesh-LOAM: Real-time Mesh-Based LiDAR Odometry and Mapping

Controllable Mesh Generation Through Sparse Latent Point Diffusion Models.

GetMesh: A Controllable Model for High-quality Mesh Generation and Manipulation

A Spectral Segmentation Method for Large Meshes

Scalable point cloud meshing for image-based large-scale 3D modeling

T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image

MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenization

Meshformers: Transformer-Based Networks for Mesh Understanding

Marching Windows: Scalable Mesh Generation for Volumetric Data with Multiple Materials.

Tetrahedron Splatting for 3D Generation

TPNet: A Novel Mesh Analysis Method Via Topology Preservation and Perception Enhancement

Robust Voxelization and Visualization by Improved Tetrahedral Mesh Generation

Geometric Granularity Aware Pixel-to-Mesh