Abstract:We present MeshSegmenter, a simple yet effective framework designed for zero-shot 3D semantic segmentation. This model successfully extends the powerful capabilities of 2D segmentation models to 3D meshes, delivering accurate 3D segmentation across diverse meshes and segment descriptions. Specifically, our model leverages the Segment Anything Model (SAM) model to segment the target regions from images rendered from the 3D shape. In light of the importance of the texture for segmentation, we also leverage the pretrained stable diffusion model to generate images with textures from 3D shape, and leverage SAM to segment the target regions from images with textures. Textures supplement the shape for segmentation and facilitate accurate 3D segmentation even in geometrically non-prominent areas, such as segmenting a car door within a car mesh. To achieve the 3D segments, we render 2D images from different views and conduct segmentation for both textured and untextured images. Lastly, we develop a multi-view revoting scheme that integrates 2D segmentation results and confidence scores from various views onto the 3D mesh, ensuring the 3D consistency of segmentation results and eliminating inaccuracies from specific perspectives. Through these innovations, MeshSegmenter offers stable and reliable 3D segmentation results both quantitatively and qualitatively, highlighting its potential as a transformative tool in the field of 3D zero-shot segmentation. The code is available at \url{<a class="link-external link-https" href="https://github.com/zimingzhong/MeshSegmenter" rel="external noopener nofollow">this https URL</a>}.

Low-rank 3D Mesh Segmentation and Labeling with Structure Guiding

Low-rank 3D mesh segmentation and labeling with structure guiding

Semi-Supervised Mesh Segmentation and Labeling

3D mesh segmentation using a two-stage merging strategy

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Spectral 3D Mesh Segmentation with a Novel Single Segmentation Field.

SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform

iSeg3D: An Interactive 3D Shape Segmentation Tool

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation

Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labels

Weakly Supervised 3D Segmentation Via Receptive-Driven Pseudo Label Consistency and Structural Consistency.

3D Guided Weakly Supervised Semantic Segmentation

Semi-Supervised 3D Shape Segmentation via Self Refining

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

Spectral Mesh Segmentation Via L0 Gradient Minimization.

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesis

Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation

Joint Global and Dynamic Pseudo Labeling for Semi-Supervised Point Cloud Sequence Segmentation