Abstract:We present MeshSegmenter, a simple yet effective framework designed for zero-shot 3D semantic segmentation. This model successfully extends the powerful capabilities of 2D segmentation models to 3D meshes, delivering accurate 3D segmentation across diverse meshes and segment descriptions. Specifically, our model leverages the Segment Anything Model (SAM) model to segment the target regions from images rendered from the 3D shape. In light of the importance of the texture for segmentation, we also leverage the pretrained stable diffusion model to generate images with textures from 3D shape, and leverage SAM to segment the target regions from images with textures. Textures supplement the shape for segmentation and facilitate accurate 3D segmentation even in geometrically non-prominent areas, such as segmenting a car door within a car mesh. To achieve the 3D segments, we render 2D images from different views and conduct segmentation for both textured and untextured images. Lastly, we develop a multi-view revoting scheme that integrates 2D segmentation results and confidence scores from various views onto the 3D mesh, ensuring the 3D consistency of segmentation results and eliminating inaccuracies from specific perspectives. Through these innovations, MeshSegmenter offers stable and reliable 3D segmentation results both quantitatively and qualitatively, highlighting its potential as a transformative tool in the field of 3D zero-shot segmentation. The code is available at \url{<a class="link-external link-https" href="https://github.com/zimingzhong/MeshSegmenter" rel="external noopener nofollow">this https URL</a>}.

Fast Mesh Segmentation Based on Multiple Kernel Learning

Fast Global Segmentation Based on the Dual Formulation of TV-norm

Mesh Segmentation with Concavity-Aware Fields

3D mesh segmentation using a two-stage merging strategy

Graph Based Mesh Segmentation

Fast mesh segmentation using random walks

A fast region-based image segmentation based on least square method

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Spectral Mesh Segmentation Via L0 Gradient Minimization.

Texture Segmentation Using Kernel-based Techniques

Semi-Supervised Mesh Segmentation and Labeling

CEFM - A Heuristic Mesh Segmentation Method Based on Convexity Estimation and Fast Marching.

Fast Multi-View Segment Graph Kernel for Object Classification

Mesh Segmentation for Parallel Decompression on GPU.

Mesh Segmentation by Local Depth

Feature Sensitive Mesh Segmentation

Connectivity-Based Segmentation for GPU-Accelerated Mesh Decompression

CAD Mesh Model Segmentation by Clustering

A Spectral Segmentation Method for Large Meshes

MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesis

Robust Mesh Segmentation Using Feature-Aware Region Fusion