Abstract:3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D knowledge distillation, achieving zero-shot 3D part segmentation. However, these methods are limited by their reliance on text prompts, which restricts the scalability to large-scale unlabeled datasets and the flexibility in handling part ambiguities. In this work, we introduce SAMPart3D, a scalable zero-shot 3D part segmentation framework that segments any 3D object into semantic parts at multiple granularities, without requiring predefined part label sets as text prompts. For scalability, we use text-agnostic vision foundation models to distill a 3D feature extraction backbone, allowing scaling to large unlabeled 3D datasets to learn rich 3D priors. For flexibility, we distill scale-conditioned part-aware 3D features for 3D part segmentation at multiple granularities. Once the segmented parts are obtained from the scale-conditioned part-aware 3D features, we use VLMs to assign semantic labels to each part based on the multi-view renderings. Compared to previous methods, our SAMPart3D can scale to the recent large-scale 3D object dataset Objaverse and handle complex, non-ordinary objects. Additionally, we contribute a new 3D part segmentation benchmark to address the lack of diversity and complexity of objects and parts in existing benchmarks. Experiments show that our SAMPart3D significantly outperforms existing zero-shot 3D part segmentation methods, and can facilitate various applications such as part-level editing and interactive segmentation.

Open-set Hierarchical Semantic Segmentation for 3D Scene

Open-Vocabulary SAM3D: Towards Training-free Open-Vocabulary 3D Scene Understanding

Search3D: Hierarchical Open-Vocabulary 3D Segmentation

OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning

SAI3D: Segment Any Instance in 3D Scenes

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesis

SA3DIP: Segment Any 3D Instance with Potential 3D Priors

Open-Vocabulary Octree-Graph for 3D Scene Understanding

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Campus3D

SAMPart3D: Segment Any Part in 3D Objects

A Unified Framework for 3D Scene Understanding

Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance

OpenMask3D: Open-Vocabulary 3D Instance Segmentation

SAM2Point: Segment Any 3D as Videos in Zero-shot and Promptable Manners

SAM3D: Segment Anything in 3D Scenes

Open-Ended 3D Point Cloud Instance Segmentation

Open-Vocabulary High-Resolution 3D (OVHR3D) Data Segmentation and Annotation Framework

Deep Hierarchical Semantic Segmentation

SAM-guided Graph Cut for 3D Instance Segmentation