Abstract:Few-shot point cloud segmentation seeks to generate per-point masks for previously unseen categories, using only a minimal set of annotated point clouds as reference. Existing prototype-based methods rely on support prototypes to guide the segmentation of query point clouds, but they encounter challenges when significant object variations exist between the support prototypes and query features. In this work, we present dynamic prototype adaptation (DPA), which explicitly learns task-specific prototypes for each query point cloud to tackle the object variation problem. DPA achieves the adaptation through prototype rectification, aligning vanilla prototypes from support with the query feature distribution, and prototype-to-query attention, extracting task-specific context from query point clouds. Furthermore, we introduce a prototype distillation regularization term, enabling knowledge transfer between early-stage prototypes and their deeper counterparts during adaption. By iteratively applying these adaptations, we generate task-specific prototypes for accurate mask predictions on query point clouds. Extensive experiments on two popular benchmarks show that DPA surpasses state-of-the-art methods by a significant margin, e.g., 7.43\% and 6.39\% under the 2-way 1-shot setting on S3DIS and ScanNet, respectively. Code is available at

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the issue of object variation in Few-shot Point Cloud Segmentation. Specifically, existing prototype-based methods perform poorly when there are significant object variations between the support set and the query set. These variations include differences in scale, appearance, and features of objects of the same category in different scenes. Therefore, directly using prototypes generated from the support set to segment the query set point cloud leads to performance degradation. ### Solution To solve the above problem, the authors propose a Dynamic Prototype Adaptation (DPA) method. DPA generates task-specific prototypes through the following three key modules: 1. **Prototype Rectification**: Maps the initial prototype from the support set feature distribution to the query set feature distribution to align the prototype with the features of the query point cloud. 2. **Prototype-to-Query Attention**: Aggregates task-specific contextual information from the query point cloud to generate more accurate task-specific prototypes. 3. **Prototype Distillation**: Introduces a prototype distillation regularization term, allowing early-stage prototypes to learn from deeper prototypes, thereby enhancing the prototype adaptation process. ### Main Contributions - **Proposed the DPA Framework**: This framework dynamically adjusts the initial prototypes to generate task-specific prototypes, addressing the object variation issue between the support set and the query set. - **Introduced Prototype Rectification and Prototype-to-Query Attention Mechanisms**: These two mechanisms aid the prototype adaptation process and improve segmentation performance. - **Achieved Best Performance on Two Benchmark Datasets**: On the S3DIS and ScanNet datasets, DPA outperformed the existing best methods by 7.43% and 6.39% respectively in the 2-way 1-shot setting. ### Experimental Results - **Datasets**: The experiments were conducted on the Stanford Large-Scale 3D Indoor Spaces (S3DIS) and ScanNet datasets. - **Evaluation Metric**: Mean Intersection over Union (mean-IoU) was used as the evaluation metric. - **Experimental Results**: DPA performed excellently under different N-way K-shot settings, especially in the 2-way 1-shot setting, significantly outperforming existing methods. ### Conclusion By proposing the DPA framework, this paper effectively addresses the object variation issue in Few-shot Point Cloud Segmentation, generating task-specific prototypes and significantly improving segmentation performance. Experimental results show that DPA achieves the best performance on multiple benchmark datasets.

Dynamic Prototype Adaptation with Distillation for Few-shot Point Cloud Segmentation

Prototype Adaption and Projection for Few- and Zero-Shot 3D Point Cloud Semantic Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement

Few-shot 3D Point Cloud Semantic Segmentation

Learning from the Target: Dual Prototype Network for Few Shot Semantic Segmentation

Query-guided Support Prototypes for Few-shot 3D Indoor Segmentation

Beyond the Prototype: Divide-and-conquer Proxies for Few-shot Segmentation

APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation

Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation

Adaptive Prototype Learning and Allocation for Few-Shot Segmentation

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Generalized Few-Shot Point Cloud Segmentation Via Geometric Words

Contrastive enhancement using latent prototype for few-shot segmentation

Rethinking Few-shot 3D Point Cloud Semantic Segmentation

Beyond singular prototype: A prototype splitting strategy for few-shot medical image segmentation

Breaking Immutable: Information-Coupled Prototype Elaboration for Few-Shot Object Detection

PANet: Few-Shot Image Semantic Segmentation With Prototype Alignment

Holistic Prototype Activation for Few-Shot Segmentation

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Localization and Expansion: A Decoupled Framework for Point Cloud Few-shot Semantic Segmentation