Abstract:In the realm of high-resolution (HR), fine-grained image segmentation, the primary challenge is balancing broad contextual awareness with the precision required for detailed object delineation, capturing intricate details and the finest edges of objects. Diffusion models, trained on vast datasets comprising billions of image-text pairs, such as SD V2.1, have revolutionized text-to-image synthesis by delivering exceptional quality, fine detail resolution, and strong contextual awareness, making them an attractive solution for high-resolution image segmentation. To this end, we propose DiffDIS, a diffusion-driven segmentation model that taps into the potential of the pre-trained U-Net within diffusion models, specifically designed for high-resolution, fine-grained object segmentation. By leveraging the robust generalization capabilities and rich, versatile image representation prior of the SD models, coupled with a task-specific stable one-step denoising approach, we significantly reduce the inference time while preserving high-fidelity, detailed generation. Additionally, we introduce an auxiliary edge generation task to not only enhance the preservation of fine details of the object boundaries, but reconcile the probabilistic nature of diffusion with the deterministic demands of segmentation. With these refined strategies in place, DiffDIS serves as a rapid object mask generation model, specifically optimized for generating detailed binary maps at high resolutions, while demonstrating impressive accuracy and swift processing. Experiments on the DIS5K dataset demonstrate the superiority of DiffDIS, achieving state-of-the-art results through a streamlined inference process. Our code will be made publicly available.

Diffusion unit: Interpretable edge enhancement and suppression learning for 3D point cloud segmentation

Enhancing Local Feature Learning Using Diffusion for 3D Point Cloud Understanding

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

EIDU-Net: edge-preserved inception DenseGCN U-Net for LiDAR point cloud segmentation

Diff3DETR: Agent-based Diffusion Model for Semi-supervised 3D Object Detection

Diff3DETR:Agent-based Diffusion Model for Semi-supervised 3D Object Detection

High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacity

A Comparative Study of Feature Expansion Unit for 3D Point Cloud Upsampling

Adaptive Edge-to-Edge Interaction Learning for Point Cloud Analysis

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation

Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object Detection

Dense Point Diffusion for 3D Object Detection

DiffuBox: Refining 3D Object Detection with Point Diffusion

3D Object Detection from Point Cloud via Voting Step Diffusion

A Unified Framework for 3D Scene Understanding

DFormer: Diffusion-guided Transformer for Universal Image Segmentation

Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery