Abstract:The progress of 3D instance segmentation techniques has made it essential for several applications, such as augmented reality, autonomous driving, and robotics. Traditional methods usually have challenges with complex indoor scenes made of multiple objects with different occlusions and orientations. In this work, the authors present an innovative model that integrates a new adaptive n-shifted shuffle (ANSS) attention mechanism with the Generalized Hough Transform (GHT) for robust 3D instance segmentation of indoor scenes. The proposed technique leverages the n-shifted sigmoid activation function, which improves the adaptive shuffle attention mechanism, permitting the network to dynamically focus on relevant features across various regions. A learnable shuffling pattern is produced through the proposed ANSS attention mechanism to spatially rearrange the relevant features, thus augmenting the model's ability to capture the object boundaries and their fine-grained details. The integration of GHT furnishes a vigorous framework to localize and detect objects in the 3D space, even when heavy noise and partial occlusions are present. The authors evaluate the proposed method on the challenging Stanford 3D Indoor Spaces Dataset (S3DIS), where it establishes its superiority over existing methods. The proposed approach achieves state-of-the-art performance in both mean Intersection over Union (IoU) and overall accuracy, showcasing its potential for practical deployment in real-world scenarios. These results illustrate that the integration of the ANSS and the GHT yields a robust solution for 3D instance segmentation tasks.

OccuSeg: Occupancy-Aware 3D Instance Segmentation

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

End-to-End 3D Point Cloud Instance Segmentation Without Detection

Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving

Three-Dimensional Instance Segmentation Using the Generalized Hough Transform and the Adaptive n-Shifted Shuffle Attention

A Unified Framework for 3D Scene Understanding

MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation

PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentation

OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning

Scene as Occupancy

Data-efficient 3D instance segmentation by transferring knowledge from synthetic scans

Open-Ended 3D Point Cloud Instance Segmentation

Learning Occupancy for Monocular 3D Object Detection

Instance-Aware Embedding for Point Cloud Instance Segmentation

Bi-stage Multi-Modal 3D Instance Segmentation Method for Production Workshop Scene

SAI3D: Segment Any Instance in 3D Scenes

Multi-scale deep learning and clustering-based tabletop object instance segmentation for robot manipulation