Abstract:In 3D point cloud-based object detection, attention mechanism in Group-Free [1] learns direct relationships between proposals and all seed points, providing each proposal with a global context in the form of a cross-attention map. However, our analysis and experimental comparison show that the attention mechanism assigns inappropriately large attention weights to certain seed points far from a proposal, which is not conducive to detecting objects correctly. In this work, we alleviate the above problem by proposing a mask method. For an initial proposal, our method first calculates a spatial distance-based mask, which measures the spatial relationship between all seed points and the proposal. Then, we fuse the mask into cross-attention layers in stacked attention modules and get a refined cross-attention map. In essence, our mask gives each proposal a local context; after it is fused with the global context given by the attention mechanism, the refined cross-attention map could suppress the negative impact of some distant seed points on a proposal. We present two alternative strategies to compute the mask, a hard mask, and a soft mask. Experimental results demonstrate that the soft mask brings better performance. In the soft mask, for each initial proposal's 3D-box shape, we use a parametric approximate ellipsoid as the basis of the mask's calculation, which has only two learnable parameters. Experimental results show our work could outperform Group-Free 0.7 mAP@0.25 at the cost of increasing inference time by less than 1%. The performance of our algorithm on the public dataset SUN RGB-D is 63.7 mAP@0.25 and 45.5 mAP@0.5, which is the best performance among algorithms that preserve the irregular of seed points.

An Efficient Connected-Component Labeling Algorithm for 3-D Binary Images

A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN

Region Labeling Algorithm Based on Boundary Tracking for Binary Image

Connected Component Labeling Algorithm Based on Run Recursive Method

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Run-Based Connected Components Labeling Using Double-Row Scan.

An Optimized Run-Length Based Algorithm for Sparse Remote Sensing Image Labeling

Efficient Path-Reconstruction Operator

An Efficient Ungrouped Mask Method with Two Learnable Parameters for 3D Object Detection

AVFP-MVX: Multimodal VoxelNet with Attention Mechanism and Voxel Feature Pyramid

An efficient interactive multi-label segmentation tool for 2D and 3D medical images using fully connected conditional random field

An Efficient Encoding Voxel-Based Segmentation (EVBS) Algorithm Based on Fast Adjacent Voxel Search for Point Cloud Plane Segmentation

Learning to group and label fine-grained shape components

Attentional Keypoint Detection on Point Clouds for 3D Object Part Segmentation

BRoPH: An efficient and compact binary descriptor for 3D point clouds

Visual Boundary-Guided Pseudo-Labeling for Weakly Supervised 3D Point Cloud Segmentation in Indoor Environments

Hardware Implementation Of Connected Components Analysis For The Vision-Based Tactile Perception Image

MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation

VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation

Untargeted Attack on Targeted-Label for Multi-Label Image Classification

Label-Efficient 3D Brain Segmentation via Complementary 2D Diffusion Models with Orthogonal Views