Abstract:3D symmetry detection is a fundamental problem in computer vision and graphics. Most prior works detect symmetry when the object model is fully known, few studies symmetry detection on objects with partial observation, such as single RGB-D images. Recent work addresses the problem of detecting symmetries from incomplete data with a deep neural network by leveraging the dense and accurate symmetry annotations. However, due to the tedious labeling process, full symmetry annotations are not always practically available. In this work, we present a 3D symmetry detection approach to detect symmetry from single-view RGB-D images without using symmetry supervision. The key idea is to train the network in a weakly-supervised learning manner to complete the shape based on the predicted symmetry such that the completed shape be similar to existing plausible shapes. To achieve this, we first propose a discriminative variational autoencoder to learn the shape prior in order to determine whether a 3D shape is plausible or not. Based on the learned shape prior, a symmetry detection network is present to predict symmetries that produce shapes with high shape plausibility when completed based on those symmetries. Moreover, to facilitate end-to-end network training and multiple symmetry detection, we introduce a new symmetry parametrization for the learning-based symmetry estimation of both reflectional and rotational symmetry. The proposed approach, coupled symmetry detection with shape completion, essentially learns the symmetry-aware shape prior, facilitating more accurate and robust symmetry detection. Experiments demonstrate that the proposed method is capable of detecting reflectional and rotational symmetries accurately, and shows good generality in challenging scenarios, such as objects with heavy occlusion and scanning noise. Moreover, it achieves state-of-the-art performance, improving the F1-score over the existing supervised learning method by 2%-11% on the ShapeNet and ScanNet datasets.

Large-Baseline Matching And Reconstruction From Symmetry Cells

Symmetry-based 3-D Reconstruction from Perspective Images

Coupled Structure-from-motion and 3D Symmetry Detection for Urban Facades

Efficient Large Scale Stereo Matching Based on Cross-Scale.

On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image

3D Symmetry Detection by a Single Image and Geometric Transformation

Symmetry-aware Graph Matching.

Symmetry Strikes Back: From Single-Image Symmetry Detection to 3D Generation

Learning to Detect 3D Reflection Symmetry for Single-View Reconstruction

Learning to Detect 3D Symmetry from Single-View RGB-D Images with Weak Supervision

Geometry-aware Feature Matching for Large-Scale Structure from Motion

SymmetryNet

An adaptive symmetry detection algorithm based on local features

Symmetry-Aware Semantic Segmentation of a 3D Human Body Model

Symmetry-aware Kinematic Skeleton Generation of a 3D Human Body Model.

Application of Feature Point Detection and Matching in 3D Objects Reconstruction

Beyond Planar Symmetry: Modeling Human Perception of Reflection and Rotation Symmetries in the Wild

Partial Symmetry Detection for 3D Geometry using Contrastive Learning with Geodesic Point Cloud Patches

Estimating True Symmetry In Scale-Space

Structure and Pose from Single Images of Symmetric Objects with Applications to Robot Navigation

Robust Symmetry Prediction with Multi-Modal Feature Fusion for Partial Shapes