Abstract:3D symmetry detection is a fundamental problem in computer vision and graphics. Most prior works detect symmetry when the object model is fully known, few studies symmetry detection on objects with partial observation, such as single RGB-D images. Recent work addresses the problem of detecting symmetries from incomplete data with a deep neural network by leveraging the dense and accurate symmetry annotations. However, due to the tedious labeling process, full symmetry annotations are not always practically available. In this work, we present a 3D symmetry detection approach to detect symmetry from single-view RGB-D images without using symmetry supervision. The key idea is to train the network in a weakly-supervised learning manner to complete the shape based on the predicted symmetry such that the completed shape be similar to existing plausible shapes. To achieve this, we first propose a discriminative variational autoencoder to learn the shape prior in order to determine whether a 3D shape is plausible or not. Based on the learned shape prior, a symmetry detection network is present to predict symmetries that produce shapes with high shape plausibility when completed based on those symmetries. Moreover, to facilitate end-to-end network training and multiple symmetry detection, we introduce a new symmetry parametrization for the learning-based symmetry estimation of both reflectional and rotational symmetry. The proposed approach, coupled symmetry detection with shape completion, essentially learns the symmetry-aware shape prior, facilitating more accurate and robust symmetry detection. Experiments demonstrate that the proposed method is capable of detecting reflectional and rotational symmetries accurately, and shows good generality in challenging scenarios, such as objects with heavy occlusion and scanning noise. Moreover, it achieves state-of-the-art performance, improving the F1-score over the existing supervised learning method by 2%-11% on the ShapeNet and ScanNet datasets.

Beyond Planar Symmetry: Modeling Human Perception of Reflection and Rotation Symmetries in the Wild

Attention based: modeling human perception of reflectional symmetry in the wild

Multiresolution Rotational Symmetry Detection Via Radius-Based Frieze-Expansion.

SymmetryNet

PRS-Net: Planar Reflective Symmetry Detection Net for 3D Models

Symmetry Strikes Back: From Single-Image Symmetry Detection to 3D Generation

NeRD: Neural 3D Reflection Symmetry Detector

Learning to Detect 3D Reflection Symmetry for Single-View Reconstruction

Coupled Structure-from-motion and 3D Symmetry Detection for Urban Facades

Learning to Detect 3D Symmetry from Single-View RGB-D Images with Weak Supervision

A Fast and Efficient 3D Reflection Symmetry Detector Based on Neural Networks.

Learning-based Real-time Detection of Intrinsic Reflectional Symmetry

Learning-based Intrinsic Reflectional Symmetry Detection

SymmNeRF: Learning to Explore Symmetry Prior for Single-View View Synthesis

Robust Symmetry Detection via Riemannian Langevin Dynamics

Using Machine Learning to Detect Rotational Symmetries from Reflectional Symmetries in 2D Images

2017 ICCV Challenge: Detecting Symmetry in the Wild.

3D Symmetry Detection by a Single Image and Geometric Transformation

SNeS: Learning Probably Symmetric Neural Surfaces from Incomplete Data

Symmetry Perception by Deep Networks: Inadequacy of Feed-Forward Architectures and Improvements with Recurrent Connections

Symmetry perception with spiking neural networks