Abstract:Deep learning approaches to estimating full 3D orientations of objects, in addition to object classes, are limited in their accuracies, due to the difficulty in learning the continuous nature of three-axis orientation variations by regression or classification with sufficient generalization. This paper presents a novel progressive deep learning framework, herein referred to as 3D POCO Net, that offers high accuracy in estimating orientations about three rotational axes yet with efficiency in network complexity. The proposed 3D POCO Net is configured, using four PointNet-based networks for independently representing the object class and three individual axes of rotations. The four independent networks are linked by in-between association subnetworks that are trained to progressively map the global features learned by individual networks one after another for fine-tuning the independent networks. In 3D POCO Net, high accuracy is achieved by combining a high precision classification based on a large number of orientation classes with a regression based on a weighted sum of classification outputs, while high efficiency is maintained by a progressive framework by which a large number of orientation classes are grouped into independent networks linked by association subnetworks. We implemented 3D POCO Net for full three-axis orientation variations and trained it with about 146 million orientation variations augmented from the ModelNet10 dataset. The testing results show that we can achieve an orientation regression error of about 2.5° with about 90% accuracy in object classification for general three-axis orientation estimation and object classification. Furthermore, we demonstrate that a pre-trained 3D POCO Net can serve as an orientation representation platform based on which orientations as well as object classes of partial point clouds from occluded objects are learned in the form of transfer learning.

OCNN: Point Cloud-Based Convolutional Neural Network for Object Orientation Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Rethinking Local-to-global Representation Learning for Rotation-Invariant Point Cloud Analysis

POIRot: A rotation invariant omni-directional pointnet

3D Convolution on RGB-D Point Clouds for Accurate Model-free Object Pose Estimation

A novel GCN-based point cloud classification model robust to pose variances

OCMG-Net: Neural Oriented Normal Refinement for Unstructured Point Clouds

OACNNs: Orientation adaptive convolutional neural networks

Cy-CNN: cylinder convolution based rotation-invariant neural network for point cloud registration

Convolutional Neural Network Powered Identification of the Location and Orientation of Human Body Via Human Form Point Cloud

A multilevel object pose estimation algorithm based on point cloud keypoints

Progressive Deep Learning Framework for Recognizing 3D Orientations and Object Class Based on Point Cloud Representation

Siamese Neural Pointnet: 3D Face Verification under Pose Interference and Partial Occlusion

Rotation-Invariant Point Cloud Representation for 3-D Model Recognition

A Novel Robust Algorithm for Position and Orientation Detection Based on Cascaded Deep Neural Network

PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registration

Asymmetrical Siamese Network for Point Clouds Normal Estimation

3D Orientation Estimation and Vanishing Point Extraction from Single Panoramas Using Convolutional Neural Network

OCM3D: Object-Centric Monocular 3D Object Detection

Orientation Convolutional Networks for Image Recognition

Position-robust Optronic Convolutional Neural Networks Dealing with Images Position Variation