Abstract:Single-image 3-D reconstruction has long been a challenging problem. Recent deep learning approaches have been introduced to this 3-D area, but the ability to generate point clouds still remains limited due to inefficient and expensive 3-D representations, the dependency between the output and the number of model parameters, or the lack of a suitable computing operation. In this article, we present a novel deep-learning-based method to reconstruct a point cloud of an object from a single still image. The proposed method can be decomposed into two steps: feature fusion and deformation. The first step extracts both global and point-specific shape features from a 2-D object image, and then injects them into a randomly generated point cloud. In the second step, which is deformation, we introduce a new layer termed as GraphX that considers the interrelationship between points like common graph convolutions but operates on unordered sets. The framework can be applicable to realistic image data with background as we optionally learn a mask branch to segment objects from input images. To complement the quality of point clouds, we further propose an objective function to control the point uniformity. In addition, we introduce different variants of GraphX that cover from best performance to best memory budget. Moreover, the proposed model can generate an arbitrary-sized point cloud, which is the first deep method to do so. Extensive experiments demonstrate that we outperform the existing models and set a new height for different performance metrics in single-image 3-D reconstruction.

3D-ARNet: An accurate 3D point cloud reconstruction network from a single-image

An 3D Point Cloud Reconstruction Approach from Single Image for Smart Power Plant

3D Point Cloud Generation Reconstruction from Single Image Based on Image Retrieval

Adaptive Recurrent Forward Network for Dense Point Cloud Completion

3D-Isrnet

3D-Isrnet:Generating 3d Point Clouds Through Image Similarity Retrieval in A Complex Background from a Single Image

Part-Wise AtlasNet for 3D Point Cloud Reconstruction from a Single Image

RFNet - Recurrent Forward Network for Dense Point Cloud Completion.

3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-Lmnet from Single Image

3D-CDRNet: Retrieval-based dense point cloud reconstruction from a single image under complex background

Dense Point Cloud Reconstruction by Shape and Pose Features Learning

Visual Enhanced 3D Point Cloud Reconstruction from A Single Image

A Single Stage and Single View 3D Point Cloud Reconstruction Network Based on DetNet

Deep Point Cloud Reconstruction

RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

Single-Image 3-D Reconstruction: Rethinking Point Cloud Deformation

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

P2CADNet: An End-to-End Reconstruction Network for Parametric 3D CAD Model from Point Clouds

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

UNeR3D: Versatile and Scalable 3D RGB Point Cloud Generation from 2D Images in Unsupervised Reconstruction

3D Reconstruction of Simple Objects from A Single View Silhouette Image