Abstract:Geometric objects in educational materials are usually illustrated as 2D line drawings without depth information, and this is a barrier for readers to fully understand the 3D structure of these geometric objects. To address this issue, we propose a novel method to recover the 3D shape of the geometric object from a single 2D line drawing image. Specifically, our proposed method can be divided into two stages: sketch extraction stage and reconstruction stage. In the sketch extraction stage, we propose a deep neural network to identify the category of the geometric object in the line drawing image and extract its sketch simultaneously. Our network architecture is based on High-Resolution Network (HRNet), which integrates two task-specific decoders: one for classification and the other for vertices detection. With the predicted category and location of vertices, we can easily obtain the sketch of the geometric object in the input line drawing image. Compared with previous methods, our CNN-based method can directly extract the sketch of geometric objects without any hand-crafted features or processes, which gives a more robust performance. In the reconstruction stage, we exploit an example-based method and conduct the reconstruction by optimizing an objective function of reconstruction error. Moreover, we generate a simulated dataset to alleviate the problem caused by unbalanced distribution across different categories in the manually-collected dataset, which greatly improves the performance of our deep neural network model. Extensive experimental results demonstrate that the proposed method performs significantly better than the existing methods in both accuracy and efficiency.

Solid Geometric Object Reconstruction from Single Line Drawing Image.

Recovering Solid Geometric Object from Single Line Drawing Image

An Example-Based Approach to 3D Man-Made Object Reconstruction from Line Drawings

Separation of Line Drawings Based on Split Faces for 3D Object Reconstruction

Geometric Object 3D Reconstruction from Single Line Drawing Image with Bottom-Up and Top-Down Classification and Sketch Generation.

Sketch-based 3-D modeling for piecewise planar objects in single images

Progressive 3D Reconstruction of Planar-Faced Manifold Objects with DRF-Based Line Drawing Decomposition

Sketch-based 3D Modeling by Aligning Outlines of an Image

Precise 3d reconstruction from a single image

Geometric Object 3D Reconstruction from Single Line Drawing Image Based on a Network for Classification and Sketch Extraction

Model-driven sketch reconstruction with structure-oriented retrieval

3D Object Reconstruction by Point Coordinates of 2D Line Drawings

Survey on 3D Reconstruction from Single Line Drawings

Object Reconstruction from Geometric Features and Constraints in Reverse Engineering

Efficient Depth Restoration from 2D Line Drawings with Line Segments and Curves

Context-aware Geometric Object Reconstruction for Mobile Education

Automatic 3D Reconstruction of a Polyhedral Object from a Single Line Drawing under Perspective Projection.

Bottom-up/Top-down Geometric Object Reconstruction with CNN Classification for Mobile Education.

Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings

Line-Based 3D Building Abstraction and Polygonal Surface Reconstruction From Images

Single Image Based 3D Symmetric Free-Form Objects Reconstruction