On General Solution of 3-D Reconstruction from Line Drawing

JF FENG,QY SHI

DOI: https://doi.org/10.1117/12.217426

1995-01-01

Abstract:In this paper, we study the invariant subspace under the fractional linear tranform in the dual space, and give the general solution of trihedrons which are corresponding to a line drawing.

What problem does this paper attempt to address?

Progressive 3D Reconstruction of Planar-Faced Manifold Objects with DRF-Based Line Drawing Decomposition

Changqing Zou,Shifeng Chen,Hongbo Fu,Jianzhuang Liu

DOI: https://doi.org/10.1109/tvcg.2014.2354039

IF: 5.2

2014-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:This paper presents an approach for reconstructing polyhedral objects from single-view line drawings. Our approach separates a complex line drawing representing a manifold object into a series of simpler line drawings, based on the degree of reconstruction freedom (DRF). We then progressively reconstruct a complete 3D model from these simpler line drawings. Our experiments show that our decomposition algorithm is able to handle complex drawings which are challenging for the state of the art. The advantages of the presented progressive 3D reconstruction method over the existing reconstruction methods in terms of both robustness and efficiency are also demonstrated.
Separation of Line Drawings Based on Split Faces for 3D Object Reconstruction

Changqing Zou,Heng Yang,Jianzhuang Liu

DOI: https://doi.org/10.1109/CVPR.2014.94

2014-01-01

Abstract:Reconstructing 3D objects from single line drawings is often desirable in computer vision and graphics applications. If the line drawing of a complex 3D object is decomposed into primitives of simple shape, the object can be easily reconstructed. We propose an effective method to conduct the line drawing separation and turn a complex line drawing into parametric 3D models. This is achieved by recursively separating the line drawing using two types of split faces. Our experiments show that the proposed separation method can generate more basic and simple line drawings, and its combination with the example-based reconstruction can robustly recover wider range of complex parametric 3D objects than previous methods.
A Computational Approach to Joint Line Detection on Triangular Meshes.

Xunnian Yang,Jianmin Zheng,Desheng Wang

DOI: https://doi.org/10.1007/s00366-012-0303-9

2014-01-01

Engineering Computations

Abstract:In this paper, we present formulae for evaluating differential quantities at vertices of triangular meshes that may approximate potential piecewise smooth surfaces with discontinuous normals or discontinuous curvatures at the joint lines. We also define the C (1) and C (2) discontinuity measures for surface meshes using changing rates of one-sided curvatures or changing rates of curvatures across mesh edges. The curvatures are computed discretely as of local interpolating surfaces that lie within a tolerance to the mesh. Together with proper estimation of local shape parameters, the obtained discontinuity measures own properties like sensitivity to salient joint lines and being scale invariant. A simple algorithm is finally developed for detection of C (1) or C (2) discontinuity joint lines on triangular meshes with even highly non-uniform triangulations. Several examples are provided to demonstrate the effectiveness of the proposed method.
An Example-Based Approach to 3D Man-Made Object Reconstruction from Line Drawings

Changqing Zou,Tianfan Xue,Xiaojiang Peng,Honghua Li,Baochang Zhang,Ping Tan,Jianzhuang Liu

DOI: https://doi.org/10.1016/j.patcog.2016.05.031

IF: 8

2016-01-01

Pattern Recognition

Abstract:Recovering 3D geometry from a single 2D line drawing is an important and challenging problem in computer vision. It has wide applications in interactive 3D modeling from images, computer-aided design, and 3D object retrieval. Previous methods of 3D reconstruction from line drawings are mainly based on a set of heuristic rules. They are not robust to sketch errors and often fail for objects that do not satisfy the rules. In this paper, we propose a novel approach, called example-based 3D object reconstruction from line drawings, which is based on the observation that a natural or man-made complex 3D object normally consists of a set of basic 3D objects. Given a line drawing, a graphical model is built where each node denotes a basic object whose candidates are from a 3D model (example) database. The 3D reconstruction is solved using a maximum-a-posteriori (MAP) estimation such that the reconstructed result best fits the line drawing. Our experiments show that this approach achieves much better reconstruction accuracy and are more robust to imperfect line drawings than previous methods.
Survey on 3D Reconstruction from Single Line Drawings

Jin-xin ZHENG,Zhi TANG,Yong-tao WANG

DOI: https://doi.org/10.3969/j.issn.1002-137X.2014.01.006

2014-01-01

Computer Science

Abstract:Reconstructing the three-dimensional structure of an object from single line drawings is an important issue in the field of machine vision.Its applications include three-dimensional design and hand drawing based creation,conversion of existing engineering drawings to solid models,single natural image based 3Dreconstruction,image understanding and retrieval.This paper presented our taxonomy of the existing methods,and reviewed the relevant methods according to the types of algorithms they use.Finally,we concluded the achievements and drawbacks of the existing methods of 3D reconstruction from single line drawings,and pointed out some future directions of research.
Solid Geometric Object Reconstruction from Single Line Drawing Image.

Jinxin Zheng,Yongtao Wang,Zhi Tang

DOI: https://doi.org/10.5220/0005261203910400

2015-01-01

Abstract:We present a robust method to reconstruct solid geometric object from single line drawing image taken from the geometric books. Unlike most of the existing methods which require perfect and complete sketches of the line drawings as the inputs, our method directly takes the line drawing images as the inputs and can well handle the incomplete sketches that are automatically produced by our sketch extraction algorithm. The proposed method consists of three major steps as follows: First, the sketch of the input line drawing (i.e., line segments and their intersections) is automatically extracted and further represented as an undirected graph. Second, candidate 3D models from the pre-built 3D model database are found by graph matching. Third, for each candidate 3D model, the model parameters, the rotation and the translation aligning the model with the sketch, are found by optimizing an objective function which is composed of the residuals between the vertices of the sketch and the 2D projections of the candidate modelâs vertices, and an optimal reconstruction solution is further selected as the final result. Experimental results show that our method can effectively reconstruct the solid geometric object from single line drawing image.
3D Object Reconstruction by Point Coordinates of 2D Line Drawings

Dan Hao,Wuqiang,Shen Dong,Lijun

2013-01-01

Abstract:It is a research subject in computer vision to 3D reconstruction of an object represented by a single 2D line drawing.Previous works on 3D reconstruction from 2D line drawings focus on objects with lines,plane,view,and so on.This paper mainly studies the 3D reconstruction from 2D line drawings.Besides,a new approach is proposed:it is that for the research of the point coordinates of 2D line drawings,so as to achieve the object reconstruction by the reconstruction of point coordinates.The reconstruction process includes:① the collection of point coordinates (X,Y) of 2D line drawings;② the derivation of mathematical formula about the reconstruction of the point of 2D line drawings,and calculating the corresponding point of the 3D coordinates;③ the regeneration of 3D graphics with 3D points;④ analyze error by the proportional of parallel of axonometric projection,in order to prove the accuracy of the method.
Reconstruction of Curved Solids from Engineering Drawings

SX Liu,SM Hu,YJ Chen,JG Sun

DOI: https://doi.org/10.1016/s0010-4485(00)00143-3

2001-01-01

Abstract:This paper presents a new approach for reconstructing solids with planar, quadric and toroidal surfaces from three-view engineering drawings. By applying geometric theory to 3-D reconstruction, our method is able to remove restrictions placed on the axes of curved surfaces by existing methods. The main feature of our algorithm is that it combines the geometric properties of conics with affine properties to recover a wider range of 3-D edges. First, the algorithm determines the type of each 3-D candidate conic edge based on its projections in three orthographic views, and then generates that candidate edge using the conjugate diameter method. This step produces a wire-frame model that contains all candidate vertices and candidate edges. Next, a maximum turning angle method is developed to find all the candidate faces in the wire-frame model. Finally, a general and efficient searching technique is proposed for finding valid solids from the candidate faces; the technique greatly reduces the searching space and the backtracking incidents. Several examples are given to demonstrate the efficiency and capability of the proposed algorithm.
Automatic 3D Reconstruction of a Polyhedral Object from a Single Line Drawing under Perspective Projection.

Hao Yang,Hui Zhang

DOI: https://doi.org/10.1016/j.cag.2017.04.003

IF: 1.821

2017-01-01

Computers & Graphics

Abstract:A novel method is proposed to automatically recover a 3D polyhedral object from a single 2D line drawing in perspective projection. In the algorithm, a camera calibration based on partial orthogonality is performed in order to retrieve multiple pinhole cameras. Then, 3D orientations of edge lines are estimated by a factor graph inference. Finally, 3D reconstruction is conducted through hybrid optimization by combining beam search with simulated annealing. Parameterization based on inverse depths is proposed to reduce the dimension of variables in optimization. Experimental results show that the algorithm proposed in the study can reconstruct reasonable 3D objects from perspective-projected line drawings, which cannot be handled by existing approaches. Qualitative and quantitative comparisons are provided to illustrate the advantages of the proposed method. (C) 2017 Elsevier Ltd. All rights reserved.
Geometric Object 3D Reconstruction from Single Line Drawing Image with Bottom-Up and Top-Down Classification and Sketch Generation.

Ting Guo,Yongtao Wang,Yafeng Zhou,Zheqi He,Zhi Tang

DOI: https://doi.org/10.1109/icdar.2017.115

2017-01-01

Abstract:Since geometric objects are usually illustrated as 2D line drawings with the loss of depth information, it is difficult for people to fully understand the geometric structure of them. Most of the existing 3D reconstruction methods require the input to be perfect sketch of the line drawing, therefore they are not suitable when only line drawing image is offered. To address this problem, we propose a robust reconstruction method that can directly conduct reconstruction from the input single line drawing image. Our main contribution is that we introduce a bottom-up and top-down scheme to the task of geometric object 3D reconstruction. First, for the sub-task of geometric object classification, we perform a bottom-up process of geometric features extraction together with a top-down process of additional feature searching to classify the geometric object. Second, for the sub-task of sketch completion, we complete the sketch extracted from the geometric object's contour based on the class of the geometric object, in a top-down manner. Extensive experimental results demonstrate that our approach can improve in both accuracy and efficiency compared with the existing methods.
Solid Reconstruction Using Recognition of Quadric Surfaces from Orthographic Views.

Jie-Hui Gong,Hui Zhang,Gui-Fang Zhang,Jia-Guang Sun

DOI: https://doi.org/10.1016/j.cad.2006.04.009

2006-01-01

Abstract:The reconstruction of 3D objects from 2D orthographic views is crucial for maintaining and further developing existing product designs. A B-rep oriented method for reconstructing curved objects from three orthographic views is presented by employing a hybrid wire-frame in place of an intermediate wire-frame. The Link-Relation Graph (LRG) is introduced as a multi-graph representation of orthographic views, and quadric surface features (QSFs) are defined by special basic patterns of LRG as well as aggregation rules. By hint-based pattern matching in the LRGs of three orthographic views in an order of priority, the corresponding QSFs are recognized, and the geometry and topology of quadric surfaces are recovered simultaneously. This method can handle objects with interacting quadric surfaces and avoids the combinatorial search for tracing all the quadric surfaces in an intermediate wire-frame by the existing methods. Several examples are provided.
General surface reconstruction from a set of planar contours

Meihe Xu,Zesheng Tang

1997-01-01

Abstract:A general solution to 3D reconstruction of the complex shaped objects defined by a set of contours is proposed. Special attention is paid to the correspondence and branching problems. In order to make the solution to suit the objects that have holes, the inclusion detections for all contours are made. Then, a new metric, which determines the position relationship between two adjacent contours, is defined to solve the correspondence problem. Next, the branching problems, including non-singular and singular branching, is completely solved by decomposing it into several simple links from one to one loop. Finally, these methods have been applied to the reconstruction of the external surface of complex shaped objects such as skull, artery, pituitary and nerve in the cellar region of human brain. The results show that the presented methods are practicable and satisfactory.
3D RECONSTRUCTION BASED ON 2D VIEW FEATURE

Wei GAO,Qun-Sheng PENG

DOI: https://doi.org/10.3321/j.issn:0254-4164.1999.05.006

1999-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:The concept of two dimensional (2D) view features, based on global macroscopical structure, topological structure of engineering drawing and projection rule of 3D features on the three orthogonal view planes was proposed. By recognition and matching of relative 2D view features, the corresponding 3D basic features were extracted and the feature chain was built, then the 3D feature-based model was reconstructed. With the relation between 2D view features and 3D basic features, the integrated algorithm for multi-view parametrization driven by dimensions, 3D parameter and 3D reconstruction was developed. The experimental results have shown that the algorithm based on 2D view features is simple and feasible.
Three-Dimensional Algebraic Reconstruction from Three Mutually Orthogonal Projections

Ximen Jiye,Shao Zhifeng

DOI: https://doi.org/10.1017/s0424820100118400

1985-01-01

Abstract:The classic reconstruction problem is that of reconstructing a 3D object from its 2D projections /1-5/. It is also well known that the principal difficulty in solving this problem in electron microscopy is that a very large number of independent projections are normally required. Recently it has been shown /3,4/ that if we restrict our attention to binary or Boolean objects, far fewer projections are needed in order to obtain an approximate solution. 2-dimensional solutions of ID projections were demonstrated using only four views and 3-dimensional reconstruction of 2D projections were obtained by dividing the projections into identifiable slices.In the present paper, an algebraic reconstruction technique (ART) has been studied which uses three mutually orthogonal projections.
Efficient Depth Restoration from 2D Line Drawings with Line Segments and Curves

Kunyu Cai,Hui Zhang

DOI: https://doi.org/10.1109/cadgraphics.2015.43

2015-01-01

Abstract:A 2D line drawing is a direct way to illustrate a 3D object. 3D reconstruction from a 2D single line drawing is an important research topic in the area of computer vision and geometric modeling. In this paper, we present an approach to reconstruct objects from single 2D line drawings with line segments, arcs and B-splines. Firstly, planar and curved faces are identified in the line drawing. Then, with a depth estimation algorithm to establish the initial depth of the vertices, the wireframe is reconstructed by hierarchical optimization-based method. Finally, planar and curved faces are reconstructed. The experimental results show that the recovered objects correspond to the human perception. The time complexity shows that our approach is in high-efficiency.
Embedding Visual Cognition in 3D Reconstruction from Multi-View Engineering Drawings

WD Geng,JB Wang,YY Zhang

DOI: https://doi.org/10.1016/s0010-4485(01)00092-6

IF: 3.652

2002-01-01

Computer-Aided Design

Abstract:In this paper we discuss how to reconstruct 3D models from multi-view engineering draws by employing human engineers’ approaches. Human's ‘divide and conquer’ interpretation strategy in visual cognition is simulated, and successfully carried out on the basis of spatial division of 3D object space. At first, a volume-oriented method is utilized to decompose the 3D object space in a set of 3D ‘cell-boxes’ whose three-view bounding rectangles will isolate its related sub-projections from input projections views, and in every cell-box a cell primitive is implied. Then, a 3D model of each cell primitive is ‘locally’ generated from its ‘sub-projection’ views by wire-frame oriented algorithms. The final interpretation result of the overall projection-views is a ‘Union’ of these cell primitives. To deal with the ambiguity, a visual reasoning engine is implemented on the basis of principles from Gestalt psychology. It will be activated to pick out the most reasonable interpretation, when ambiguities are generated during the reconstruction process. The section views are also incorporated in getting rid of the ambiguity. Moreover, we design a natural and convenient interaction way to encourage the user to be involved in the process while interpreting complex projections. The key steps of this human-like reconstruction approach are presented in detail.
A 3D Reconstruction Algorithm Based on 1D Subspace

刘侍刚,彭亚丽,韩崇昭,王英华

DOI: https://doi.org/10.3321/j.issn:1002-0446.2009.03.006

2009-01-01

ROBOT

Abstract:To recover the 3D scene,a 3D reconstruction algorithm based on ID subspace is presented under orthographic projection.It relies on the facts that the rows composed of all the image points span the same linear subspace as the rows composed of the 3D space points and that the basis of the subspace can consist of the two rows composed of the first image points and a row vector which is orthogonal to the former.The row vector is obtained,and lastly the 3D reconstruction is accomplished.The experiments with both simulation and real data show that the algorithm is robust and has small reprojection errors.
Recovering Solid Geometric Object from Single Line Drawing Image

Jinxin Zheng,Yongtao Wang,Zhi Tang

DOI: https://doi.org/10.1007/s11042-015-2966-x

IF: 2.577

2015-01-01

Multimedia Tools and Applications

Abstract:Many educational materials contain a lot of solid geometric figures. The solid geometric objects in these figures are usually drawn as 2D line drawings thus have lost their 3D information. This paper presents a method to recover the 3D information of the solid geometric object from single line drawing image taken from the geometric books, which would be used to help the users better present and understand the solid geometric object on their mobile devices. The main advantage of our method is the abilitYTo handle inaccurately processed sketches as opposed to the previous methods which require perfect line drawings as inputs. Our method consists of three main steps as follows. First, the sketch of the input line drawing image is automatically extracted and further represented as an undirected graph. Second, candidate 3D models from the pre-built 3D model database are found by graph similarity-based searching and sub-graph isomorphism matching. Third, for each candidate 3D model, the model parameters, the rotation and the translation aligning the model with the sketch are found by minimizing an objective function which is composed of the residuals between the vertices of the sketch and the 2D projections of the candidate model's vertices, and an optimal reconstruction solution is further selected as the final result. Extensive experimental results demonstrate the effectiveness and robustness of our method for recovering the solid geometric object from single line drawing image.
Dimension Recognition And Geometry Reconstruction In Vectorization Of Engineering Drawings

Feng Su,Jiqiang Song,Chiew-lan Tai,Shijie Cai

DOI: https://doi.org/10.1109/CVPR.2001.990545

2001-01-01

Abstract:This paper presents a novel approach for recognizing and interpreting dimensions in engineering drawings. It starts by detecting potential dimension frames, each comprising only the line and text components of a dimension, then verifies them by detecting the dimension symbols. By removing the prerequisite of symbol recognition from detection of dimension sets, our method is capable of handling low quality drawings. We also propose a reconstruction algorithm for rebuilding the drawing entities based on the recognized dimension annotations. A coordinate grid structure is introduced to represent and analyze two-dimensional spatial constraints between entities; this simplifies and unifies the process of rectifying deviations of entity dimensions induced during scanning and vectorization.
Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings

Jia Zheng,Yifan Zhu,Kehan Wang,Qiang Zou,Zihan Zhou

2022-01-01

Abstract: In this paper, we revisit the long-standing problem of automatic reconstruction of 3D objects from single line drawings. Previous optimization-based methods can generate compact and accurate 3D models, but their success rates depend heavily on the ability to (i) identifying a sufficient set of true geometric constraints, and (ii) choosing a good initial value for the numerical optimization. In view of these challenges, we propose to train deep neural networks to detect pairwise relationships among geometric entities (i.e., edges) in the 3D object, and to predict initial depth value of the vertices. Our experiments on a large dataset of CAD models show that, by leveraging deep learning in a geometric constraint solving pipeline, the success rate of optimization-based 3D reconstruction can be significantly improved.

On General Solution of 3-D Reconstruction from Line Drawing

Progressive 3D Reconstruction of Planar-Faced Manifold Objects with DRF-Based Line Drawing Decomposition

Separation of Line Drawings Based on Split Faces for 3D Object Reconstruction

A Computational Approach to Joint Line Detection on Triangular Meshes.

An Example-Based Approach to 3D Man-Made Object Reconstruction from Line Drawings

Survey on 3D Reconstruction from Single Line Drawings

Solid Geometric Object Reconstruction from Single Line Drawing Image.

3D Object Reconstruction by Point Coordinates of 2D Line Drawings

Reconstruction of Curved Solids from Engineering Drawings

Automatic 3D Reconstruction of a Polyhedral Object from a Single Line Drawing under Perspective Projection.

Geometric Object 3D Reconstruction from Single Line Drawing Image with Bottom-Up and Top-Down Classification and Sketch Generation.

Solid Reconstruction Using Recognition of Quadric Surfaces from Orthographic Views.

General surface reconstruction from a set of planar contours

3D RECONSTRUCTION BASED ON 2D VIEW FEATURE

Three-Dimensional Algebraic Reconstruction from Three Mutually Orthogonal Projections

Efficient Depth Restoration from 2D Line Drawings with Line Segments and Curves

Embedding Visual Cognition in 3D Reconstruction from Multi-View Engineering Drawings

A 3D Reconstruction Algorithm Based on 1D Subspace

Recovering Solid Geometric Object from Single Line Drawing Image

Dimension Recognition And Geometry Reconstruction In Vectorization Of Engineering Drawings

Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings