Abstract:Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in reconstruction quality and multi-view interaction friendliness, hindering their practical application. This paper proposes a faithful and user-friendly iterative solution to tackle these limitations by learning geometry-aligned deep implicit functions from one or multiple sketches. Our method lifts 2D sketches to volume-based feature tensors, which align strongly with the output 3D shape, enabling accurate reconstruction and faithful editing. Such a geometry-aligned feature encoding technique is well-suited to iterative modeling since features from different viewpoints can be easily memorized or aggregated. Based on these advantages, we design a unified interactive system for sketch-based shape modeling. It enables users to generate the desired geometry iteratively by drawing sketches from any number of viewpoints. In addition, it allows users to edit the generated surface by making a few local modifications. We demonstrate the effectiveness and practicality of our method with extensive experiments and user studies, where we found that our method outperformed existing methods in terms of accuracy, efficiency, and user satisfaction. The source code of this project is available at <a class="link-external link-https" href="https://github.com/LordLiang/GA-Sketching" rel="external noopener nofollow">this https URL</a>.

Model-driven sketch reconstruction with structure-oriented retrieval

Sketching Feature-Based Modeling by Capturing Design Intention

Sketch-based 3D Modeling by Aligning Outlines of an Image

Sketch-Based 3D Model Retrieval via Multi-feature Fusion

Sketch-based 3-D modeling for piecewise planar objects in single images

Model-Guided 3D Sketching

Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval

Probabilistic Latent Semantic Analysis for Sketch-Based 3D Model Retrieval

Extended Large Scale Sketch-Based 3D Shape Retrieval.

Reconstruction of 3D Models from Single Sketchy Drawing

3D Sketching for 3D Object Retrieval

Discriminative Sketch-Based 3d Model Retrieval Via Robust Shape Matching

Sketch based modeling and editing via shape space exploration

Efficient Sketch-Based 3D Shape Retrieval via View Selection.

Sketch-based 3D Shape Modeling from Sparse Point Clouds

GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit Functions

Sketch2Scene: sketch-based co-retrieval and co-placement of 3D models

Sketch-based 3D Model Retrieval Utilizing Adaptive View Clustering and Semantic Information

A New Sketch-Based 3D Model Retrieval Approach by Using Global and Local Features

A Novel 3d Model Retrieval System Based On Three-View Sketches

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches