Abstract:Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in reconstruction quality and multi-view interaction friendliness, hindering their practical application. This paper proposes a faithful and user-friendly iterative solution to tackle these limitations by learning geometry-aligned deep implicit functions from one or multiple sketches. Our method lifts 2D sketches to volume-based feature tensors, which align strongly with the output 3D shape, enabling accurate reconstruction and faithful editing. Such a geometry-aligned feature encoding technique is well-suited to iterative modeling since features from different viewpoints can be easily memorized or aggregated. Based on these advantages, we design a unified interactive system for sketch-based shape modeling. It enables users to generate the desired geometry iteratively by drawing sketches from any number of viewpoints. In addition, it allows users to edit the generated surface by making a few local modifications. We demonstrate the effectiveness and practicality of our method with extensive experiments and user studies, where we found that our method outperformed existing methods in terms of accuracy, efficiency, and user satisfaction. The source code of this project is available at <a class="link-external link-https" href="https://github.com/LordLiang/GA-Sketching" rel="external noopener nofollow">this https URL</a>.

Investigation and Implementation of Sketch Based 3D Modeling System

Sketching Feature-Based Modeling by Capturing Design Intention

Research and Implementation of the Sketching Design System

Model-driven sketch reconstruction with structure-oriented retrieval

Sketch-based 3-D modeling for piecewise planar objects in single images

Computer-Aided Sketching for 3D Conceptual configuration of Product: State-of-the-Art

Sketch-based 3D Modeling by Aligning Outlines of an Image

Model-Guided 3D Sketching

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

PENCIL: A Framework for Expressing Free-Hand Sketching in 3D

An online sketching and gesture editing system for conceptual design

A Survey of Sketch Based Modeling Systems

The Parameter Extraction and Curve Fitting of Strokes from Sketchy Graphics

Research on Free Modeling Method Based on Free Hand Sketching

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit Functions

A 3d Sketching Interacting Tool For Physical Simulation Based On Web

Three-dimension Sketch Design Oriented to Product Innovation

An Interactive Image-based Modeling System

Method of generating three-dimensional scene model

Sketch-based 3D face modeling for virtual character