Abstract:The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for novice users. Sketch-based 3D modeling provides a promising solution by leveraging the intuitive nature of human-computer interaction. However, generating high-quality content that accurately reflects the creator's ideas can be challenging due to the sparsity and ambiguity of sketches. Furthermore, novice users often find it challenging to create accurate drawings from multiple perspectives or follow step-by-step instructions in existing methods. To address this, we introduce a groundbreaking end-to-end approach in our work, enabling 3D modeling from a single free-hand sketch, Deep3DSketch+$\backslash$+. The issue of sparsity and ambiguity using single sketch is resolved in our approach by leveraging the symmetry prior and structural-aware shape discriminator. We conducted comprehensive experiments on diverse datasets, including both synthetic and real data, to validate the efficacy of our approach and demonstrate its state-of-the-art (SOTA) performance. Users are also more satisfied with results generated by our approach according to our user study. We believe our approach has the potential to revolutionize the process of 3D modeling by offering an intuitive and easy-to-use solution for novice users.

3D Sketching in AutoSketch

Sketching Feature-Based Modeling by Capturing Design Intention

Computer-Aided Sketching for 3D Conceptual configuration of Product: State-of-the-Art

Research on Technologies of Computer Aided Sketching Design

Model-Guided 3D Sketching

PENCIL: A Framework for Expressing Free-Hand Sketching in 3D

An online sketching and gesture editing system for conceptual design

Sketch-based 3D Modeling by Aligning Outlines of an Image

Research and Implementation of the Sketching Design System

Using the CAT for 3D Sketching in Front of Large Displays

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

A 3D Sketch-Based Modeling Design System with Paper-and-Pencil Interface

SmartCanvas: Context-inferred Interpretation of Sketches for Preparatory Design Studies.

A 3d Sketching Interacting Tool For Physical Simulation Based On Web

A Survey and Prospects of Computer Aided Sketch Technology

Model-driven sketch reconstruction with structure-oriented retrieval

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

Three-dimension Sketch Design Oriented to Product Innovation

High-Fidelity 3D Model Generation with Relightable Appearance from Single Freehand Sketches and Text Guidance

Smartpaper: an Interactive and User Friendly Sketching System

Sketching Reality