Abstract:We present MV2Cyl, a novel method for reconstructing 3D from 2D multi-view images, not merely as a field or raw geometry but as a sketch-extrude CAD model. Extracting extrusion cylinders from raw 3D geometry has been extensively researched in computer vision, while the processing of 3D data through neural networks has remained a bottleneck. Since 3D scans are generally accompanied by multi-view images, leveraging 2D convolutional neural networks allows these images to be exploited as a rich source for extracting extrusion cylinder information. However, we observe that extracting only the surface information of the extrudes and utilizing it results in suboptimal outcomes due to the challenges in the occlusion and surface segmentation. By synergizing with the extracted base curve information, we achieve the optimal reconstruction result with the best accuracy in 2D sketch and extrude parameter estimation. Our experiments, comparing our method with previous work that takes a raw 3D point cloud as input, demonstrate the effectiveness of our approach by taking advantage of multi-view images.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **reconstructing 3D extrusion cylinders from multi - view images**, rather than relying on the original 3D geometric data. Specifically, the authors propose a new method named MV2Cyl, which aims to directly reconstruct 3D shapes through multi - view images and represent them as sketch - extrude CAD models, rather than just as fields or original geometries. ### Specific Background of the Problem 1. **Limitations of Existing Methods**: - Research on extracting extrusion cylinders from original 3D geometric data (such as point clouds) has been extensive, but the quality of the results is still not satisfactory. - Unsupervised methods, although able to perform well in analyzing the original geometry, face challenges in accurately segmenting shapes and partially fitting the output extrusion cylinders. - Supervised methods (such as those based on language architectures) also face difficulties in generating valid outputs. 2. **Advantages of Multi - view Images**: - 3D scans are usually accompanied by multi - view images, which can be a rich source for extracting extrusion cylinder information. - 2D convolutional neural networks perform well in various 3D tasks and are superior to 3D processing networks. ### Core Ideas of MV2Cyl - **Utilizing 2D Image Information**: Learn 2D prior information (such as curves and surfaces) from multi - view images through 2D convolutional neural networks and integrate it into the 3D representation. - **Combining Curve and Surface Information**: Not only extract surface information, but also combine the base curve information to more accurately reconstruct the parameters of the extrusion cylinders. - **Optimizing the Neural Field**: Integrate 2D information into a consistent 3D representation by optimizing the neural field, thereby achieving more robust reverse engineering. ### Main Contributions 1. **Innovative Framework**: Propose a completely new framework, MV2Cyl, which can reconstruct 3D extrusion cylinders using only multi - view images. 2. **Performance Improvement**: Experiments show that this method outperforms existing methods on two sketch - extrude CAD datasets (Fusion360 and DeepCAD), especially when dealing with challenges such as occlusion and surface segmentation. ### Summary The main objective of this paper is to reconstruct 3D extrusion cylinders through multi - view images and represent them as sketch - extrude CAD models, thereby overcoming the limitations of existing methods in dealing with original 3D geometric data. MV2Cyl achieves more accurate and robust reconstruction effects by combining 2D convolutional neural networks and neural field optimization.

MV2Cyl: Reconstructing 3D Extrusion Cylinders from Multi-View Images

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinders

Embedding Visual Cognition in 3D Reconstruction from Multi-View Engineering Drawings

MV-C3D: A Spatial Correlated Multi-View 3D Convolutional Neural Networks

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Multi-View Stereo Representation Revist: Region-Aware MVSNet

Im2Avatar: Colorful 3D Reconstruction from a Single Image

Multi-view 3D Morphable Face Reconstruction via Canonical Volume Fusion

Single-Image 3-D Reconstruction: Rethinking Point Cloud Deformation

MVPNet: Multi-View Point Regression Networks for 3D Object Reconstruction from A Single Image

MVD$^2$: Efficient Multiview 3D Reconstruction for Multiview Diffusion

MVSBoost: An Efficient Point Cloud-based 3D Reconstruction

Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRI

Multi-view Convolutional Neural Networks for 3D Shape Recognition

From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep Fusion

Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Function

HC-MVSNet: A Probability Sampling-Based Multi-View-stereo Network with Hybrid Cascade Structure for 3D Reconstruction

Multi-view 3D Models from Single Images with a Convolutional Network