SN-Engine, a Scale-free Geometric Modelling Environment

T.A. Zhukov

DOI: https://doi.org/10.48550/arXiv.2006.12661

2020-06-23

Abstract:We present a new scale-free geometric modelling environment designed by the author of the paper. It allows one to consistently treat geometric objects of arbitrary size and offers extensive analytic and computational support for visualization of both real and artificial sceneries.

Graphics

What problem does this paper attempt to address?

Scalable generation of large-scale unstructured meshes by a novel domain decomposition approach.

Jianjun Chen,Zhoufang Xiao,Yao Zheng,Jianfeng Zou,Dawei Zhao,Yufeng Yao

DOI: https://doi.org/10.1016/j.advengsoft.2018.04.005

IF: 4.255

2018-01-01

Advances in Engineering Software

Abstract:•Inputting a CAD model, the proposed approach executes the subsequent meshing steps in a fully parallel and automatic manner.•The most time-consuming steps of domain decomposition have been parallelized.•The finally generated surface mesh is defined on the input CAD model.•The shape quality of inter-domain interfaces is reasonable; thus, the parallel mesh improvement algorithm can fix them without compromising mesh quality.•A more scalable parallel performance is observed by detailed comparisons with state-of-the-arts approaches.
Geo-Sketcher: Rapid 3D Geological Modeling using Geological and Topographic Map Sketches

Ronan Amorim,Emilio Vital Brazil,Faramarz Samavati,Mario Costa Sousa

2023-08-22

Abstract:The construction of 3D geological models is an essential task in oil/gas exploration, development and production. However, it is a cumbersome, time-consuming and error-prone task mainly because of the model's geometric and topological complexity. The models construction is usually separated into interpretation and 3D modeling, performed by different highly specialized individuals, which leads to inconsistencies and intensifies the challenges. In addition, the creation of models following geological rules is paramount for properly depicting static and dynamic properties of oil/gas reservoirs. In this work, we propose a sketch-based approach to expedite the creation of valid 3D geological models by mimicking how domain experts interpret geological structures, allowing creating models directly from interpretation sketches. Our sketch-based modeler (Geo-Sketcher) is based on sketches of standard 2D topographic and geological maps, comprised of lines, symbols and annotations. We developed a graph-based representation to enable (1) the automatic computation of the relative ages of rock series and layers, and (2) the embedding of specific geological rules directly in the sketching. We introduce the use of Hermite-Birkhoff Radial Basis Functions to interpolate the geological map constraints, and demonstrate the capabilities of our approach with a variety of results with different levels of complexity.

Graphics,Computational Geometry
Sketch-based Free-Form Shape Modelling with a Fast and Stable Numerical Engine.

YJ Liu,K Tang,A Joneja

DOI: https://doi.org/10.1016/j.cag.2005.08.007

IF: 1.821

2005-01-01

Computers & Graphics

Abstract:In this paper, we present a feature-based free-form shape modelling technique based on solving a fundamental problem of reconstructing the depth information from 2D sketch planes. First, to mathematically define the problem with the human perception, the proposed technique (1) formulates the 2D shaded regions on sketches by a hybrid thin plate surface model that can exhibit controlled continuity over the recovered 3D surface and (2) formulates the 1D salient open free-form curves and salient corners as linear sketch constraints. The 3D free-form shape from sketch planes is then achieved by solving a linearly constrained quadratic optimization problem which unifies both 2D region-based and 1D contour-based shape information over 2D sketches. Secondly, to solve the formulated optimization problem with an interactive-rate performance, a fast and stable numerical engine is proposed with a rigorous proof that for our specially formulated problem, system decomposition with reduced computational cost is always possible. Stability, accuracy and efficiency are studied in depth for the proposed numerical engine. Finally a prototype system utilizing the proposed technique is presented with two applications that demonstrate the usefulness and effectiveness of the proposed technique.
Procedural Generation and Rendering of Realistic, Navigable Forest Environments: An Open-Source Tool

Callum Newlands,Klaus-Peter Zauner

DOI: https://doi.org/10.48550/arXiv.2208.01471

2022-08-02

Graphics

Abstract:Simulation of forest environments has applications from entertainment and art creation to commercial and scientific modelling. Due to the unique features and lighting in forests, a forest-specific simulator is desirable, however many current forest simulators are proprietary or highly tailored to a particular application. Here we review several areas of procedural generation and rendering specific to forest generation, and utilise this to create a generalised, open-source tool for generating and rendering interactive, realistic forest scenes. The system uses specialised L-systems to generate trees which are distributed using an ecosystem simulation algorithm. The resulting scene is rendered using a deferred rendering pipeline, a Blinn-Phong lighting model with real-time leaf transparency and post-processing lighting effects. The result is a system that achieves a balance between high natural realism and visual appeal, suitable for tasks including training computer vision algorithms for autonomous robots and visual media generation.
A framework for multi-scale modelling

B. Chopard,Joris Borgdorff,A. G. Hoekstra

DOI: https://doi.org/10.1098/rsta.2013.0378

2014-08-06

Abstract:We review a methodology to design, implement and execute multi-scale and multi-science numerical simulations. We identify important ingredients of multi-scale modelling and give a precise definition of them. Our framework assumes that a multi-scale model can be formulated in terms of a collection of coupled single-scale submodels. With concepts such as the scale separation map, the generic submodel execution loop (SEL) and the coupling templates, one can define a multi-scale modelling language which is a bridge between the application design and the computer implementation. Our approach has been successfully applied to an increasing number of applications from different fields of science and technology.
Scalable Scene Modeling from Perspective Imaging: Physics-based Appearance and Geometry Inference

Shuang Song

2024-04-02

Abstract:3D scene modeling techniques serve as the bedrocks in the geospatial engineering and computer science, which drives many applications ranging from automated driving, terrain mapping, navigation, virtual, augmented, mixed, and extended reality (for gaming and movie industry etc.). This dissertation presents a fraction of contributions that advances 3D scene modeling to its state of the art, in the aspects of both appearance and geometry modeling. In contrast to the prevailing deep learning methods, as a core contribution, this thesis aims to develop algorithms that follow first principles, where sophisticated physic-based models are introduced alongside with simpler learning and inference tasks. The outcomes of these algorithms yield processes that can consume much larger volume of data for highly accurate reconstructing 3D scenes at a scale without losing methodological generality, which are not possible by contemporary complex-model based deep learning methods. Specifically, the dissertation introduces three novel methodologies that address the challenges of inferring appearance and geometry through physics-based modeling.

Computer Vision and Pattern Recognition
From sketch to reality: precision-friendly 3D generation technology

Yuanqi Hu,Jianqi Zhang,Ling Bai,Jing Li,Bing Li,Ying Zang,Wenjun Hu

DOI: https://doi.org/10.1007/s00371-024-03425-z

IF: 2.835

2024-05-18

The Visual Computer

Abstract:With the rapid development of computer graphics and 3D computer vision, the field of reconstructing 3D geometric shapes from sketches has quickly seen an influx of innovative methodologies. However, the majority of current methods primarily rely on the associative memory of matching images to models during their training stages, failing to fully grasp the real structure of the three-dimensional objects presented in the images. These approaches often lead to significant discrepancies between the reconstructed objects and the expected models. For instance, some methods often lose important geometric details when dealing with objects that have complex topological structures, resulting in a significant reduction in the visual consistency between the reconstructed models and the original images. Moreover, existing technologies also demonstrate clear limitations in theoretically capturing the subtle symmetry and local features of three-dimensional objects. To address this issue, we propose a two-phase framework in this work to more accurately reflect the objects in the input images in the reconstructed models. Initially, we employ an encoder–decoder structure to generate an implicit signed distance field (SDF) representing the 3D shapes. Subsequently, we carry out a comprehensive optimization of the decoder from the first phase. This process includes two main steps: firstly, utilizing differentiable rendering techniques to render the mesh model derived from the distance field, ensuring its consistency with the input images; secondly, combining the symmetry of the 3D shapes with innovative regularization loss to further refine the decoder, aiming to reduce the discrepancies between the images and the 3D shapes. Compared to similar research, our method not only demonstrates superior performance in reconstructing 3D shapes from sketches but also offers new perspectives and solutions for the optimization of 3D shapes. This work signifies an important advancement in understanding and reconstructing the transition process from sketches to precise 3D models. Code: https://github.com/Hyuq1/Sketch2Reality.git

computer science, software engineering
Multiresolution Free Form Object Modeling with Point Sampled Geometry.

Yong-Jin Liu,Kai Tang,Matthew Ming-Fai Yuen

DOI: https://doi.org/10.1007/bf02945586

2004-01-01

Abstract:In this paper an efficient framework for the creation of 3D digital content with point sampled geometry is proposed. A new hierarchy of shape representations with three levels is adopted in this framework. Based on this new hierarchical shape representation, the proposed framework offers concise integration of various volumetric- and surface-based modeling techniques, such as Boolean operation, offset, blending, free-form deformation, parameterization and texture mapping, and thus simplifies the complete modeling process. Previously to achieve the same goal, several separated algorithms had to be used independently with inconsistent volumetric and surface representations of the free-form object. Both graphics and industrial applications are presented to demonstrate the effectiveness and efficiency of the proposed framework.
OSN: Infinite Representations of Dynamic 3D Scenes from Monocular Videos

Ziyang Song,Jinxi Li,Bo Yang

2024-07-08

Abstract:It has long been challenging to recover the underlying dynamic 3D scene representations from a monocular RGB video. Existing works formulate this problem into finding a single most plausible solution by adding various constraints such as depth priors and strong geometry constraints, ignoring the fact that there could be infinitely many 3D scene representations corresponding to a single dynamic video. In this paper, we aim to learn all plausible 3D scene configurations that match the input video, instead of just inferring a specific one. To achieve this ambitious goal, we introduce a new framework, called OSN. The key to our approach is a simple yet innovative object scale network together with a joint optimization module to learn an accurate scale range for every dynamic 3D object. This allows us to sample as many faithful 3D scene configurations as possible. Extensive experiments show that our method surpasses all baselines and achieves superior accuracy in dynamic novel view synthesis on multiple synthetic and real-world datasets. Most notably, our method demonstrates a clear advantage in learning fine-grained 3D scene geometry. Our code and data are available at <a class="link-external link-https" href="https://github.com/vLAR-group/OSN" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Graphics,Machine Learning,Robotics
A Feasible Modeling System Driven by Command Sets

ZHU Yun-zhi,LIU Hua,HUA Wei

DOI: https://doi.org/10.3969/j.issn.1001-3695.2005.09.030

2005-01-01

Abstract:We have built a concise and powerful geometry modeling system, optimized to the scenery construction and virtual avatar shaping. We have devised a set of effective modeling operation commands based on the extensive analysis of the mode￣ling procedures. These elaborated operation commands have been proved to be efficient and effective to build the highly complex geometric objects. The modeling system is characterized by the easy manipulation for the novices.
GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit Functions

Jie Zhou,Zhongjin Luo,Qian Yu,Xiaoguang Han,Hongbo Fu

DOI: https://doi.org/10.48550/arXiv.2309.05946

2023-09-12

Abstract:Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in reconstruction quality and multi-view interaction friendliness, hindering their practical application. This paper proposes a faithful and user-friendly iterative solution to tackle these limitations by learning geometry-aligned deep implicit functions from one or multiple sketches. Our method lifts 2D sketches to volume-based feature tensors, which align strongly with the output 3D shape, enabling accurate reconstruction and faithful editing. Such a geometry-aligned feature encoding technique is well-suited to iterative modeling since features from different viewpoints can be easily memorized or aggregated. Based on these advantages, we design a unified interactive system for sketch-based shape modeling. It enables users to generate the desired geometry iteratively by drawing sketches from any number of viewpoints. In addition, it allows users to edit the generated surface by making a few local modifications. We demonstrate the effectiveness and practicality of our method with extensive experiments and user studies, where we found that our method outperformed existing methods in terms of accuracy, efficiency, and user satisfaction. The source code of this project is available at <a class="link-external link-https" href="https://github.com/LordLiang/GA-Sketching" rel="external noopener nofollow">this https URL</a>.

Graphics
GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond

Chongjie Ye,Yinyu Nie,Jiahao Chang,Yuantao Chen,Yihao Zhi,Xiaoguang Han

2024-03-29

Abstract:We present GauStudio, a novel modular framework for modeling 3D Gaussian Splatting (3DGS) to provide standardized, plug-and-play components for users to easily customize and implement a 3DGS pipeline. Supported by our framework, we propose a hybrid Gaussian representation with foreground and skyball background models. Experiments demonstrate this representation reduces artifacts in unbounded outdoor scenes and improves novel view synthesis. Finally, we propose Gaussian Splatting Surface Reconstruction (GauS), a novel render-then-fuse approach for high-fidelity mesh reconstruction from 3DGS inputs without fine-tuning. Overall, our GauStudio framework, hybrid representation, and GauS approach enhance 3DGS modeling and rendering capabilities, enabling higher-quality novel view synthesis and surface reconstruction.

Computer Vision and Pattern Recognition
A General Particle Modeling Method for Complex Geometries

Jiangnan Kang,Yijie Sun,Ziqi Zhou,Zhongguo Sun,Guang Xi

DOI: https://doi.org/10.1063/5.0209800

IF: 4.6

2024-01-01

Physics of Fluids

Abstract:Particle modeling for complex geometries is a challenge for the wide application of particle methods in engineering fields. The traditional modeling method with Cartesian coordinates faces difficulties in accurately representing boundary shapes and would lose flow details near the slender structure. The modeling method with the signed distance field (SDF) and particle shifting technique can obtain a uniform boundary-fitting particle distribution. However, the accuracy and efficiency of SDF construction, as well as the conservation of geometry volume after discretizing the model into particles, need to be further improved. In this paper, a general particle modeling method is proposed for arbitrary geometries. A double search technique is proposed to quickly construct the narrowband signed distance field (NSDF) near the geometry boundary. A scanning method is developed for the NSDF to determine the inner/outer relationship between the non-narrowband grids and the geometry. In addition, a volume compensation technique is proposed to ensure the volume conservation of the particle model. A modeling evaluation system is established, and three evaluation indicators are proposed to evaluate the quality of particle distribution and total volume conservation for particle models. Complex geometries such as the Stanford bunny, the Stanford dragon, and the centrifugal impeller are modeled to validate the accuracy and convergence of the proposed method. The results show that the proposed method can achieve a more uniform and accurate boundary-fitting particle distribution for complex geometries, and it can also effectively model tiny structures while significantly reducing total geometry volume error.
Modelling landscape evolution on geological time scales: a new method based on irregular spatial discretization

Jean Braun,Malcolm Sambridge

DOI: https://doi.org/10.1046/j.1365-2117.1997.00030.x

1997-01-01

Basin Research

Abstract:We present simulations of large‐scale landscape evolution on tectonic time scales obtained from a new numerical model which allows for arbitrary spatial discretization. The new method makes use of efficient algorithms from the field of computational geometry to compute the set of natural neighbours of any irregular distribution of points in a plane. The natural neighbours are used to solve geomorphic equations that include erosion/deposition by channelled flow and diffusion. The algorithm has great geometrical flexibility, which makes it possible to solve problems involving complex boundaries, radially symmetrical uplift functions and horizontal tectonic transport across strike‐slip faults. The algorithm is also ideally suited for problems which require large variations in spatial discretization and/or self‐adaptive meshing. We present a number of examples to illustrate the power of the new approach and its advantages over more ‘classical’ models based on regular (rectangular) discretization. We also demonstrate that the synthetic river networks and landscapes generated by the model obey the laws of network composition and have scaling properties similar to those of natural landscapes. Finally we explain how orographically controlled precipitation and flexural isostasy may be easily incorporated in the model without sacrificing efficiency.

geosciences, multidisciplinary
Reconstructing Objects In-the-wild for Realistic Sensor Simulation

Ze Yang,Sivabalan Manivasagam,Yun Chen,Jingkang Wang,Rui Hu,Raquel Urtasun

DOI: https://doi.org/10.1109/icra48891.2023.10160535

2023-01-01

Abstract:Reconstructing objects from real world data and rendering them at novel views is critical to bringing realism, diversity and scale to simulation for robotics training and testing. In this work, we present NeuSim, a novel approach that estimates accurate geometry and realistic appearance from sparse in-the-wild data captured at distance and at limited viewpoints. Towards this goal, we represent the object surface as a neural signed distance function and leverage both LiDAR and camera sensor data to reconstruct smooth and accurate geometry and normals. We model the object appearance with a robust physics-inspired reflectance representation effective for in-the-wild data. Our experiments show that NeuSim has strong view synthesis performance on challenging scenarios with sparse training views. Furthermore, we showcase composing NeuSim assets into a virtual world and generating realistic multi-sensor data for evaluating self-driving perception models. The supplementary material can be found at the project website: https://waabi.ai/research/neusim/
Sketching Reality

Xuejin Chen,Sing Bing Kang,Yingqing Xu,Julie Dorsey,Heung‐Yeung Shum

DOI: https://doi.org/10.1145/1356682.1356684

IF: 6.2

2008-01-01

ACM Transactions on Graphics

Abstract:In this article, we introduce sketching reality , the process of converting a freehand sketch into a realistic-looking model. We apply this concept to architectural designs. As the sketch is being drawn, our system periodically interprets its 2.5D-geometry by identifying new junctions, edges, and faces, and then analyzing the extracted topology. The user can add detailed geometry and textures through sketches as well. This is possible through the use of databases that match partial sketches to models of detailed geometry and textures. The final product is a realistic texture-mapped 2.5D-model of the building. We show a variety of buildings that have been created using this system.
Sketch-based Segmentation of Scanned Outdoor Environment Models

Xiaoru Yuan,Hui Xu,Minh X. Nguyen,Amit Shesh,Baoquan Chen

DOI: https://doi.org/10.2312/SBM/SBM05/019-026

2005-01-01

Abstract:When modeling with scanned outdoor models, being able to select a subset of the points efficiently that collectively represent an object is an important and fundamental operation. Such segmentation problems have been extensively studied, and simple and efficient solutions exist in two dimensions. However, 3D segmentation, especially that of sparse point models obtained by scanning, remains a challenge because of inherent incompleteness and noise. We present a sketched-based interface that allows segmentation of general 3D point-based models. The user marks object and background regions by placing strokes using a stylus, and the tool segments out the marked object(s). To refine the results, the user simply moves the camera to a different location and repeats the process. Our method is based on graph cuts, a popular and well-tested paradigm for segmentation problems. We employ a two-pass process: we use the strokes to perform 2D image segmentation in the projection plane of the camera and use its results for the 3D scanned data segmentation. The advantages of our method are ease of use, speed and robustness. Our method works for general 3D point models and not just range images. Important applications include selection of objects when dealing with large, unorganized point models for refinement, remodeling, meshing, etc.
SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling

Yijun Yuan,Michael Bleier,Andreas Nüchter

DOI: https://doi.org/10.48550/arXiv.2405.07847

2024-05-13

Abstract:We present SceneFactory, a workflow-centric and unified framework for incremental scene modeling, that supports conveniently a wide range of applications, such as (unposed and/or uncalibrated) multi-view depth estimation, LiDAR completion, (dense) RGB-D/RGB-L/Mono//Depth-only reconstruction and SLAM. The workflow-centric design uses multiple blocks as the basis for building different production lines. The supported applications, i.e., productions avoid redundancy in their designs. Thus, the focus is on each block itself for independent expansion. To support all input combinations, our implementation consists of four building blocks in SceneFactory: (1) Mono-SLAM, (2) depth estimation, (3) flexion and (4) scene reconstruction. Furthermore, we propose an unposed & uncalibrated multi-view depth estimation model (U2-MVD) to estimate dense geometry. U2-MVD exploits dense bundle adjustment for solving for poses, intrinsics, and inverse depth. Then a semantic-awared ScaleCov step is introduced to complete the multi-view depth. Relying on U2-MVD, SceneFactory both supports user-friendly 3D creation (with just images) and bridges the applications of Dense RGB-D and Dense Mono. For high quality surface and color reconstruction, we propose due-purpose Multi-resolutional Neural Points (DM-NPs) for the first surface accessible Surface Color Field design, where we introduce Improved Point Rasterization (IPR) for point cloud based surface query. We implement and experiment with SceneFactory to demonstrate its broad practicability and high flexibility. Its quality also competes or exceeds the tightly-coupled state of the art approaches in all tasks. We contribute the code to the community (<a class="link-external link-https" href="https://jarrome.github.io/" rel="external noopener nofollow">this https URL</a>).

Computer Vision and Pattern Recognition,Robotics
CAD model inspection utility and prototyping framework based on OpenCascade

V. Turlapov,S. Slyadnev,A. Malyshev

Abstract:We present an open-source, extensible software which assists in the development of CAD geometric algorithms based on Boundary Representation data structures. The software is coupled with OpenCascade library which is an open-source geometric modeling kernel offering a broad range of modeling operations for the development of multi-purpose CAD systems and utilities. The new software serves as a framework for constructing geometric modeling algorithms. We provide several examples of geometric utilities developed with the help of the present framework. Furthermore, our software offers some advanced facilities for inspection of geometric and topological structures of existing CAD parts which can be imported from any popular CAD system.

Computer Science,Engineering
SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design

Ari Seff,Yaniv Ovadia,Wenda Zhou,Ryan P. Adams

DOI: https://doi.org/10.48550/arXiv.2007.08506

2020-07-17

Abstract:Parametric computer-aided design (CAD) is the dominant paradigm in mechanical engineering for physical design. Distinguished by relational geometry, parametric CAD models begin as two-dimensional sketches consisting of geometric primitives (e.g., line segments, arcs) and explicit constraints between them (e.g., coincidence, perpendicularity) that form the basis for three-dimensional construction operations. Training machine learning models to reason about and synthesize parametric CAD designs has the potential to reduce design time and enable new design workflows. Additionally, parametric CAD designs can be viewed as instances of constraint programming and they offer a well-scoped test bed for exploring ideas in program synthesis and induction. To facilitate this research, we introduce SketchGraphs, a collection of 15 million sketches extracted from real-world CAD models coupled with an open-source data processing pipeline. Each sketch is represented as a geometric constraint graph where edges denote designer-imposed geometric relationships between primitives, the nodes of the graph. We demonstrate and establish benchmarks for two use cases of the dataset: generative modeling of sketches and conditional generation of likely constraints given unconstrained geometry.

Machine Learning

SN-Engine, a Scale-free Geometric Modelling Environment

Scalable generation of large-scale unstructured meshes by a novel domain decomposition approach.

Geo-Sketcher: Rapid 3D Geological Modeling using Geological and Topographic Map Sketches

Sketch-based Free-Form Shape Modelling with a Fast and Stable Numerical Engine.

Procedural Generation and Rendering of Realistic, Navigable Forest Environments: An Open-Source Tool

A framework for multi-scale modelling

Scalable Scene Modeling from Perspective Imaging: Physics-based Appearance and Geometry Inference

From sketch to reality: precision-friendly 3D generation technology

Multiresolution Free Form Object Modeling with Point Sampled Geometry.

OSN: Infinite Representations of Dynamic 3D Scenes from Monocular Videos

A Feasible Modeling System Driven by Command Sets

GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit Functions

GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond

A General Particle Modeling Method for Complex Geometries

Modelling landscape evolution on geological time scales: a new method based on irregular spatial discretization

Reconstructing Objects In-the-wild for Realistic Sensor Simulation

Sketching Reality

Sketch-based Segmentation of Scanned Outdoor Environment Models

SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling

CAD model inspection utility and prototyping framework based on OpenCascade

SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design