Long-Term Survival Following Treatment with Antineoplastons for Colon Cancer with Unresectable Multiple Liver Metastases: Report of a Case

Y. Ogata,H. Tsuda,K. Matono,T. Kumabe,H. Saitsu,H. Hara,Y. Akagi,Y. Araki,M. Sata,K. Shirouzu

DOI: https://doi.org/10.1007/s10595-002-2503-2

2003-06-01

Abstract:

What problem does this paper attempt to address?

A clustering approach to free form surface reconstruction from multi-view range images

Hong Zhou,Yonghuai Liu,Longzhuang Li,Baogang Wei

DOI: https://doi.org/10.1016/j.imavis.2008.07.009

IF: 3.86

2009-01-01

Image and Vision Computing

Abstract:3D modelling finds a wide range of applications in robot vision and reverse engineering. However due to the presence of surface scanning noise, accumulative registration errors, and improper data fusion, the reconstructed surfaces from multiple registered range images are often non-smooth and distorted with thick patches, false connections and blurred features. These shortcomings will limit the wide applications of 3D modelling using the latest laser scanning systems. In this paper, the clustering approach, surface segmentation and classification are employed to fuse registered range images to reduce the adverse effect of large accumulative registration errors and heavy scanning noise, minimize the dissimilarity of the fused surface with respect to the original overlapping surfaces, and produce smooth and detailed 3D object computer models. For initialization of the clustering approach, an automatic method is developed, shifting possible corresponding points from different viewpoints toward each other and thus, making sure that the initialization of the cluster centroids are in between the two data sets so that more efficient and effective integration of data can be obtained. Then the principal component analysis (PCA) is employed to segment these centroids into different areas for the representation of the initially fused surface and then the tensor analysis is applied to classify these areas into featured and non-featured ones. In the integration process, the K means and fuzzy c means clustering approaches from the pattern recognition and machine learning literatures are employed to integrate non-featured areas for a smooth fused surface and featured areas for keeping the geometric details. By controlling a parameter, the final integrated surface can be traded off between smoothness and geometric details. Finally the fused point set is triangulated using an improved Delaunay method, guaranteeing a watertight surface. The new method is theoretically guaranteed to converge and minimize the dissimilarity between the final fused surface and original surfaces. A comparative study based on real images shows that the proposed algorithm desirably retains geometric details, produces smooth surface and minimizes the integration error.
Surface Reconstruction from Point Clouds: A Survey and a Benchmark

ZhangJin Huang,Yuxin Wen,ZiHao Wang,Jinjuan Ren,Kui Jia

DOI: https://doi.org/10.1109/TPAMI.2024.3429209

2024-07-16

Abstract:Reconstruction of a continuous surface of two-dimensional manifold from its raw, discrete point cloud observation is a long-standing problem in computer vision and graphics research. The problem is technically ill-posed, and becomes more difficult considering that various sensing imperfections would appear in the point clouds obtained by practical depth scanning. In literature, a rich set of methods has been proposed, and reviews of existing methods are also provided. However, existing reviews are short of thorough investigations on a common benchmark. The present paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. To this end, we contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data; the benchmark includes object- and scene-level surfaces and takes into account various sensing imperfections that are commonly encountered in practical depth scanning. We conduct thorough empirical studies by comparing existing methods on the constructed benchmark, and pay special attention on robustness of existing methods against various scanning imperfections; we also study how different methods generalize in terms of reconstructing complex surface shapes. Our studies help identity the best conditions under which different methods work, and suggest some empirical findings. For example, while deep learning methods are increasingly popular in the research community, our systematic studies suggest that, surprisingly, a few classical methods perform even better in terms of both robustness and generalization; our studies also suggest that the practical challenges of misalignment of point sets from multi-view scanning, missing of surface points, and point outliers remain unsolved by all the existing surface reconstruction methods. We expect that the benchmark and our studies would be valuable both for practitioners and as a guidance for new innovations in future research. We make the benchmark publicly accessible at https://Gorilla-Lab-SCUT.github.io/SurfaceReconstructionBenchmark.
A Survey of Surface Reconstruction from Point Clouds

Matthew Berger,Andrea Tagliasacchi,Lee M. Seversky,Pierre Alliez,Gaël Guennebaud,Joshua A. Levine,Andrei Sharf,Claudio T. Silva

DOI: https://doi.org/10.1111/cgf.12802

IF: 2.5

2016-03-30

Computer Graphics Forum

Abstract:Abstract The area of surface reconstruction has seen substantial progress in the past two decades. The traditional problem addressed by surface reconstruction is to recover the digital representation of a physical shape that has been scanned, where the scanned data contain a wide variety of defects. While much of the earlier work has been focused on reconstructing a piece‐wise smooth representation of the original shape, recent work has taken on more specialized priors to address significantly challenging data imperfections, where the reconstruction can take on different representations—not necessarily the explicit geometry. We survey the field of surface reconstruction, and provide a categorization with respect to priors, data imperfections and reconstruction output. By considering a holistic view of surface reconstruction, we show a detailed characterization of the field, highlight similarities between diverse reconstruction techniques and provide directions for future work in surface reconstruction.

computer science, software engineering
Photometric multi-view mesh refinement for high-resolution satellite images

Mathias Rothermel,Ke Gong,Dieter Fritsch,Konrad Schindler,Norbert Haala

DOI: https://doi.org/10.1016/j.isprsjprs.2020.05.001

IF: 12.7

2020-08-01

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:<p>Modern high-resolution satellite sensors collect optical imagery with ground sampling distances (GSDs) of 30–50 cm, which has sparked a renewed interest in photogrammetric 3D surface reconstruction from satellite data. State-of-the-art reconstruction methods typically generate 2.5D elevation data. Here, we present an approach to recover full 3D surface meshes from multi-view satellite imagery. The proposed method takes as input a coarse initial mesh and refines it by iteratively updating all vertex positions to maximise the photo-consistency between images. Photo-consistency is measured in image space, by transferring texture from one image to another via the surface. We derive the equations to propagate changes in texture similarity through the rational function model (RFM), often also referred to as rational polynomial coefficient (RPC) model. Furthermore, we devise a hierarchical scheme to optimise the surface with gradient descent. In experiments with two different datasets, we show that the refinement improves the initial digital elevation models (DEMs) generated with conventional dense image matching. Moreover, we demonstrate that our method is able to reconstruct true 3D geometry, such as facade structures, if off-nadir views are available.</p>

imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary
Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction

Ali Karami,Fabio Menna,Fabio Remondino

DOI: https://doi.org/10.3390/s22218172

IF: 3.9

2022-10-26

Sensors

Abstract:Image-based 3D reconstruction has been employed in industrial metrology for micro-measurements and quality control purposes. However, generating a highly-detailed and reliable 3D reconstruction of non-collaborative surfaces is still an open issue. In this paper, a method for generating an accurate 3D reconstruction of non-collaborative surfaces through a combination of photogrammetry and photometric stereo is presented. On one side, the geometric information derived with photogrammetry is used in areas where its 3D measurements are reliable. On the other hand, the high spatial resolution capability of photometric stereo is exploited to acquire a finely detailed topography of the surface. Finally, three different approaches are proposed to fuse both geometric information and high frequency details. The proposed method is tested on six different non-collaborative objects with different surface characteristics. To evaluate the accuracy of the proposed method, a comprehensive cloud-to-cloud comparison between reference data and 3D points derived from the proposed fusion methods is provided. The experiments demonstrated that, despite correcting global deformation up to an average RMSE of less than 0.1 mm, the proposed method recovers the surface topography at the same high resolution as the photometric stereo.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds

Raphael Sulzer,Renaud Marlet,Bruno Vallet,Loic Landrieu

2024-04-17

Abstract:We present a comprehensive survey and benchmark of both traditional and learning-based methods for surface reconstruction from point clouds. This task is particularly challenging for real-world acquisitions due to factors like noise, outliers, non-uniform sampling, and missing data. Traditional approaches often simplify the problem by imposing handcrafted priors on either the input point clouds or the resulting surface, a process that can necessitate tedious hyperparameter tuning. Conversely, deep learning models have the capability to directly learn the properties of input point clouds and desired surfaces from data. We study the influence of these handcrafted and learned priors on the precision and robustness of surface reconstruction techniques. We evaluate various time-tested and contemporary methods in a standardized manner. When both trained and evaluated on point clouds with identical characteristics, the learning-based models consistently produce superior surfaces compared to their traditional counterparts$\unicode{x2013}$even in scenarios involving novel shape categories. However, traditional methods demonstrate greater resilience to the diverse array of point cloud anomalies commonly found in real-world 3D acquisitions. For the benefit of the research community, we make our code and datasets available, inviting further enhancements to learning-based surface reconstruction. This can be accessed at <a class="link-external link-https" href="https://github.com/raphaelsulzer/dsr-benchmark" rel="external noopener nofollow">this https URL</a> .

Computer Vision and Pattern Recognition,Computational Geometry
Multisource Point Clouds, Point Simplification and Surface Reconstruction

Lingli Zhu,Antero Kukko,Juho-Pekka Virtanen,Juha Hyyppä,Harri Kaartinen,Hannu Hyyppä,Tuomas Turppa,Zhu,Kukko,Virtanen,Hyyppä,Kaartinen,Hyyppä,Turppa

DOI: https://doi.org/10.3390/rs11222659

IF: 5

2019-11-13

Remote Sensing

Abstract:As data acquisition technology continues to advance, the improvement and upgrade of the algorithms for surface reconstruction are required. In this paper, we utilized multiple terrestrial Light Detection And Ranging (Lidar) systems to acquire point clouds with different levels of complexity, namely dynamic and rigid targets for surface reconstruction. We propose a robust and effective method to obtain simplified and uniform resample points for surface reconstruction. The method was evaluated. A point reduction of up to 99.371% with a standard deviation of 0.2 cm was achieved. In addition, well-known surface reconstruction methods, i.e., Alpha shapes, Screened Poisson reconstruction (SPR), the Crust, and Algebraic point set surfaces (APSS Marching Cubes), were utilized for object reconstruction. We evaluated the benefits in exploiting simplified and uniform points, as well as different density points, for surface reconstruction. These reconstruction methods and their capacities in handling data imperfections were analyzed and discussed. The findings are that i) the capacity of surface reconstruction in dealing with diverse objects needs to be improved; ii) when the number of points reaches the level of millions (e.g., approximately five million points in our data), point simplification is necessary, as otherwise, the reconstruction methods might fail; iii) for some reconstruction methods, the number of input points is proportional to the number of output meshes; but a few methods are in the opposite; iv) all reconstruction methods are beneficial from the reduction of running time; and v) a balance between the geometric details and the level of smoothing is needed. Some methods produce detailed and accurate geometry, but their capacity to deal with data imperfection is poor, while some other methods exhibit the opposite characteristics.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Deep-Learning-Based 3-D Surface Reconstruction—A Survey

Anis Farshian,Markus Götz,Gabriele Cavallaro,Charlotte Debus,Matthias Nießner,Jón Atli Benediktsson,Achim Streit

DOI: https://doi.org/10.1109/jproc.2023.3321433

IF: 20.6

2023-11-01

Proceedings of the IEEE

Abstract:In the last decade, deep learning (DL) has significantly impacted industry and science. Initially largely motivated by computer vision tasks in 2-D imagery, the focus has shifted toward 3-D data analysis. In particular, 3-D surface reconstruction, i.e., reconstructing a 3-D shape from sparse input, is of great interest to a large variety of application fields. DL-based approaches show promising quantitative and qualitative surface reconstruction performance compared to traditional computer vision and geometric algorithms. This survey provides a comprehensive overview of these DL-based methods for 3-D surface reconstruction. To this end, we will first discuss input data modalities, such as volumetric data, point clouds, and RGB, single-view, multiview, and depth images, along with corresponding acquisition technologies and common benchmark datasets. For practical purposes, we also discuss evaluation metrics enabling us to judge the reconstructive performance of different methods. The main part of the document will introduce a methodological taxonomy ranging from point- and mesh-based techniques to volumetric and implicit neural approaches. Recent research trends, both methodological and for applications, are highlighted, pointing toward future developments.

engineering, electrical & electronic
Recent Methods for Reconstructing Surfaces from Multiple Images

Gang Zeng,Maxime Lhuillier,Long Quan

DOI: https://doi.org/10.1007/11499251_30

2005-01-01

Abstract:Many objects can be mathematically represented as smooth surfaces with arbitrary topology, and smooth surface reconstruction from images could be cast into a variational problem. The main difficulties are the intrinsic ill-posedness of the reconstruction, image noise, efficiency and scalability. In this paper, we discuss the reconstruction approaches that use volumetric, graph-cut, and level-set optimization tools; and the objective functionals that use different image information, silhouette, photometry, and texture. Our discussion is accompanied by the implementations of these approaches on real examples.
Plane Fitting in 3D Reconstruction to Preserve Smooth Homogeneous Surfaces

Yanan Xu,Yohwan So,Sanghyuk Woo

DOI: https://doi.org/10.3390/s22239391

2022-12-01

Abstract:Photogrammetric techniques for weakly-textured surfaces without sufficient information about the R (red), G (green) and B (blue) primary colors of light are challenging. Considering that most urban or indoor object surfaces follow simple geometric shapes, a novel method for reconstructing smooth homogeneous planar surfaces based on MVS (Multi-View Stereo) is proposed. The idea behind it is to extract enough features for the image description, and to refine the dense points generated by the depth values of pixels with plane fitting, to favor the alignment of the surface to the detected planes. The SIFT (Scale Invariant Feature Transform) and AKAZE (Accelerated-KAZE) feature extraction algorithms are combined to ensure robustness and help retrieve connections in small samples. The smoothness of the enclosed watertight Poisson surface can be enhanced by enforcing the 3D points to be projected onto the absolute planes detected by a RANSAC (Random Sample Consensus)-based approach. Experimental evaluations of both cloud-to-mesh comparisons in the per-vertex distances with the ground truth models and visual comparisons with a popular mesh filtering based post-processing method indicate that the proposed method can considerably retain the integrity and smoothness of the reconstruction results. Combined with other primitive fittings, the reconstruction extent of homogeneous surfaces can be further extended, serving as primitive models for 3D building reconstruction, and providing guidance for future works in photogrammetry and 3D surface reconstruction.
Reconstruction of freeform surfaces for metrology

N El-Hayek,H Nouira,N Anwer,M Damak,O Gibaru

DOI: https://doi.org/10.1088/1742-6596/483/1/012003

2014-03-28

Journal of Physics: Conference Series

Abstract:The application of freeform surfaces has increased since their complex shapes closely express a product's functional specifications and their machining is obtained with higher accuracy. In particular, optical surfaces exhibit enhanced performance especially when they take aspheric forms or more complex forms with multi-undulations. This study is mainly focused on the reconstruction of complex shapes such as freeform optical surfaces, and on the characterization of their form. The computer graphics community has proposed various algorithms for constructing a mesh based on the cloud of sample points. The mesh is a piecewise linear approximation of the surface and an interpolation of the point set. The mesh can further be processed for fitting parametric surfaces (Polyworks® or Geomagic®). The metrology community investigates direct fitting approaches. If the surface mathematical model is given, fitting is a straight forward task. Nonetheless, if the surface model is unknown, fitting is only possible through the association of polynomial Spline parametric surfaces. In this paper, a comparative study carried out on methods proposed by the computer graphics community will be presented to elucidate the advantages of these approaches. We stress the importance of the pre-processing phase as well as the significance of initial conditions. We further emphasize the importance of the meshing phase by stating that a proper mesh has two major advantages. First, it organizes the initially unstructured point set and it provides an insight of orientation, neighbourhood and curvature, and infers information on both its geometry and topology. Second, it conveys a better segmentation of the space, leading to a correct patching and association of parametric surfaces.
Evaluating Feature Extraction Methods with Synthetic Noise Patterns for Image-Based Modelling of Texture-Less Objects

Jahanzeb Hafeez,Jaehyun Lee,Soonchul Kwon,Sungjae Ha,Gitaek Hur,Seunghyun Lee

DOI: https://doi.org/10.3390/rs12233886

IF: 5

2020-11-27

Remote Sensing

Abstract:Image-based three-dimensional (3D) reconstruction is a process of extracting 3D information from an object or entire scene while using low-cost vision sensors. A structure-from-motion coupled with multi-view stereo (SFM-MVS) pipeline is a widely used technique that allows 3D reconstruction from a collection of unordered images. The SFM-MVS pipeline typically comprises different processing steps, including feature extraction and feature matching, which provide the basis for automatic 3D reconstruction. However, surfaces with poor visual texture (repetitive, monotone, etc.) challenge the feature extraction and matching stage and affect the quality of reconstruction. The projection of image patterns while using a video projector during the image acquisition process is a well-known technique that has been shown to be successful for such surfaces. In this study, we evaluate the performance of different feature extraction methods on texture-less surfaces with the application of synthetically generated noise patterns (images). Seven state-of-the-art feature extraction methods (HARRIS, Shi-Tomasi, MSER, SIFT, SURF, KAZE, and BRISK) are evaluated on problematic surfaces in two experimental phases. In the first phase, the 3D reconstruction of real and virtual planar surfaces evaluates image patterns while using all feature extraction methods, where the patterns with uniform histograms have the most suitable morphological features. The best performing pattern from Phase One is used in Phase Two experiments in order to recreate a polygonal model of a 3D printed object using all of the feature extraction methods. The KAZE algorithm achieved the lowest standard deviation and mean distance values of 0.0635 mm and −0.00921 mm, respectively.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction

Yingjie Qu,Fei Deng

DOI: https://doi.org/10.3390/rs15174297

IF: 5

2023-08-31

Remote Sensing

Abstract:Automatic reconstruction of surfaces from satellite imagery is a hot topic in computer vision and photogrammetry. State-of-the-art reconstruction methods typically produce 2.5D elevation data. In contrast, we propose a one-stage method directly generating a 3D mesh model from multi-view satellite imagery. We introduce a novel Sat-Mesh approach for satellite implicit surface reconstruction: We represent the scene as a continuous signed distance function (SDF) and leverage a volume rendering framework to learn the SDF values. To address the challenges posed by lighting variations and inconsistent appearances in satellite imagery, we incorporate a latent vector in the network architecture to encode image appearances. Furthermore, we introduce a multi-view stereo constraint to enhance surface quality. This constraint minimizes the similarity between image patches to optimize the position and orientation of the SDF surface. Experimental results demonstrate that our method achieves superior visual quality and quantitative accuracy in generating mesh models. Moreover, our approach can learn seasonal variations in satellite imagery, resulting in texture mesh models with different and consistent seasonal appearances.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Views

Yaniv Wolf,Amit Bracha,Ron Kimmel

2024-07-17

Abstract:Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian properties remains a challenge, as those are optimized based on a photometric loss. While some concurrent models have tried adding geometric constraints during the Gaussian optimization process, they still produce noisy, unrealistic surfaces. We propose a novel approach for bridging the gap between the noisy 3DGS representation and the smooth 3D mesh representation, by injecting real-world knowledge into the depth extraction process. Instead of extracting the geometry of the scene directly from the Gaussian properties, we instead extract the geometry through a pre-trained stereo-matching model. We render stereo-aligned pairs of images corresponding to the original training poses, feed the pairs into a stereo model to get a depth profile, and finally fuse all of the profiles together to get a single mesh. The resulting reconstruction is smoother, more accurate and shows more intricate details compared to other methods for surface reconstruction from Gaussian Splatting, while only requiring a small overhead on top of the fairly short 3DGS optimization process. We performed extensive testing of the proposed method on in-the-wild scenes, obtained using a smartphone, showcasing its superior reconstruction abilities. Additionally, we tested the method on the Tanks and Temples and DTU benchmarks, achieving state-of-the-art results.

Computer Vision and Pattern Recognition
OPEN-SOURCE IMAGE-BASED 3D RECONSTRUCTION PIPELINES: REVIEW, COMPARISON AND EVALUATION

E.-K. Stathopoulou,M. Welponer,F. Remondino

DOI: https://doi.org/10.5194/isprs-archives-xlii-2-w17-331-2019

2019-11-29

Abstract:Abstract. State-of-the-art automated image orientation (Structure from Motion) and dense image matching (Multiple View Stereo) methods commonly used to produce 3D information from 2D images can generate 3D results – such as point cloud or meshes – of varying geometric and visual quality. Pipelines are generally robust and reliable enough, mostly capable to process even large sets of unordered images, yet the final results often lack completeness and accuracy, especially while dealing with real-world cases where objects are typically characterized by complex geometries and textureless surfaces and obstacles or occluded areas may also occur. In this study we investigate three of the available commonly used open-source solutions, namely COLMAP, OpenMVG+OpenMVS and AliceVision, evaluating their results under diverse large scale scenarios. Comparisons and critical evaluation on the image orientation and dense point cloud generation algorithms is performed with respect to the corresponding ground truth data. The presented FBK-3DOM datasets are available for research purposes.
Hybrid Method of Connection Evaluation and Framework Optimization for Building Surface Reconstruction

Ying Li,Guanghong Gong,Chen Liu,Yaopu Zhao,Yongjie Qi,Chuanchuan Lu,Ni Li

DOI: https://doi.org/10.3390/rs16050792

IF: 5

2024-02-25

Remote Sensing

Abstract:The three-dimensional (3D) reconstruction of buildings using photogrammetric point clouds is important for many applications, ranging from digital city construction to urban energy consumption analysis. However, problems such as building complexity and point cloud flaws may lead to incorrect modeling, which will affect subsequent steps such as texture mapping. This paper introduces a pipeline for building surface reconstruction from photogrammetric point clouds, employing a hybrid method that combines connection evaluation and framework optimization. Firstly, the plane segmentation method divides building point clouds into several pieces, which is complemented by a proposed candidate plane generation method aimed at removing redundancies and merging similarities. Secondly, the improved connection evaluation method detects potential skeleton lines from different planes. Subsequently, a framework optimization method is introduced to select suitable undirected polygonal boundaries from planes, forming the basis for plane primitives. Finally, by triangulating all plane primitives and filling holes, a building surface polygonal model is generated. Experiments conducted on various building examples provide both qualitative and quantitative evidence that the proposed hybrid method outperforms many existing methods, including traditional methods and deep learning methods. Notably, the proposed method successfully reconstructs the main building structures and intricate details, which can be further used to generate textural models and semantic models. Experimental results validate that the proposed method can be used for the surface reconstruction from photogrammetric point clouds of planar buildings.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Scalable Cloud-Native Pipeline for Efficient 3D Model Reconstruction from Monocular Smartphone Images

Potito Aghilar,Vito Walter Anelli,Michelantonio Trizio,Tommaso Di Noia

2024-09-28

Abstract:In recent years, 3D models have gained popularity in various fields, including entertainment, manufacturing, and simulation. However, manually creating these models can be a time-consuming and resource-intensive process, making it impractical for large-scale industrial applications. To address this issue, researchers are exploiting Artificial Intelligence and Machine Learning algorithms to automatically generate 3D models effortlessly. In this paper, we present a novel cloud-native pipeline that can automatically reconstruct 3D models from monocular 2D images captured using a smartphone camera. Our goal is to provide an efficient and easily-adoptable solution that meets the Industry 4.0 standards for creating a Digital Twin model, which could enhance personnel expertise through accelerated training. We leverage machine learning models developed by NVIDIA Research Labs alongside a custom-designed pose recorder with a unique pose compensation component based on the ARCore framework by Google. Our solution produces a reusable 3D model, with embedded materials and textures, exportable and customizable in any external 3D modelling software or 3D engine. Furthermore, the whole workflow is implemented by adopting the microservices architecture standard, enabling each component of the pipeline to operate as a standalone replaceable module.

Computer Vision and Pattern Recognition,Artificial Intelligence
SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Dataset

Yubin Hu,Kairui Wen,Heng Zhou,Xiaoyang Guo,Yongjin Liu

2024-10-29

Abstract:Reconstructing accurate 3D surfaces for street-view scenarios is crucial for applications such as digital entertainment and autonomous driving simulation. However, existing street-view datasets, including KITTI, Waymo, and nuScenes, only offer noisy LiDAR points as ground-truth data for geometric evaluation of reconstructed surfaces. These geometric ground-truths often lack the necessary precision to evaluate surface positions and do not provide data for assessing surface normals. To overcome these challenges, we introduce the SS3DM dataset, comprising precise \textbf{S}ynthetic \textbf{S}treet-view \textbf{3D} \textbf{M}esh models exported from the CARLA simulator. These mesh models facilitate accurate position evaluation and include normal vectors for evaluating surface normal. To simulate the input data in realistic driving scenarios for 3D reconstruction, we virtually drive a vehicle equipped with six RGB cameras and five LiDAR sensors in diverse outdoor scenes. Leveraging this dataset, we establish a benchmark for state-of-the-art surface reconstruction methods, providing a comprehensive evaluation of the associated challenges. For more information, visit our homepage at <a class="link-external link-https" href="https://ss3dm.top" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Organ and subcellular distribution of mercury in rats as dependent on the time of exposure to sodium selenite.

J. Chmielnicka,E. Komsta-Szumska,R. Jedrychowski

DOI: https://doi.org/10.1016/0013-9351(79)90087-2

IF: 8.3

1979-10-01

Environmental Research

Abstract:
Autonomous 3D geometry reconstruction through robot-manipulated optical sensors

Carmelo Mineo,Donatella Cerniglia,Vito Ricotta,Bernhard Reitinger

DOI: https://doi.org/10.1007/s00170-021-07432-5

IF: 3.563

2021-07-05

The International Journal of Advanced Manufacturing Technology

Abstract:Abstract Many industrial sectors face increasing production demands and the need to reduce costs, without compromising the quality. The use of robotics and automation has grown significantly in recent years, but versatile robotic manipulators are still not commonly used in small factories. Beside of the investments required to enable efficient and profitable use of robot technology, the efforts needed to program robots are only economically viable in case of large lot sizes. Generating robot programs for specific manufacturing tasks still relies on programming trajectory waypoints by hand. The use of virtual simulation software and the availability of the specimen digital models can facilitate robot programming. Nevertheless, in many cases, the virtual models are not available or there are excessive differences between virtual and real setups, leading to inaccurate robot programs and time-consuming manual corrections. Previous works have demonstrated the use of robot-manipulated optical sensors to map the geometry of samples. However, the use of simple user-defined robot paths, which are not optimized for a specific part geometry, typically causes some areas of the samples to not be mapped with the required level of accuracy or to not be sampled at all by the optical sensor. This work presents an autonomous framework to enable adaptive surface mapping, without any previous knowledge of the part geometry being transferred to the system. The novelty of this work lies in enabling the capability of mapping a part surface at the required level of sampling density, whilst minimizing the number of necessary view poses. Its development has also led to an efficient method of point cloud down-sampling and merging. The article gives an overview of the related work in the field, a detailed description of the proposed framework and a proof of its functionality through both simulated and experimental evidences.

Long-Term Survival Following Treatment with Antineoplastons for Colon Cancer with Unresectable Multiple Liver Metastases: Report of a Case

A clustering approach to free form surface reconstruction from multi-view range images

Surface Reconstruction from Point Clouds: A Survey and a Benchmark

A Survey of Surface Reconstruction from Point Clouds

Photometric multi-view mesh refinement for high-resolution satellite images

Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction

A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds

Multisource Point Clouds, Point Simplification and Surface Reconstruction

Deep-Learning-Based 3-D Surface Reconstruction—A Survey

Recent Methods for Reconstructing Surfaces from Multiple Images

Plane Fitting in 3D Reconstruction to Preserve Smooth Homogeneous Surfaces

Reconstruction of freeform surfaces for metrology

Evaluating Feature Extraction Methods with Synthetic Noise Patterns for Image-Based Modelling of Texture-Less Objects

Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction

GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Views

OPEN-SOURCE IMAGE-BASED 3D RECONSTRUCTION PIPELINES: REVIEW, COMPARISON AND EVALUATION

Hybrid Method of Connection Evaluation and Framework Optimization for Building Surface Reconstruction

Scalable Cloud-Native Pipeline for Efficient 3D Model Reconstruction from Monocular Smartphone Images

SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Dataset

Organ and subcellular distribution of mercury in rats as dependent on the time of exposure to sodium selenite.

Autonomous 3D geometry reconstruction through robot-manipulated optical sensors