Abstract:3D modelling finds a wide range of applications in robot vision and reverse engineering. However due to the presence of surface scanning noise, accumulative registration errors, and improper data fusion, the reconstructed surfaces from multiple registered range images are often non-smooth and distorted with thick patches, false connections and blurred features. These shortcomings will limit the wide applications of 3D modelling using the latest laser scanning systems. In this paper, the clustering approach, surface segmentation and classification are employed to fuse registered range images to reduce the adverse effect of large accumulative registration errors and heavy scanning noise, minimize the dissimilarity of the fused surface with respect to the original overlapping surfaces, and produce smooth and detailed 3D object computer models. For initialization of the clustering approach, an automatic method is developed, shifting possible corresponding points from different viewpoints toward each other and thus, making sure that the initialization of the cluster centroids are in between the two data sets so that more efficient and effective integration of data can be obtained. Then the principal component analysis (PCA) is employed to segment these centroids into different areas for the representation of the initially fused surface and then the tensor analysis is applied to classify these areas into featured and non-featured ones. In the integration process, the K means and fuzzy c means clustering approaches from the pattern recognition and machine learning literatures are employed to integrate non-featured areas for a smooth fused surface and featured areas for keeping the geometric details. By controlling a parameter, the final integrated surface can be traded off between smoothness and geometric details. Finally the fused point set is triangulated using an improved Delaunay method, guaranteeing a watertight surface. The new method is theoretically guaranteed to converge and minimize the dissimilarity between the final fused surface and original surfaces. A comparative study based on real images shows that the proposed algorithm desirably retains geometric details, produces smooth surface and minimizes the integration error.

Principal component analysis with missing data and its application to object modeling

A clustering approach to free form surface reconstruction from multi-view range images

In-Hand 3D Object Reconstruction from a Monocular RGB Video

Sketch-based 3-D modeling for piecewise planar objects in single images

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Robust 3D Reconstruction with an RGB-D Camera

An Interactive Image-Based Modeling Approach With Scene Constraints

Using principle component analysis to estimate geometric parameters from point cloud LIDAR data

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Superquadric-Based Object Modeling by an Iterative Segmentation-And-Recovery Algorithm

Filling Missing Values Matters for Range Image-Based Point Cloud Segmentation

Architectural Modeling from Sparsely Scanned Range Data

Robust 2D Principal Component Analysis: A Structured Sparsity Regularized Approach.

High-Dimensional Principal Component Analysis with Heterogeneous Missingness

UniQuadric: A SLAM Backend for Unknown Rigid Object 3D Tracking and Light-Weight Modeling.

Regularization-based 3D Object Modeling from Multiple Range Images

Robust methods for geometric primitive recovery and estimation from range images

Semantic Object-level Modeling for Robust Visual Camera Relocalization

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

&#8467;1 Major Component Detection and Analysis (&#8467;1 MCDA): Foundations in Two Dimensions

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization