Abstract:3D modelling finds a wide range of applications in robot vision and reverse engineering. However due to the presence of surface scanning noise, accumulative registration errors, and improper data fusion, the reconstructed surfaces from multiple registered range images are often non-smooth and distorted with thick patches, false connections and blurred features. These shortcomings will limit the wide applications of 3D modelling using the latest laser scanning systems. In this paper, the clustering approach, surface segmentation and classification are employed to fuse registered range images to reduce the adverse effect of large accumulative registration errors and heavy scanning noise, minimize the dissimilarity of the fused surface with respect to the original overlapping surfaces, and produce smooth and detailed 3D object computer models. For initialization of the clustering approach, an automatic method is developed, shifting possible corresponding points from different viewpoints toward each other and thus, making sure that the initialization of the cluster centroids are in between the two data sets so that more efficient and effective integration of data can be obtained. Then the principal component analysis (PCA) is employed to segment these centroids into different areas for the representation of the initially fused surface and then the tensor analysis is applied to classify these areas into featured and non-featured ones. In the integration process, the K means and fuzzy c means clustering approaches from the pattern recognition and machine learning literatures are employed to integrate non-featured areas for a smooth fused surface and featured areas for keeping the geometric details. By controlling a parameter, the final integrated surface can be traded off between smoothness and geometric details. Finally the fused point set is triangulated using an improved Delaunay method, guaranteeing a watertight surface. The new method is theoretically guaranteed to converge and minimize the dissimilarity between the final fused surface and original surfaces. A comparative study based on real images shows that the proposed algorithm desirably retains geometric details, produces smooth surface and minimizes the integration error.

The correspondence between the surface to be recovered and its images based on multicolor pseudo-random array in machine vision

Research on application of multicolor pseudo - random code in characteristic point match

A clustering approach to free form surface reconstruction from multi-view range images

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Study on the Feature Point Extraction of Multicolor Pseudo-random Encoded Single Image in Uncalibrated 3D Euclidean Reconstruction

Feature Points Matching for Face Reconstruction Based on the Window Unique Property of Pseudo-Random Coded Image

Application Of Color-Encoded Structure Light In 3-D Vision Technology

Image Processing For Virtual Recovery Of Murals

Non-Lambertian photometric stereo by color and noise analysis

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

Structured Light Acquisition System Based on Waveband Separation

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

Research on the technique of dynamic 3D measurement of structured light based on color grating

A Robust and Accurate Structured Light Pattern for Dynamic 3D Reconstruction

An adaptive calibration algorithm for projected images in daily environment.

3D reconstruction of objects with occlusion and surface reflection using a dual monocular structured light system.

Machine Vision and Data Reconstruction for Measuring Free Form Surface

3D Reconstruction from a Single Still Image Based on Monocular Vision of an Uncalibrated Camera

Deep-learning Based Single-Shot 3D Reconstruction with Simulated Color-Crosstalk and Randomized Extrinsics

Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light

3D Reconstruction of Outdoor Scenes from Synchronized Laser Range Data and Visual Image Data