Abstract:Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced occlusions. Conclusions: The authors have developed a fast and robust surface reconstruction method on point clouds captured from a 3D surface photogrammetry system, with demonstrated sub-millimeter reconstruction accuracy and subsecond reconstruction time. It is suitable for real-time motion tracking in radiotherapy, with clear surface structures for better quantifications.

Efficient 3D Volume Reconstruction from a Point Cloud Using a Phase-Field Method

Three-dimensional Volume Reconstruction from Slice Data Using Phase-Field Models

Improved Fast 3D Reconstruction Algorithm Based on Laser Scanning Point Cloud

Fast and Efficient Narrow Volume Reconstruction from Scattered Data.

A High-Precision Reconstruction Algorithm of 3D Data Fields Based on Quasi-interpolation

Effective 3D Object Reconstruction from Densely Sampled Circular Light Fields

A Two-Phase Approach of Progressive Mesh Reconstruction from Unorganized Point Clouds

A New Method of Point Clouds Extraction from the 3D Volume Data

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Phase-field Guided Surface Reconstruction Based on Implicit Hierarchical B-splines.

Virtual Structured-Light Three-Dimensional Point Cloud Compression with Geometric Reshaping

3D Incomplete Point Cloud Surfaces Reconstruction with Segmentation and Feature-Enhancement.

3D Surface Segmentation from Point Clouds Via Quadric Fits Based on DBSCAN Clustering

Second-order accurate and unconditionally stable algorithm with unique solvability for a phase-field model of 3D volume reconstruction

RECONSTRUCTION OF 3D MODELS FROM POINT CLOUDS WITH HYBRID REPRESENTATION

Consistently and unconditionally energy-stable linear method for the diffuse-interface model of narrow volume reconstruction

A new segmentation method for point cloud data

3D Reconstruction and Measurement Analysis of a Dense Point Cloud Fused with a Depth Image

Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system