Abstract:Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced occlusions. Conclusions: The authors have developed a fast and robust surface reconstruction method on point clouds captured from a 3D surface photogrammetry system, with demonstrated sub-millimeter reconstruction accuracy and subsecond reconstruction time. It is suitable for real-time motion tracking in radiotherapy, with clear surface structures for better quantifications.

Maximum Spatial–temporal Isometric Cluster for Dynamic Surface Correspondence

A clustering approach to free form surface reconstruction from multi-view range images

Free Form Surface Matching Using Motion Consistency

Three-dimensional Dynamic Surface Alignment Based on Isometric Random Walk Graph

3D Partial Correspondence Based on Isometric Bipartite Graph

Electors Voting for Fast Automatic Shape Correspondence

Prior surface model guided dense reconstruction via graph-cuts

Shape Sparse Correspondence for Nearly-Isometric Meshes Based on Green's Function Representation

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

Feature-Assisted Dense Spatio-Temporal Reconstruction From Binocular Sequences

Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenes

High-Accuracy Relative Pose Measurement of Noncooperative Objects Based on Double-Constrained Intersurface Mutual Projections

Nonisometric Surface Registration via Conformal Laplace-Beltrami Basis Pursuit

Isometric Multi-Shape Matching

A Coarse-to-Fine Algorithm for Matching and Registration in 3D Cross-Source Point Clouds

A Surface Approximation Method for Image and Video Correspondences

A Performance Evaluation of Correspondence Grouping Methods for 3D Rigid Data Matching

A Branch-and-Bound Approach to Correspondence and Grouping Problems

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system

Relative Epipolar Motion of Tracked Features for Correspondence in Binocular Stereo

Surface matching for object recognition in complex three-dimensional scenes