Abstract:Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced occlusions. Conclusions: The authors have developed a fast and robust surface reconstruction method on point clouds captured from a 3D surface photogrammetry system, with demonstrated sub-millimeter reconstruction accuracy and subsecond reconstruction time. It is suitable for real-time motion tracking in radiotherapy, with clear surface structures for better quantifications.

GPSR: A Green Point Cloud Surface Reconstruction Method

Improved Fast 3D Reconstruction Algorithm Based on Laser Scanning Point Cloud

A Novel Pointcloud-Based Isosurface Extraction

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system

3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting

GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision

A Fast Progressive Surface Reconstruction Algorithm for Unorganized Points

Multi-grid Representation with Field Regularization for Self-Supervised Surface Reconstruction from Point Clouds

Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors

Surface Reconstruction Technology from Dense Scattered Points Based on Grid

Surface Reconstruction from Point Clouds without Normals by Parametrizing the Gauss Formula

Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction

A New Approach to 3D Object Surface Reconstruction from Unorganized Points

3D-PCGR: Colored Point Cloud Generation and Reconstruction with Surface and Scale Constraints

Diffusing Winding Gradients (DWG): A Parallel and Scalable Method for 3D Reconstruction from Unoriented Point Clouds

SSRNet: Scalable 3D Surface Reconstruction Network

PG-NeuS: Robust and Efficient Point Guidance for Multi-View Neural Surface Reconstruction

A Novel Surface Reconstruction Framework from Point Clouds Without Normal

StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting

A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds