Abstract:Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced occlusions. Conclusions: The authors have developed a fast and robust surface reconstruction method on point clouds captured from a 3D surface photogrammetry system, with demonstrated sub-millimeter reconstruction accuracy and subsecond reconstruction time. It is suitable for real-time motion tracking in radiotherapy, with clear surface structures for better quantifications.

A Robust and Accurate Approach for Reconstruction of Patient-Specific 3D Bone Models from Sparse Point Sets.

Robust and accurate reconstruction of patient-specific 3d surface models from sparse point sets: a sequential three-stage trimmed optimization approach

Accurate and robust reconstruction of a surface model of the proximal femur from sparse-point data and a dense-point distribution model for surgical navigation.

Use of A Dense Surface Point Distribution Model in A Three-Stage Anatomical Shape Reconstruction from Sparse Information for Computer Assisted Orthopaedic Surgery: A Preliminary Study

Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models

RECONSTRUCTION OF PATIENT-SPECIFIC 3DBONE MODEL FROM BIPLANARX-RAY IMAGES AND POINTDISTRIBUTIONMODELS

Statistical deformable bone models for robust 3D surface extrapolation from sparse data

Bayesian mesh reconstruction from noisy point data

A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images.

Surface Reconstruction of Bone from X-ray Images and Point Distribution Model Incorporating a Novel Method for 2D-3D Correspondence

An Integrated Approach for Reconstructing a Surface Model of the Proximal Femur from Sparse Input Data and a Multi-Resolution Point Distribution Model: an in Vitro Study.

An Integrated Approach for Reconstructing Surface Models of the Proximal Femur from Sparse Input Data for Surgical Navigation

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model.

Shape-aware Surface Reconstruction from Sparse 3D Point-Clouds

3d Reconstruction Of A Patient-Specific Surface Model Of The Proximal Femur From Calibrated X-Ray Radiographs: A Validation Study

Kernel regularized bone surface reconstruction from partial data using statistical shape model.

2D/3D Reconstruction of Patient-Specific Surface Models and Uncertainty Estimation Via Posterior Shape Models

3d Volumetric Intensity Reconsturction From 2d X-Ray Images Using Partial Least Squares Regression

Reconstruction individual three-dimensional model of fractured long bone based on feature points

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system

LatentPCN: Latent Space-Constrained Point Cloud Network for Reconstruction of 3D Patient-Specific Bone Surface Models from Calibrated Biplanar X-ray Images