Abstract:Point clouds are a widely used format for storing information in a memory-efficient and easily manipulatable representation. However, research in the application of point cloud mapping and subsequent organ reconstruction with deep learning, is limited. In particular, current methods for left atrium (LA) visualization using point clouds recorded from clinical mapping during cardiac ablation are proprietary and remain difficult to validate. Many clinics rely on additional imaging such as MRIs/CTs to improve the accuracy of LA mapping. In this study, for the first time, we proposed a novel deep learning framework for the automatic 3D surface reconstruction of the LA directly from point clouds acquired via widely used clinical mapping systems. The backbone of our framework consists of a 30-layer 3D fully convolutional neural network (CNN). The architecture contains skip connections that perform multi-resolution processing to maximize information extraction from the point clouds and ensure a high-resolution prediction by combining features at different receptive levels. We used large kernels with increased receptive fields to address the sparsity of the point clouds. Residual blocks and activation normalization were further implemented to improve the feature learning on sparse inputs. By utilizing a light-weight design with low-depth layers, our CNN took approximately 10 s per patient. Independent testing on two cross-modality clinical datasets showed excellent dice scores of 93% and surface-to-surface distances below 1 pixel. Overall, our study may provide a more efficient, cost-effective 3D LA reconstruction approach during ablation procedures, and potentially lead to improved treatment of cardiac diseases.

On Verification of Splines Based Intraoperative Reconstruction of Cardiac Anatomy: Model Research

An Approach for Designing Patient-Specific Prosthetic Aortic Valves Based on CTA Images Using Fluid-Structure Interaction (FSI) Method.

Progressive Surface Reconstruction of Cardiac Anatomy from Sparse and Scattered Points for Heart Mapping Procedure

A New Dynamic Surface Reconstruction Method for Cardiac 3D Mapping Procedure

Closed T-Spline Surface Reconstruction from Medical Image Data

Ultrasonic Ray-Tracing Based Endocardial Surface Reconstruction

Simultaneous segmentation and motion recovery in 3d cardiac image analysis

A Piecewise Patch-to-model Matching Method for Image-Guided Cardiac Catheter Ablation

Extraction and reconstruction of the 3-D cardiac motion and material information from medical images

Experimental validation and clinical feasibility of 3D reconstruction of coronary artery bifurcation stents using intravascular ultrasound

Automatic 3D Surface Reconstruction of the Left Atrium From Clinically Mapped Point Clouds Using Convolutional Neural Networks

A Simultaneous Framework for Recovering Three Dimensional Shape and Nonrigid Motion from Cardiac Image Sequences

Research on 3D Reconstruction Algorithm of Medical CT Image Based on Parallel Contour

Reconstruction of Intima and Adventitia Models into a State Undeformed by a Catheter by Using CT, IVUS, and Biplane X-Ray Angiogram Images

Patient-specific Heart Geometry Modeling for Solid Biomechanics using Deep Learning

Reconstruction of a Finite Element Model of Intracranial Aneurysms Based on CT Images

4D Myocardium Reconstruction with Decoupled Motion and Shape Model

Shape of my heart: Cardiac models through learned signed distance functions

3D reconstruction of coronary artery bifurcations from intravascular ultrasound and angiography

A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstruction

High-Quality Intra-Operative Ultrasound Reconstruction Based On Catheter Path