Abstract:Mesh reconstruction of the cardiac anatomy from medical images is useful for shape and motion measurements and biophysics simulations to facilitate the assessment of cardiac function and health. However, 3D medical images are often acquired as 2D slices that are sparsely sampled and noisy, and mesh reconstruction on such data is a challenging task. Traditional voxel-based approaches rely on pre- and post-processing that compromises image fidelity, while mesh-level deep learning approaches require mesh annotations that are difficult to get. Therefore, direct cross-domain supervision from 2D images to meshes is a key technique for advancing 3D learning in medical imaging, but it has not been well-developed. While there have been attempts to approximate the optimized meshes' slicing, few existing methods directly use 2D slices to supervise mesh reconstruction in a differentiable manner. Here, we propose a novel explicit differentiable voxelization and slicing (DVS) algorithm that allows gradient backpropagation to a mesh from its slices, facilitating refined mesh optimization directly supervised by the losses defined on 2D images. Further, we propose an innovative framework for extracting patient-specific left ventricle (LV) meshes from medical images by coupling DVS with a graph harmonic deformation (GHD) mesh morphing descriptor of cardiac shape that naturally preserves mesh quality and smoothness during optimization. Experimental results demonstrate that our method achieves state-of-the-art performance in cardiac mesh reconstruction tasks from CT and MRI, with an overall Dice score of 90% on multi-datasets, outperforming existing approaches. The proposed method can further quantify clinically useful parameters such as ejection fraction and global myocardial strains, closely matching the ground truth and surpassing the traditional voxel-based approach in sparse images.

MorphiNet: A Graph Subdivision Network for Adaptive Bi-ventricle Surface Reconstruction

Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRI

Multi-class point cloud completion networks for 3D cardiac anatomy reconstruction from cine magnetic resonance images

A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstruction

3D Coronary Vessel Reconstruction from Bi-Plane Angiography using Graph Convolutional Networks

Reconstruction of Cardiac Cine MRI Using Motion-Guided Deformable Alignment and Multi-Resolution Fusion

Neural Deformable Models for 3D Bi-Ventricular Heart Shape Reconstruction and Modeling from 2D Sparse Cardiac Magnetic Resonance Imaging

Multi-component Deformable Models Coupled with 2D-3D U-Net for Automated Probabilistic Segmentation of Cardiac Walls and Blood

Automated model discovery for human cardiac tissue: Discovering the best model and parameters

Reconstruction of Cardiac Cine MRI Using Motion‐Guided Deformable Alignment and Multi‐Resolution Fusion

DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume Reconstruction

Patient-specific Heart Geometry Modeling for Solid Biomechanics using Deep Learning

Reconstruction and completion of high-resolution 3D cardiac shapes using anisotropic CMRI segmentations and continuous implicit neural representations

Learning Whole Heart Mesh Generation From Patient Images For Computational Simulations

Improved 3D Whole Heart Geometry from Sparse CMR Slices

Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges

CNN-based Cardiac Motion Extraction to Generate Deformable Geometric Left Ventricle Myocardial Models from Cine MRI

Explicit Differentiable Slicing and Global Deformation for Cardiac Mesh Reconstruction

Shape of my heart: Cardiac models through learned signed distance functions

Measure Anatomical Thickness from Cardiac MRI with Deep Neural Networks