Abstract:Three‐dimensional visualisation of mesh reconstruction of the medical images is commonly used for various clinical applications including pre / post‐surgical planning. Such meshes are conventionally generated by extracting the surface from volumetric segmentation masks. Therefore, they have inherent limitations of staircase artefacts due to their anisotropic voxel dimensions. The time‐consuming process for manual refinement to remove artefacts and/or the isolated regions further adds to these limitations. Methods for directly generating meshes from volumetric data by template deformation are often limited to simple topological structures, and methods that use implicit functions for continuous surfaces, do not achieve the level of mesh reconstruction accuracy when compared to segmentation‐based methods. In this study, we address these limitations by combining the implicit function representation with a multi‐level deep learning architecture. We introduce a novel multi‐level local feature sampling component which leverages the spatial features for the implicit function regression to enhance the segmentation result. We further introduce a shape boundary estimator that accelerates the explicit mesh reconstruction by minimising the number of the signed distance queries during model inference. The result is a multi‐level deep learning network that directly regresses the implicit function from medical image volumes to a continuous surface model, which can be used for mesh reconstruction from arbitrary high volume resolution to minimise staircase artefacts. We evaluated our method using pelvic computed tomography (CT) dataset from two public sources with varying z‐axis resolutions. We show that our method minimised the staircase artefacts while achieving comparable results in surface accuracy when compared to the state‐of‐the‐art segmentation algorithms. Furthermore, our method was 9 times faster in volume reconstruction than comparable implicit shape representation networks.

Fast Medical Shape Reconstruction via Meta-learned Implicit Neural Representations

Deep Medial Voxels: Learned Medial Axis Approximations for Anatomical Shape Modeling

Learning continuous shape priors from sparse data with neural implicit functions

Shape registration with learned deformations for 3D shape reconstruction from sparse and incomplete point clouds

ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction

MISNeR: Medical Implicit Shape Neural Representation for Image Volume Visualisation

Enhanced 3D Shape Reconstruction With Knowledge Graph of Category Concept

Reconstruction and completion of high-resolution 3D cardiac shapes using anisotropic CMRI segmentations and continuous implicit neural representations

Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction

Shape of my heart: Cardiac models through learned signed distance functions

Anatomically Constrained Implicit Face Models

ShapeMed-Knee: A Dataset and Neural Shape Model Benchmark for Modeling 3D Femurs

Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstruction

Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks

Skull shape reconstruction using cascaded convolutional networks

World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography

Joint reconstruction and segmentation in undersampled 3D knee MRI combining shape knowledge and deep learning

Seeking Common Ground While Reserving Differences: Multiple Anatomy Collaborative Framework for Undersampled MRI Reconstruction

Automatic Skull Reconstruction by Deep Learnable Symmetry Enforcement

Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworks

Fast Mesh Reconstruction from Single View Based on GCN and Topology Modification.