Abstract:Three-dimensional (3D) ultrasound imaging has contributed to our understanding of fetal developmental processes by providing rich contextual information of the inherently 3D anatomies. However, its use is limited in clinical settings, due to the high purchasing costs and limited diagnostic practicality. Freehand 2D ultrasound imaging, in contrast, is routinely used in standard obstetric exams, but inherently lacks a 3D representation of the anatomies, which limits its potential for more advanced assessment. Such full representations are challenging to recover even with external tracking devices due to internal fetal movement which is independent from the operator-led trajectory of the probe. Capitalizing on the flexibility offered by freehand 2D ultrasound acquisition, we propose ImplicitVol to reconstruct 3D volumes from non-sensor-tracked 2D ultrasound sweeps. Conventionally, reconstructions are performed on a discrete voxel grid. We, however, employ a deep neural network to represent, for the first time, the reconstructed volume as an implicit function. Specifically, ImplicitVol takes a set of 2D images as input, predicts their locations in 3D space, jointly refines the inferred locations, and learns a full volumetric reconstruction. When testing natively-acquired and volume-sampled 2D ultrasound video sequences collected from different manufacturers, the 3D volumes reconstructed by ImplicitVol show significantly better visual and semantic quality than the existing interpolation-based reconstruction approaches. The inherent continuity of implicit representation also enables ImplicitVol to reconstruct the volume to arbitrarily high resolutions. As formulated, ImplicitVol has the potential to integrate seamlessly into the clinical workflow, while providing richer information for diagnosis and evaluation of the developing brain.

Sensorless volumetric reconstruction of fetal brain freehand ultrasound scans with deep implicit representation

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

RapidVol: Rapid Reconstruction of 3D Ultrasound Volumes from Sensorless 2D Scans

EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers

Neural Implicit Surface Reconstruction of Freehand 3D Ultrasound Volume with Geometric Constraints

Efficient Neural Reconstruction for Freehand 3-D Ultrasound Imaging and Visualization in Augmented Reality

Sensorless End-to-End Freehand Three-dimensional Ultrasound Reconstruction with Physics Guided Deep Learning

Real-time volume rendering for three-dimensional fetal ultrasound using volumetric photon mapping

Super-Resolution Reconstruction of Fetal Brain MRI with Prior Anatomical Knowledge

Surface Reconstruction from Sparse and Mutually Intersected Contours for Freehand 3D Ultrasound Using Variational Method

An Automated Framework for Localization, Segmentation and Super-Resolution Reconstruction of Fetal Brain MRI

Automatic Fetal Face Detection from Ultrasound Volumes Via Learning 3D and 2D Information

Variational Approach To Reconstruct Surface From Sparse & Nonparallel Contours In Freehand 3d Ultrasound Imaging

Surface Reconstruction from Sparse Non-Parallel Cross-Sections for Freehand 3d Ultrasound Using Variational Implicit Functions

Implicit Neural Representations for Breathing-compensated Volume Reconstruction in Robotic Ultrasound

Development of Implicit Representation Method for Freehand 3D Ultrasound Image Reconstruction of Carotid Vessel

3D Volume Reconstruction and Biometric Analysis of Fetal Brain from MR Images

Variational surface reconstruction from sparse and nonparallel contours for freehand 3D ultrasound

Fully-automated alignment of 3D fetal brain ultrasound to a canonical reference space using multi-task learning

Surface Reconstruction from Sparse & Arbitrarily Oriented Contours in Freehand 3D Ultrasound.