Abstract:Three-dimensional (3D) ultrasound imaging has contributed to our understanding of fetal developmental processes by providing rich contextual information of the inherently 3D anatomies. However, its use is limited in clinical settings, due to the high purchasing costs and limited diagnostic practicality. Freehand 2D ultrasound imaging, in contrast, is routinely used in standard obstetric exams, but inherently lacks a 3D representation of the anatomies, which limits its potential for more advanced assessment. Such full representations are challenging to recover even with external tracking devices due to internal fetal movement which is independent from the operator-led trajectory of the probe. Capitalizing on the flexibility offered by freehand 2D ultrasound acquisition, we propose ImplicitVol to reconstruct 3D volumes from non-sensor-tracked 2D ultrasound sweeps. Conventionally, reconstructions are performed on a discrete voxel grid. We, however, employ a deep neural network to represent, for the first time, the reconstructed volume as an implicit function. Specifically, ImplicitVol takes a set of 2D images as input, predicts their locations in 3D space, jointly refines the inferred locations, and learns a full volumetric reconstruction. When testing natively-acquired and volume-sampled 2D ultrasound video sequences collected from different manufacturers, the 3D volumes reconstructed by ImplicitVol show significantly better visual and semantic quality than the existing interpolation-based reconstruction approaches. The inherent continuity of implicit representation also enables ImplicitVol to reconstruct the volume to arbitrarily high resolutions. As formulated, ImplicitVol has the potential to integrate seamlessly into the clinical workflow, while providing richer information for diagnosis and evaluation of the developing brain.

Development of Implicit Representation Method for Freehand 3D Ultrasound Image Reconstruction of Carotid Vessel

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

Automatic Diagnosis of Carotid Atherosclerosis Using a Portable Freehand 3D Ultrasound Imaging System

Neural Implicit Surface Reconstruction of Freehand 3D Ultrasound Volume with Geometric Constraints

Efficient Neural Reconstruction for Freehand 3-D Ultrasound Imaging and Visualization in Augmented Reality

Surface Reconstruction from Sparse and Mutually Intersected Contours for Freehand 3D Ultrasound Using Variational Method

Sensorless volumetric reconstruction of fetal brain freehand ultrasound scans with deep implicit representation

Patient-specific cerebral 3D vessel model reconstruction using deep learning

Variational Approach To Reconstruct Surface From Sparse & Nonparallel Contours In Freehand 3d Ultrasound Imaging

Automated Segmentation Method for the 3D Ultrasound Carotid Image Based on Geometrically Deformable Model with Automatic Merge Function

Software that combines deep learning, 3D reconstruction and CFD to analyze the state of carotid arteries from ultrasound imaging

Sensorless End-to-End Freehand Three-dimensional Ultrasound Reconstruction with Physics Guided Deep Learning

Surface Reconstruction from Sparse Non-Parallel Cross-Sections for Freehand 3d Ultrasound Using Variational Implicit Functions

Improvement of depiction of the intracranial arteries on brain CT angiography using deep learning reconstruction

Surface Reconstruction from Sparse & Arbitrarily Oriented Contours in Freehand 3D Ultrasound.

Three-Dimensional Reconstruction of Vascular Model in Intravascular Ultrasound Images Using Semantic Segmentation

3D carotid artery segmentation using shape-constrained active contours

3D Ultrasound Image Reconstruction from Irregularly Sampled 2D Images

Rapid vessel segmentation and reconstruction of head and neck angiograms using 3D convolutional neural network

3D Ultrasound Reconstructions of the Carotid Artery and Thyroid Gland Using Artificial-Intelligence-Based Automatic Segmentation—Qualitative and Quantitative Evaluation of the Segmentation Results via Comparison with CT Angiography