Abstract:The fundamental motivation of the proposed work is to present a new visualization-guided computing paradigm to combine direct 3D volume processing and volume rendered clues for effective 3D exploration. For example, extracting and visualizing microstructures in-vivo have been a long-standing challenging problem. However, due to the high sparseness and noisiness in cerebrovasculature data as well as highly complex geometry and topology variations of micro vessels, it is still extremely challenging to extract the complete 3D vessel structure and visualize it in 3D with high fidelity. In this paper, we present an end-to-end deep learning method, VC-Net, for robust extraction of 3D microvascular structure through embedding the image composition, generated by maximum intensity projection (MIP), into the 3D volumetric image learning process to enhance the overall performance. The core novelty is to automatically leverage the volume visualization technique (e.g., MIP - a volume rendering scheme for 3D volume images) to enhance the 3D data exploration at the deep learning level. The MIP embedding features can enhance the local vessel signal (through canceling out the noise) and adapt to the geometric variability and scalability of vessels, which is of great importance in microvascular tracking. A multi-stream convolutional neural network (CNN) framework is proposed to effectively learn the 3D volume and 2D MIP feature vectors, respectively, and then explore their inter-dependencies in a joint volume-composition embedding space by unprojecting the 2D feature vectors into the 3D volume embedding space. It is noted that the proposed framework can better capture the small/micro vessels and improve the vessel connectivity. To our knowledge, this is the first time that a deep learning framework is proposed to construct a joint convolutional embedding space, where the computed vessel probabilities from volume rendering based 2D projection and 3D volume can be explored and integrated synergistically. Experimental results are evaluated and compared with the traditional 3D vessel segmentation methods and the state-of-the-art in deep learning, by using extensive public and real patient (micro- )cerebrovascular image datasets. The application of this accurate segmentation and visualization of sparse and complicated 3D microvascular structure facilitated by our method demonstrates the potential in a powerful MR arteriogram and venogram diagnosis of vascular disease.

Three-dimensional cerebral vasculature topological parameter extraction of transgenic zebrafish embryos with a filling-enhancement deep learning network

3D quantification of zebrafish cerebrovascular architecture by automated image analysis of light sheet fluorescence microscopy datasets

Zebrafish vascular quantification: a tool for quantification of three-dimensional zebrafish cerebrovascular architecture by automated image analysis

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

Quantitative analysis of blood vessels and nerve cells based on three-dimensional microscopic imaging of the whole mouse brain

Optimized U-Net model for 3D light-sheet image segmentation of zebrafish trunk vessels

In-vivo 3D imaging of Zebrafish’s intersegmental vessel development by a bi-directional light-sheet illumination microscope

3D BrainCV: Simultaneous Visualization and Analysis of Cells and Capillaries in a Whole Mouse Brain with One-Micron Voxel Resolution.

Zebrafish Embryo Vessel Segmentation Using a Novel Dual ResUNet Model

Deep learning-based vessel extraction in 3D confocal microscope images of cleared human glioma tissues

Topological Analysis of Mouse Brain Vasculature via 3D Light-sheet Microscopy Images

3DVascNet: An Automated Software for Segmentation and Quantification of Mouse Vascular Networks in 3D

Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy

Automated Vessel Tracing for Cerebral Vascularity Study in Microscopy Images

Contour attention network for cerebrovascular segmentation from TOF‐MRA volumetric images

Extraction of Vessel Networks Based on Multiview Projection and Phase Field Model

Automated cell tracking using 3D nnUnet and Light Sheet Microscopy to quantify regional deformation in zebrafish

Methods for dynamic and whole volume imaging of the zebrafish heart

VC-Net: Deep Volume-Composition Networks for Segmentation and Visualization of Highly Sparse and Noisy Image Data

A Machine Learning Method for Automated In Vivo Transparent Vessel Segmentation and Identification Based on Blood Flow Characteristics

Haemodynamics-driven developmental pruning of brain vasculature in zebrafish