Abstract:Direct volume rendering (DVR) is a technique that emphasizes structures of interest (SOIs) within a volume visually, while simultaneously depicting adjacent regional information, e.g., the spatial location of a structure concerning its neighbors. In DVR, transfer function (TF) plays a key role by enabling accurate identification of SOIs interactively as well as ensuring appropriate visibility of them. TF generation typically involves non-intuitive trial-and-error optimization of rendering parameters, which is time-consuming and inefficient. Attempts at mitigating this manual process have led to approaches that make use of a knowledge database consisting of pre-designed TFs by domain experts. In these approaches, a user navigates the knowledge database to find the most suitable pre-designed TF for their input volume to visualize the SOIs. Although these approaches potentially reduce the workload to generate the TFs, they, however, require manual TF navigation of the knowledge database, as well as the likely fine tuning of the selected TF to suit the input. In this work, we propose a TF design approach, CBR-TF, where we introduce a new content-based retrieval (CBR) method to automatically navigate the knowledge database. Instead of pre-designed TFs, our knowledge database contains volumes with SOI labels. Given an input volume, our CBR-TF approach retrieves relevant volumes (with SOI labels) from the knowledge database; the retrieved labels are then used to generate and optimize TFs of the input. This approach largely reduces manual TF navigation and fine tuning. For our CBR-TF approach, we introduce a novel volumetric image feature which includes both a local primitive intensity profile along the SOIs and regional spatial semantics available from the co-planar images to the profile. For the regional spatial semantics, we adopt a convolutional neural network to obtain high-level image feature representations. For the intensity profile, we extend the dynamic time warping technique to address subtle alignment differences between similar profiles (SOIs). Finally, we propose a two-stage CBR scheme to enable the use of these two different feature representations in a complementary manner, thereby improving SOI retrieval performance. We demonstrate the capabilities of our CBR-TF approach with comparison with a conventional approach in visualization, where an intensity profile matching algorithm is used, and also with potential use-cases in medical volume visualization.

A direct volume rendering visualization approach for serial PET-CT scans that preserves anatomical consistency

Fast PET Preview Image Reconstruction, Streaming, and Visualization During Data Acquisition: A Preliminary Study

Photorealistic three-dimensional visualization of fusion datasets: cinematic rendering of PET/CT

Simultaneous Reconstruction and Segmentation of Dynamic Pet Via Low-Rank and Sparse Matrix Decomposition

Depth-Based Feature Enhancement for Volume Visualization

Real-time visualization of large volume datasets on standard PC hardware

Accelerating Volume Ray Casting by Empty Space Skipping Used for Computer-Aided Therapy

A Transfer Function Design for Medical Volume Data Using a Knowledge Database Based on Deep Image and Primitive Intensity Profile Features Retrieval

Reconstrucion and Visualization of 3D Surface Model from Serial-Sectioned Contour Points

A New Technique of the Virtual Reality Visualization of Complex Volume Images from the Computer Tomography and Magnetic Resonance Imaging

MIP-Guided Vascular Image Visualization with Multi-Dimensional Transfer Function

Real-Time Visualize the 3D Reconstruction Procedure Using CUDA

An Efficient Iterative Cerebral Perfusion CT Reconstruction Via Low-Rank Tensor Decomposition with Spatial-Temporal Total Variation Regularization.

Interactive three dimensional medical image visualization based on graphic processing unit

Three-Dimensional CT Imaging with Volume Rending of Separating Fusing, Opacifying and False-Coloring Technique

3D Display System for Exploration Cardiovascular DSCT Volume

A practical PET/CT data visualization method with dual-threshold PET colorization and image fusion

Dynamic PET cardiac and parametric image reconstruction: a fixed-point proximity gradient approach using patch-based DCT and tensor SVD regularization

Real-Time Visualization and Interaction of Three-dimensional Human CT Images.

The Design and Realization of Real-Time Three-Dimensional Visualization System for Industrial Computed Tomography Based on GPU

Virtual Reality for Interactive Medical Analysis.