Abstract:Volume rendering, a technique for visualizing 3D arrays of sampled data, is computationally very expensive. Interactive volume rendering of large volumes (over 10243) is in demand for such applications as biomedical simulation and geoscience. Existing software optimizations can barely meet the challenge of today's increasingly large datasets. Even the fastest workstations equipped with special hardware are quickly overwhelmed. So far, none of the current special-purpose volume rendering hardware designs achieve real-time frame rate for large volumes at an acceptable hardware cost. In this dissertation, we propose an image-based framework which avails the coherence between neighboring frames during navigation of a volume dataset. The previously fully volume rendered view is cached as a keyview or keyframe. When generating the current novel view, instead of ray-casting the whole image, rays are cast only through those pixels which represent previously hidden objects. When the novel view camera moves only slightly away from that of keyview, the ray-cast pixels occupy only a small percent of the current view. Consequently, this gives us potential for vast speedup over traditional volume rendering. The rest of the novel view is generated directly from the keyview through inexpensive image transformation. To achieve this, we first construct a geometric iso-surface model from the volume, where the iso-value is deducted from the input transfer function. We further texture-map the keyview onto the constructed geometric model through projective texture mapping and then project it to the novel view. We have explored separate algorithms optimized for several stages of the framework: an algorithm for generating levels-of-detail representation of regular volumes—for efficient and levels-of-detail iso-surface extraction—and two algorithms for high quality and efficient texture mapping featuring backward and forward processing orders. To accelerate the volume rendering of keyview, we have developed a group of methods for decomposing 3D volume rotation into shear transformations which lend themselves to a feasible hardware or parallel implementation. Even though these algorithms are designed within this framework, we have demonstrated that they can be extended to serve other numerous general applications. We have applied our framework to several practical navigation systems. We have achieved an average of a magnitude speedup over that of traditional volume rendering and obtained an interactive frame rate on a case study of a virtual colon navigation of a patient's 5123 colon data. We have also extended the framework to interactive rendering of other data types, such as height field terrain and photograph sequence, and demonstrated the effectiveness of these extensions.

Texture-based 3D Ultrasound Real-time Volume Rendering

Algorithm for Displaying Surfaces from Volume Data

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

High-quality Texture-based Flow Visualization on Surfaces.

Application of Three-dimensional Visualization Technology in Medicine

Real-time freehand 3D ultrasound imaging

Real-time volume rendering of large datasets on standard PC hardware

Real-Time Ray Casting Rendering of Volume Clipping in Medical Visualization

Real-time visualization of large volume datasets on standard PC hardware

Real-time visualized freehand 3D ultrasound reconstruction based on GPU.

Incremental Volume Rendering Algorithm for Interactive 3D Ultrasound Imaging

Texture Mapping Based 3D-Reconstruction of Medical Images

Real-time Rendering of 3D Medical Data Sets

Depth-Box VDB: Accelerate Sparse Volume Rendering with Depth Maps Through Voxel Database

View Dependent Layer Sampling: an Approach to Hardware Implementation of Volume Ray Casting

Real-Time 3D Ultrasound Imaging System Based on a Hybrid Reconstruction Algorithm

Real-Time Rendering in Virtual Surgery

Accelerating the Volume Rendering in Virtual Endoscopy

Image-based Volume Rendering

Freehand Three--dimensional Ultrasound Image Filtering and Interpolating Basedon GPU

GPU-based Multi-Slice Per Pass Algorithm in Interactive Volume Illumination Rendering.