Abstract:Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication. Over the years, multiple techniques have been developed in order to cope with the various associated challenges and present the relevant information from multiple sources in an insightful way. We present an overview of these techniques and analyse the specific challenges that arise in multi‐modal data visualization and how recent works aimed to solve these, often using smart visibility techniques. We provide a taxonomy of these multi‐modal visualization applications based on the modalities used and the visualization techniques employed. Additionally, we identify unsolved problems as potential future research directions. Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication.

Relation-Aware Spreadsheets For Multimodal Volume Segmentation And Visualization

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

FeatureNet: Automatic Visual Summarization of Major Features in Multivariate Volume Data

Relation-Aware Volume Exploration Pipeline.

SegVol: Universal and Interactive Volumetric Medical Image Segmentation

Database-guided simultaneous multi-slice 3d segmentation for volumetric data

Uncertainty-Based Visual Guidance for Interactive Medical Volume Segmentation Editing

Model-driven Multicomponent Volume Exploration.

MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidance

A Multivolume Visualization Method for Spatially Aligned Volumes after 3D/3D Image Registration

An efficient interactive multi-label segmentation tool for 2D and 3D medical images using fully connected conditional random field

Interactive Occlusion-Free System for Accessible Volume Exploration

An effective and open source interactive 3D medical image segmentation solution

Interactive Volumetric Segmentation Through Least-Squares Optimization of Local Hessian-Constrained Implicits

Improving 3D Medical Image Segmentation at Boundary Regions using Local Self-attention and Global Volume Mixing

A knowledge-based approach to volumetric medical image segmentation

Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network

Robust Semi-supervised Multimodal Medical Image Segmentation via Cross Modality Collaboration

A New Algorithm of Brain Volume Contours Segmentation

A Survey on Multimodal Medical Data Visualization

Disentangle, align and fuse for multimodal and semi-supervised image segmentation