Abstract:Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication. Over the years, multiple techniques have been developed in order to cope with the various associated challenges and present the relevant information from multiple sources in an insightful way. We present an overview of these techniques and analyse the specific challenges that arise in multi‐modal data visualization and how recent works aimed to solve these, often using smart visibility techniques. We provide a taxonomy of these multi‐modal visualization applications based on the modalities used and the visualization techniques employed. Additionally, we identify unsolved problems as potential future research directions. Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication.

Review:Visualization of Three-Dimensional Medical Images

A Review of Three-Dimensional Medical Image Visualization

Design and Implementation of Three Dimensional Visualization and Analysis System of Medical Images

[Review: Segmentation and Classification Methods of 3D Medical Images].

Application of Three-dimensional Visualization Technology in Medicine

3D and 4D Medical Image Registration Combined with Image Segmentation and Visualization

Research progress and development direction of visualization and accelerating techniques for medical images

3D Display of Sequential 2D Medical Images

3D Visualization Research on Clinical Medical Science

A Survey on Multimodal Medical Data Visualization

Study And Application Of Medical Image Visualization Technology

Multimodal Medical Image Visualization Based on Mutual Information and Direct Multimodal Volume Rendering

Development and Implement with Visualization for Medical Volumetric Data

A Review of Image Segmentation Methods

[3D Visualization and Information Interaction in Biomedical Applications].

Advanced 3D Visualization and 3D Printing in Radiology

Design of an Interactive 3D Medical Visualization System

Design and Realization of a Medical Images Three-dimensional Visualization System

A New Approach of Building 3D Visualization Framework for Multimodal Medical Images Display and Computed Assisted Diagnosis

Data visualization in healthcare and medicine: a survey

Image segmentation and 3D visualization for MRI mammography