Abstract:Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication. Over the years, multiple techniques have been developed in order to cope with the various associated challenges and present the relevant information from multiple sources in an insightful way. We present an overview of these techniques and analyse the specific challenges that arise in multi‐modal data visualization and how recent works aimed to solve these, often using smart visibility techniques. We provide a taxonomy of these multi‐modal visualization applications based on the modalities used and the visualization techniques employed. Additionally, we identify unsolved problems as potential future research directions. Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication.

Multivariate Visualization of Particle Data

A Survey of Multivariate Spatial Data Visualization

Parallel Realistic Visualization of Particle‐based Fluid

Using Visualization to Improve Clustering Analysis on Heterogeneous Information Network.

Multivariate Spatial Data Visualization: A Survey

Spatial and Temporal Processes Visualization for Marine Environmental Data Using Particle System.

Visual Analysis of Large Multivariate Scattered Data using Clustering and Probabilistic Summaries

Visual inspection of multivariate volume data based on multi-class noise sampling

Multivariate Visualization for Atmospheric Pollution

Biclusters Based Visual Exploration of Multivariate Scientific Data

Scalable Multivariate Volume Visualization and Analysis based on Dimension Projection and Parallel Coordinates.

Parallel Visualization for Large-Scale Datasets

Visualization for physics analysis improvement and applications in BESIII

Model Based Visualization Of Four-Dimensional Data

Review:Visualization of Three-Dimensional Medical Images

Scalable multivariate volume visualization and analysis

Cluster-Based Visual Abstraction for Multivariate Scatterplots

Visualization of Pairwise Data: an Overview

Visual Abstraction and Exploration of Multi-class Scatterplots

Scattering Points in Parallel Coordinates

A Survey on Multimodal Medical Data Visualization