Abstract:Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication. Over the years, multiple techniques have been developed in order to cope with the various associated challenges and present the relevant information from multiple sources in an insightful way. We present an overview of these techniques and analyse the specific challenges that arise in multi‐modal data visualization and how recent works aimed to solve these, often using smart visibility techniques. We provide a taxonomy of these multi‐modal visualization applications based on the modalities used and the visualization techniques employed. Additionally, we identify unsolved problems as potential future research directions. Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication.

Multi-dimensional visualisation of laboratory findings and functional test results for analysing the clinical course of disease in medicine

Multifaceted Visual Analytics for Healthcare Applications

Design and Implementation of Three Dimensional Visualization and Analysis System of Medical Images

A Visualization Tool for Navigation of Online Disease Literature

ClinicalPath: a Visualization tool to Improve the Evaluation of Electronic Health Records in Clinical Decision-Making

Diseaseatlas: Multi-Facet Visual Analytics for Online Disease Articles

[Computer-based graphic documentation of retinal findings]

Integrated Visualization of Multi-Modal Electronic Health Record Data

Anatomically Integrated In-Place Visualization of Patient Data for Cooperative Tasks with a Case Study on a Neurosurgical Ward

Three-Dimensional Visual Patient Based on Electronic Medical Diagnostic Records.

On-Body Visualization of Patient Data for Cooperative Tasks

Visualization Index for Image-Enabled Medical Records

Bringing Modern Machine Learning into Clinical Practice Through the Use of Intuitive Visualization and Human–Computer Interaction

Visual Cluster Analysis in Support of Clinical Decision Intelligence.

Medical Graphs in Patient Information Systems in Primary Care

A Web-Based Medical Multimedia Visualisation Interface for Personal Health Records.

Medillustrator: Improving Retrospective Learning in Physicians' Continuous Medical Education via Multimodal Diagnostic Data Alignment and Representation

Design and implementation of a novel human-machine interactive healthcare system for visual reproduction test

MEDICAL ILLUSTRATION AS A HYBRID VISUALIZATION PHENOMENON FROM ART TO DESIGN UNDER THE LEADERSHIP OF MAX BRÖDEL

Visual representation of medical information: the importance of considering the end-user in the design of medical illustrations

A Survey on Multimodal Medical Data Visualization