Abstract:Background and objectivesMedical image analysis and computer-assisted intervention problems are increasingly being addressed with deep-learning-based solutions. Established deep-learning platforms are flexible but do not provide specific functionality for medical image analysis and adapting them for this domain of application requires substantial implementation effort. Consequently, there has been substantial duplication of effort and incompatible infrastructure developed across many research groups. This work presents the open-source NiftyNet platform for deep learning in medical imaging. The ambition of NiftyNet is to accelerate and simplify the development of these solutions, and to provide a common mechanism for disseminating research outputs for the community to use, adapt and build upon.MethodsThe NiftyNet infrastructure provides a modular deep-learning pipeline for a range of medical imaging applications including segmentation, regression, image generation and representation learning applications. Components of the NiftyNet pipeline including data loading, data augmentation, network architectures, loss functions and evaluation metrics are tailored to, and take advantage of, the idiosyncracies of medical image analysis and computer-assisted intervention. NiftyNet is built on the TensorFlow framework and supports features such as TensorBoard visualization of 2D and 3D images and computational graphs by default.ResultsWe present three illustrative medical image analysis applications built using NiftyNet infrastructure: (1) segmentation of multiple abdominal organs from computed tomography; (2) image regression to predict computed tomography attenuation maps from brain magnetic resonance images; and (3) generation of simulated ultrasound images for specified anatomical poses.ConclusionsThe NiftyNet infrastructure enables researchers to rapidly develop and distribute deep learning solutions for segmentation, regression, image generation and representation learning applications, or extend the platform to new applications.

NiftyNet: a Deep-Learning Platform for Medical Imaging

Code-free deep learning for multi-modality medical image classification

DeepNeuro: an open-source deep learning toolbox for neuroimaging

Deep Learning Approaches for Medical Image Analysis and Diagnosis

Deep medical image analysis with representation learning and neuromorphic computing

Automated Design of Deep Learning Methods for Biomedical Image Segmentation

INCEPTNET: Precise And Early Disease Detection Application For Medical Images Analyses

A DICOM Framework for Machine Learning Pipelines against Real-Time Radiology Images

Iterative annotation to ease neural network training: Specialized machine learning in medical image analysis

DeepMediX: A Deep Learning-Driven Resource-Efficient Medical Diagnosis Across the Spectrum

One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentation

A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises

A survey on deep learning in medical image analysis

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

MONAI: An open-source framework for deep learning in healthcare

NISF: Neural Implicit Segmentation Functions

BIBSNet: A Deep Learning Baby Image Brain Segmentation Network for MRI Scans

U-Net in Medical Image Segmentation: A Review of Its Applications Across Modalities

Deep Learning Based Medical Imaging Analysis

DeepEdit: Deep Editable Learning for Interactive Segmentation of 3D Medical Images