Abstract:Objective. Developing Machine Learning models (N Gorre et al 2023) for clinical applications from scratch can be a cumbersome task requiring varying levels of expertise. Seasoned developers and researchers may also often face incompatible frameworks and data preparation issues. This is further complicated in the context of diagnostic radiology and oncology applications, given the heterogenous nature of the input data and the specialized task requirements. Our goal is to provide clinicians, researchers, and early AI developers with a modular, flexible, and user-friendly software tool that can effectively meet their needs to explore, train, and test AI algorithms by allowing users to interpret their model results. This latter step involves the incorporation of interpretability and explainability methods that would allow visualizing performance as well as interpreting predictions across the different neural network layers of a deep learning algorithm.Approach. To demonstrate our proposed tool, we have developed the CRP10 AI Application Interface (CRP10AII) as part of the MIDRC consortium. CRP10AII is based on the web service Django framework in Python. CRP10AII/Django/Python in combination with another data manager tool/platform, data commons such as Gen3 can provide a comprehensive while easy to use machine/deep learning analytics tool. The tool allows to test, visualize, interpret how and why the deep learning model is performing. The major highlight of CRP10AII is its capability of visualization and interpretability of otherwise Blackbox AI algorithms.Results. CRP10AII provides many convenient features for model building and evaluation, including: (1) query and acquire data according to the specific application (e.g. classification, segmentation) from the data common platform (Gen3 here); (2) train the AI models from scratch or use pre-trained models (e.g. VGGNet, AlexNet, BERT) for transfer learning and test the model predictions, performance assessment, receiver operating characteristics curve evaluation; (3) interpret the AI model predictions using methods like SHAPLEY, LIME values; and (4) visualize the model learning through heatmaps and activation maps of individual layers of the neural network.Significance. Unexperienced users may have more time to swiftly pre-process, build/train their AI models on their own use-cases, and further visualize and explore these AI models as part of this pipeline, all in an end-to-end manner. CRP10AII will be provided as an open-source tool, and we expect to continue developing it based on users' feedback.

Brainchop: Providing an Edge Ecosystem for Deployment of Neuroimaging Artificial Intelligence Models

Brainchop: Next Generation Web-Based Neuroimaging Application

BrainFounder: Towards Brain Foundation Models for Neuroimage Analysis

DeepNeuro: an open-source deep learning toolbox for neuroimaging

Neuralizer: General Neuroimage Analysis without Re-Training

BrainSegFounder: Towards 3D foundation models for neuroimage segmentation

A Practical Roadmap to Implementing Deep Learning Segmentation in the Clinical Neuroimaging Research Workflow

U-net model for brain extraction: Trained on humans for transfer to non-human primates

Discovery Viewer (DV): Web-Based Medical AI Model Development Platform and Deployment Hub

NeuroAtlas: An Artificial Intelligence-based Framework for Annotation, Segmentation and Registration of Large Scale Biomedical Imaging Data

MIDRC CRP10 AI interface-an integrated tool for exploring, testing and visualization of AI models

Neurodesk: an accessible, flexible and portable data analysis environment for reproducible neuroimaging

Innv-02. Brainmets: A Clinician-Friendly Software To Manually Segment Brain Metastases And Detect Primary Tumor Origin Using Deep Learning

Characterizing browser-based medical imaging AI with serverless edge computing: towards addressing clinical data security constraints

Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

Neuro-XAI: Explainable deep learning framework based on deeplabV3+ and bayesian optimization for segmentation and classification of brain tumor in MRI scans

A Tool for Interactive Data Visualization: Application to Over 10,000 Brain Imaging and Phantom MRI Data Sets

WebMRI: Brain extraction and linear registration in the web browser

A foundation model for generalized brain MRI analysis

ExBrainable: An Open-Source GUI for CNN-based EEG Decoding and Model Interpretation

Brain Recording Analysis and Visualization Online (BRAVO): An open-source visualization tool for deep brain stimulation data