Advances in machine learning methods facilitating collaborative image-based decision making for neuroscience

Chengjia Wang,Heye Zhang,Georgios Papanastasiou,Guang Yang

DOI: https://doi.org/10.3389/fncom.2023.1267489

IF: 3.387

2023-01-01

Frontiers in Computational Neuroscience

Abstract:EDITORIAL article Front. Comput. Neurosci., 12 September 2023 Volume 17 - 2023 | https://doi.org/10.3389/fncom.2023.1267489

What problem does this paper attempt to address?

Editorial: Innovative applications with artificial intelligence methods in neuroimaging data analysis.

Feng Liu,Li Zhao,Yuan-Chiao Lu,Yao Wu

DOI: https://doi.org/10.3389/fnhum.2022.1108253

IF: 3.473

2022-01-01

Frontiers in Human Neuroscience

Abstract:EDITORIAL article Front. Hum. Neurosci., 16 December 2022Sec. Brain Imaging and Stimulation Volume 16 - 2022 | https://doi.org/10.3389/fnhum.2022.1108253
Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data

Yachun Li,Patra Charalampaki,Yong Liu,Guang-Zhong Yang,Stamatia Giannarou

DOI: https://doi.org/10.1007/s11548-018-1806-7

2018-01-01

Abstract:Purpose Probe-based confocal laser endomicroscopy (pCLE) enables in vivo, in situ tissue characterisation without changes in the surgical setting and simplifies the oncological surgical workflow. The potential of this technique in identifying residual cancer tissue and improving resection rates of brain tumours has been recently verified in pilot studies. The interpretation of endomicroscopic information is challenging, particularly for surgeons who do not themselves routinely review histopathology. Also, the diagnosis can be examiner-dependent, leading to considerable inter-observer variability. Therefore, automatic tissue characterisation with pCLE would support the surgeon in establishing diagnosis as well as guide robot-assisted intervention procedures. Methods The aim of this work is to propose a deep learning-based framework for brain tissue characterisation for context aware diagnosis support in neurosurgical oncology. An efficient representation of the context information of pCLE data is presented by exploring state-of-the-art CNN models with different tuning configurations. A novel video classification framework based on the combination of convolutional layers with long-range temporal recursion has been proposed to estimate the probability of each tumour class. The video classification accuracy is compared for different network architectures and data representation and video segmentation methods. Results We demonstrate the application of the proposed deep learning framework to classify Glioblastoma and Meningioma brain tumours based on endomicroscopic data. Results show significant improvement of our proposed image classification framework over state-of-the-art feature-based methods. The use of video data further improves the classification performance, achieving accuracy equal to 99.49%. Conclusions This work demonstrates that deep learning can provide an efficient representation of pCLE data and accurately classify Glioblastoma and Meningioma tumours. The performance evaluation analysis shows the potential clinical value of the technique.
Editorial: Improving Diagnosis, Treatment, and Prognosis of Neuropsychiatric Disorders by Leveraging Neuroimaging-based Machine Learning

Baojuan Li,Huanyu Lu,Yu‐Feng Zang,Hui Shen,Qiuyun Fan,Jian Liu

DOI: https://doi.org/10.3389/fnins.2022.891337

IF: 4.3

2022-01-01

Frontiers in Neuroscience

Abstract:EDITORIAL article Front. Neurosci., 13 April 2022Sec. Brain Imaging Methods https://doi.org/10.3389/fnins.2022.891337
How Machine Learning is Powering Neuroimaging to Improve Brain Health

Nalini M. Singh,Jordan B. Harrod,Sandya Subramanian,Mitchell Robinson,Ken Chang,Suheyla Cetin-Karayumak,Adrian Vasile Dalca,Simon Eickhoff,Michael Fox,Loraine Franke,Polina Golland,Daniel Haehn,Juan Eugenio Iglesias,Lauren J. O’Donnell,Yangming Ou,Yogesh Rathi,Shan H. Siddiqi,Haoqi Sun,M. Brandon Westover,Susan Whitfield-Gabrieli,Randy L. Gollub

DOI: https://doi.org/10.1007/s12021-022-09572-9

IF: 2.864

2022-03-28

Neuroinformatics

Abstract:Abstract This report presents an overview of how machine learning is rapidly advancing clinical translational imaging in ways that will aid in the early detection, prediction, and treatment of diseases that threaten brain health. Towards this goal, we aresharing the information presented at a symposium, “Neuroimaging Indicators of Brain Structure and Function - Closing the Gap Between Research and Clinical Application”, co-hosted by the McCance Center for Brain Health at Mass General Hospital and the MIT HST Neuroimaging Training Program on February 12, 2021. The symposium focused on the potential for machine learning approaches, applied to increasingly large-scale neuroimaging datasets, to transform healthcare delivery and change the trajectory of brain health by addressing brain care earlier in the lifespan. While not exhaustive, this overview uniquely addresses many of the technical challenges from image formation, to analysis and visualization, to synthesis and incorporation into the clinical workflow. Some of the ethical challenges inherent to this work are also explored, as are some of the regulatory requirements for implementation. We seek to educate, motivate, and inspire graduate students, postdoctoral fellows, and early career investigators to contribute to a future where neuroimaging meaningfully contributes to the maintenance of brain health.

neurosciences,computer science, interdisciplinary applications
Synergizing medical imaging and radiotherapy with deep learning

Hongming Shan,Xun Jia,Pingkun Yan,Yunyao Li,Harald Paganetti,Ge Wang

DOI: https://doi.org/10.1088/2632-2153/ab869f

2020-06-23

Machine Learning: Science and Technology

Abstract:This article reviews deep learning methods for medical imaging (focusing on image reconstruction, segmentation, registration, and radiomics) and radiotherapy (ranging from planning and verification to prediction) as well as the connections between them. Then, future topics are discussed involving semantic analysis through natural language processing and graph neural networks. It is believed that deep learning in particular, and artificial intelligence and machine learning in general, will have a revolutionary potential to advance and synergize medical imaging and radiotherapy for unprecedented smart precision healthcare.
Collaboration Analysis Using Deep Learning

Zhang Guo,Kevin Yu,Rebecca Pearlman,Nassir Navab,Roghayeh Barmaki

DOI: https://doi.org/10.48550/arXiv.1904.08066

2019-04-17

Abstract:The analysis of the collaborative learning process is one of the growing fields of education research, which has many different analytic solutions. In this paper, we provided a new solution to improve automated collaborative learning analyses using deep neural networks. Instead of using self-reported questionnaires, which are subject to bias and noise, we automatically extract group-working information by object recognition results using Mask R-CNN method. This process is based on detecting the people and other objects from pictures and video clips of the collaborative learning process, then evaluate the mobile learning performance using the collaborative indicators. We tested our approach to automatically evaluate the group-work collaboration in a controlled study of thirty-three dyads while performing an anatomy body painting intervention. The results indicate that our approach recognizes the differences of collaborations among teams of treatment and control groups in the case study. This work introduces new methods for automated quality prediction of collaborations among human-human interactions using computer vision techniques.

Human-Computer Interaction,Computer Vision and Pattern Recognition
Deep medical image analysis with representation learning and neuromorphic computing

N. Getty,T. Brettin,D. Jin,R. Stevens,F. Xia

DOI: https://doi.org/10.1098/rsfs.2019.0122

2020-12-11

Interface Focus

Abstract:Deep learning is increasingly used in medical imaging, improving many steps of the processing chain, from acquisition to segmentation and anomaly detection to outcome prediction. Yet significant challenges remain: (i) image-based diagnosis depends on the spatial relationships between local patterns, something convolution and pooling often do not capture adequately; (ii) data augmentation, the de facto method for learning three-dimensional pose invariance, requires exponentially many points to achieve robust improvement; (iii) labelled medical images are much less abundant than unlabelled ones, especially for heterogeneous pathological cases; and (iv) scanning technologies such as magnetic resonance imaging can be slow and costly, generally without online learning abilities to focus on regions of clinical interest. To address these challenges, novel algorithmic and hardware approaches are needed for deep learning to reach its full potential in medical imaging.
Collaborative Image Synthesis and Disease Diagnosis for Classification of Neurodegenerative Disorders with Incomplete Multi-modal Neuroimages

Yongsheng Pan,Yuanyuan Chen,Dinggang Shen,Yong Xia

DOI: https://doi.org/10.1007/978-3-030-87240-3_46

2021-01-01

Abstract:The missing data issue is a common problem in multi-modal neuroimage (e.g., MRI and PET) based diagnosis of neurodegenerative disorders. Although various generative adversarial networks (GANs) have been developed to impute the missing data, most current solutions treat the image imputation and disease diagnosis as two standalone tasks without considering the impact of diagnosis on image synthesis, leading to less competent synthetic images to the diagnosis task. In this paper, we propose the collaborative diagnosis-synthesis framework (CDSF) for joint missing neuroimage imputation and multi-modal diagnosis of neurodegenerative disorders. Under the CDSF framework, there is an image synthesis module (ISM) and a multi-modal diagnosis module (MDM), which are trained in a collaborative manner. Specifically, ISM is trained under the supervision of MDM, which poses the feature-consistent constraint to the cross-modality image synthesis, while MDM learns the disease-related multi-modal information from both real and synthetic multi-modal neuroimages. We evaluated our CDSF model against five image synthesis methods and three multi-modal diagnosis models on an ADNI datasets with 1464 subjects. Our results suggest that the proposed CDSF model not only generates neuroimages with higher quality, but also achieves the state-of-the-art performance in AD identification and MCI-to-AD conversion prediction.
Clinical Decision Support for Alzheimer's Disease Based on Deep Learning and Brain Network

Chenhui Hu,Ronghui Ju,Yusong Shen,Pan Zhou,Quanzheng Li

DOI: https://doi.org/10.1109/icc.2016.7510831

2016-01-01

Abstract:Modern e-health systems have undergone rapid development thanks to the advances in communications, computing and machine learning technology. Especially, deep learning has great superiority in image analysis and disease prediction. In this paper, we use Alzheimer's Disease (AD) as an example to show advantages of deep learning in diagnosing brain diseases and providing clinical decision support. Firstly, we convert raw functional magnetic resonance imaging (fMRI) to a matrix to represent activity of 90 brain regions. Secondly, to represent the functional connectivity between different brain regions, a correlation matrix is obtained by calculating the correlation between each pair of brain regions. In the next, a targeted autoencoder network is built to classify the correlation matrix, which is sensitive to AD. Finally, the experiment results show that our proposed method for AD prediction achieves much better effects than traditional means. It finds the correlations between different brain regions efficiently, provides strong reference for AD prediction. Compared to Support Vector Machine (SVM), about 25% improvement is gained in prediction accuracy. The e-health field becomes more complete and effective owing to that. Our work helps predict AD at an early stage and take measures to slow down or even prevent the onset of it.
Computational Pathology for Brain Disorders

Gabriel Jimenez,Daniel Racoceanu

DOI: https://doi.org/10.48550/arXiv.2301.07030

2023-01-13

Image and Video Processing

Abstract:Non-invasive brain imaging techniques allow understanding the behavior and macro changes in the brain to determine the progress of a disease. However, computational pathology provides a deeper understanding of brain disorders at cellular level, able to consolidate a diagnosis and make the bridge between the medical image and the omics analysis. In traditional histopathology, histology slides are visually inspected, under the microscope, by trained pathologists. This process is time-consuming and labor-intensive; therefore, the emergence of Computational Pathology has triggered great hope to ease this tedious task and make it more robust. This chapter focuses on understanding the state-of-the-art machine learning techniques used to analyze whole slide images within the context of brain disorders. We present a selective set of remarkable machine learning algorithms providing discriminative approaches and quality results on brain disorders. These methodologies are applied to different tasks, such as monitoring mechanisms contributing to disease progression and patient survival rates, analyzing morphological phenotypes for classification and quantitative assessment of disease, improving clinical care, diagnosing tumor specimens, and intraoperative interpretation. Thanks to the recent progress in machine learning algorithms for high-content image processing, computational pathology marks the rise of a new generation of medical discoveries and clinical protocols, including in brain disorders.
Adversarial Neural Networks in Medical Imaging Advancements and Challenges in Semantic Segmentation

Houze Liu,Bo Zhang,Yanlin Xiang,Yuxiang Hu,Aoran Shen,Yang Lin

2024-10-17

Abstract:Recent advancements in artificial intelligence (AI) have precipitated a paradigm shift in medical imaging, particularly revolutionizing the domain of brain imaging. This paper systematically investigates the integration of deep learning -- a principal branch of AI -- into the semantic segmentation of brain images. Semantic segmentation serves as an indispensable technique for the delineation of discrete anatomical structures and the identification of pathological markers, essential for the diagnosis of complex neurological disorders. Historically, the reliance on manual interpretation by radiologists, while noteworthy for its accuracy, is plagued by inherent subjectivity and inter-observer variability. This limitation becomes more pronounced with the exponential increase in imaging data, which traditional methods struggle to process efficiently and effectively. In response to these challenges, this study introduces the application of adversarial neural networks, a novel AI approach that not only automates but also refines the semantic segmentation process. By leveraging these advanced neural networks, our approach enhances the precision of diagnostic outputs, reducing human error and increasing the throughput of imaging data analysis. The paper provides a detailed discussion on how adversarial neural networks facilitate a more robust, objective, and scalable solution, thereby significantly improving diagnostic accuracies in neurological evaluations. This exploration highlights the transformative impact of AI on medical imaging, setting a new benchmark for future research and clinical practice in neurology.

Image and Video Processing,Computer Vision and Pattern Recognition
Editorial: New challenges and future perspectives in brain imaging methods

Dahua Yu,Kai-Hsiang Chuang,Nico Sollmann

DOI: https://doi.org/10.3389/fnins.2023.1265054

IF: 4.3

2023-01-01

Frontiers in Neuroscience

Abstract:EDITORIAL article Front. Neurosci., 01 November 2023Sec. Brain Imaging Methods Volume 17 - 2023 | https://doi.org/10.3389/fnins.2023.1265054
Editorial overview: Computational neuroscience as a bridge between artificial intelligence, modeling and data

Pietro Verzelli,Tatjana Tchumatchenko,Jeanette Hellgren Kotaleski

DOI: https://doi.org/10.1016/j.conb.2023.102835

IF: 7.07

2024-01-06

Current Opinion in Neurobiology

Abstract:Computational neuroscience continues to be a broad and dynamic discipline that transforms itself as new experimental methods make the collection of new, often multi-modal data types possible. Initially, the focus was on models of single neurons, their ion channels, the statistics of their spikes, and their processing of inputs. New multiunit recording techniques that were possible first in vitro and then gradually in vivo allowed the field to expand into the question of how populations of neurons form circuits that represent sensory stimuli or motor output. Addressing these questions revealed many mathematically and conceptually challenging directions, such as low-dimensional manifolds, their synthesis, and representational meaning. Questions about neural synchrony, phase locking, neural attractors, and their relation to learning, memory, and sleep entered the stage. In the next decades, increased automatization of connectomics studies in organisms such as flies and mice allowed the correlation of the observed activity with the probing of the underlying connectivity. Therefore, neural activity could now, for the first time, be combined with the circuit structure that generated it, enabling detailed insights into the role of cell types in generating specific aspects of neural population activity. New machine-learning methods now enable tracking and segmenting behavior into smaller units while recording neural activity. These methods are complemented by advances in cell profiling and detailed molecular characterization of neural activity and structure, such as quantitative bridges between molecules and behavior, which can be unraveled for the first time. This is an exciting time to be a computational neuroscientist for multiple reasons. First, emerging datasets that cover multiple neural and behavioral levels are emerging and demand new computational approaches. Artificial neural networks can now enable online behavioral segmentation across species and behavioral tasks, but identifying the equivalent of a "grammar" that tells how to use a specific neural activity pattern in a specific region toward the construction of a behavioral trajectory in space is still a challenge. Also, at the level of cellular and molecular mechanisms, new proteomics and connectomics data sets allow unprecedented insights into the learning mechanisms at the single synapse or dendritic branch level, but translating these insights into learning rules in artificial neural networks or revealing their functional correlates in brain circuits remains a fundamental challenge. In this issue, computational neuroscientists, whose diverse expertise ranges from molecular interactions to behavioral characterization, share their perspectives on our current knowledge and future challenges and highlight recent breakthroughs. These reviews can be seen as covering five broad areas: 1) machine learning for neuroscience; 2) neurosciences for machine learning; 3) neural computation; 4) computational models; and 5) data analysis methods. Below, we try to map the different contributions to these categories, although several of the reviews fit in more than one.

neurosciences
Exploration of Imaging Genetic Biomarkers of Alzheimer's Disease Based on a Machine Learning Method

Yuanfei Wang,Xitao Wang

DOI: https://doi.org/10.31083/j.jin2304081

2024-04-17

Abstract:Background: Alzheimer's disease (AD) is an irreversible primary brain disease with insidious onset. The rise of imaging genetics research has led numerous researchers to examine the complex association between genes and brain phenotypes from the perspective of computational biology. Methods: Given that most previous studies have assumed that imaging data and genetic data are linearly related and are therefore unable to explore their nonlinear relationship, our study applied a joint depth semi-supervised nonnegative matrix decomposition (JDSNMF) algorithm to solve this problem. The JDSNMF algorithm jointly decomposed multimodal imaging genetics data into both a standard basis matrix and multiple feature matrices. During the decomposition process, the coefficient matrix A multilayer nonlinear transformation was performed using a neural network to capture nonlinear features. Results: The results using a real dataset demonstrated that the algorithm can fully exploit the association between strongly correlated image genetics data and effectively detect biomarkers of AD. Our results might provide a reference for identifying biologically significant imaging genetic correlations, and help to elucidate disease-related mechanisms. Conclusions: The diagnostic model constructed by the top features of the three modality data sets mined by the algorithm has high accuracy, and these features are expected to become new therapeutic targets for AD.
Towards Computational Analytics of 3D Neuron Images Using Deep Adversarial Learning

Zhongyu Li,Xiayue Fan,Zengyi Shang,Lina Zhang,Haotian Zhen,Chaowei Fang

DOI: https://doi.org/10.1016/j.neucom.2020.03.129

IF: 6

2021-01-01

Neurocomputing

Abstract:Benefited from advances of neuron tracing techniques, the ever-increasing number of digitally reconstructed 3D neuron images have greatly facilitated the research in neuromorphology. However, the sheer volume and the complexity of these 3D neuron data pose significant challenges for computational analytics, e.g., effectively finding neurons sharing similar morphologies, identifying neuron types, correlating neuron morphologies with properties, all of which require accurate measuring and fast indexing methods especially designed for the massive 3D neuronal images. In this paper, we present an accurate and efficient framework for the computational analytics of 3D neuronal structures based on advances of deep learning and data mining techniques. Particularly, unlike previous methods quantitatively describe neurons by measuring pre-defined metrics according to the tree-topological structures, we first develop a new method for the morphological feature representation by a proposed 3D neuron mapping and a modified generative adversarial networks (GANs). Subsequently, considering the computational complexity when retrieving large-scale neuron datasets, we integrate the neuron features with graph-based indexing, which can significantly improve the retrieval efficiency without losing accuracy. Experimental results show that our framework can effectively measure the similarity among massive neurons (e.g., 100,000 neurons), outperforming state-of-the-arts with more than 10% in accuracy and hundreds of times in efficiency improvements.
Guided interactive image segmentation using machine learning and color-based image set clustering

Adrian Friebel,Tim Johann,Dirk Drasdo,Stefan Hoehme

DOI: https://doi.org/10.1093/bioinformatics/btac547

IF: 5.8

2022-09-30

Bioinformatics

Abstract:Motivation: Over the last decades, image processing and analysis have become one of the key technologies in systems biology and medicine. The quantification of anatomical structures and dynamic processes in living systems is essential for understanding the complex underlying mechanisms and allows, i.e. the construction of spatio-temporal models that illuminate the interplay between architecture and function. Recently, deep learning significantly improved the performance of traditional image analysis in cases where imaging techniques provide large amounts of data. However, if only a few images are available or qualified annotations are expensive to produce, the applicability of deep learning is still limited. Results: We present a novel approach that combines machine learning-based interactive image segmentation using supervoxels with a clustering method for the automated identification of similarly colored images in large image sets which enables a guided reuse of interactively trained classifiers. Our approach solves the problem of deteriorated segmentation and quantification accuracy when reusing trained classifiers which is due to significant color variability prevalent and often unavoidable in biological and medical images. This increase in efficiency improves the suitability of interactive segmentation for larger image sets, enabling efficient quantification or the rapid generation of training data for deep learning with minimal effort. The presented methods are applicable for almost any image type and represent a useful tool for image analysis tasks in general. Availability and implementation: The presented methods are implemented in our image processing software TiQuant which is freely available at tiquant.hoehme.com. Supplementary information: Supplementary data are available at Bioinformatics online.
Collaborative augmented reconstruction of 3D neuron morphology in mouse and human brains

Lingli Zhang,Lei Huang,Zexin Yuan,Yuning Hang,Ying Zeng,Kaixiang Li,Lijun Wang,Haoyu Zeng,Xin Chen,Hairuo Zhang,Jiaqi Xi,Danni Chen,Ziqin Gao,Longxin Le,Jie Chen,Wen Ye,Lijuan Liu,Yimin Wang,Hanchuan Peng

DOI: https://doi.org/10.1038/s41592-024-02401-8

2024-09-04

Abstract:Digital reconstruction of the intricate 3D morphology of individual neurons from microscopic images is a crucial challenge in both individual laboratories and large-scale projects focusing on cell types and brain anatomy. This task often fails in both conventional manual reconstruction and state-of-the-art artificial intelligence (AI)-based automatic reconstruction algorithms. It is also challenging to organize multiple neuroanatomists to generate and cross-validate biologically relevant and mutually agreed upon reconstructions in large-scale data production. Based on collaborative group intelligence augmented by AI, we developed a collaborative augmented reconstruction (CAR) platform for neuron reconstruction at scale. This platform allows for immersive interaction and efficient collaborative editing of neuron anatomy using a variety of devices, such as desktop workstations, virtual reality headsets and mobile phones, enabling users to contribute anytime and anywhere and to take advantage of several AI-based automation tools. We tested CAR's applicability for challenging mouse and human neurons toward scaled and faithful data production.
Motivation for using data-driven algorithms in research: A review of machine learning solutions for image analysis of micrographs in neuroscience

Frederic Thiele,Anthony J Windebank,Ahad M Siddiqui

DOI: https://doi.org/10.1093/jnen/nlad040

2023-05-27

Journal of Neuropathology & Experimental Neurology

Abstract:Abstract Machine learning is a powerful tool that is increasingly being used in many research areas, including neuroscience. The recent development of new algorithms and network architectures, especially in the field of deep learning, has made machine learning models more reliable and accurate and useful for the biomedical research sector. By minimizing the effort necessary to extract valuable features from datasets, they can be used to find trends in data automatically and make predictions about future data, thereby improving the reproducibility and efficiency of research. One application is the automatic evaluation of micrograph images, which is of great value in neuroscience research. While the development of novel models has enabled numerous new research applications, the barrier to use these new algorithms has also decreased by the integration of deep learning models into known applications such as microscopy image viewers. For researchers unfamiliar with machine learning algorithms, the steep learning curve can hinder the successful implementation of these methods into their workflows. This review explores the use of machine learning in neuroscience, including its potential applications and limitations, and provides some guidance on how to select a fitting framework to use in real-life research projects.

pathology,neurosciences,clinical neurology
A collaborative brain-computer interface for accelerating human decision making

Peng Yuan,Yijun Wang,Xiaorong Gao,Tzyy-Ping Jung,Shangkai Gao

DOI: https://doi.org/10.1007/978-3-642-39188-0_72

2013-01-01

Abstract:Recently, collective intelligence has been introduced to brain-computer interface (BCI) research, leading to the emergence of collaborative BCI. This study presents an online collaborative BCI for improving individuals' decision making in a visual Go/NoGo task. Six groups of six people participated in the experiment comprising both offline and online sessions. The offline results suggested that the collaborative BCI has the potential to improve individuals' decisions in various decision-making situations. The online tests showed that using Electroencephalogram (EEG) within the first 360 ms after the stimulus onset, which was 50 ms earlier than the mean behavioral response time (RT) (409±85 ms), the collaborative BCI reached a mean classification accuracy of 78.0±2.6% across all groups. It was 12.9% higher than the average individual accuracy (65.1±8.1%, p−4). This study suggested that a collaborative BCI could accelerate human decision making with reliable prediction accuracy in real time.
NeuroCrypt: Machine Learning Over Encrypted Distributed Neuroimaging Data

Nipuna Senanayake,Robert Podschwadt,Daniel Takabi,Vince D Calhoun,Sergey M Plis

DOI: https://doi.org/10.1007/s12021-021-09525-8

IF: 2.864

Neuroinformatics

Abstract:The field of neuroimaging can greatly benefit from building machine learning models to detect and predict diseases, and discover novel biomarkers, but much of the data collected at various organizations and research centers is unable to be shared due to privacy or regulatory concerns (especially for clinical data or rare disorders). In addition, aggregating data across multiple large studies results in a huge amount of duplicated technical debt and the resources required can be challenging or impossible for an individual site to build. Training on the data distributed across organizations can result in models that generalize much better than models trained on data from any of organizations alone. While there are approaches for decentralized sharing, these often do not provide the highest possible guarantees of sample privacy that only cryptography can provide. In addition, such approaches are often focused on probabilistic solutions. In this paper, we propose an approach that leverages the potential of datasets spread among a number of data collecting organizations by performing joint analyses in a secure and deterministic manner when only encrypted data is shared and manipulated. The approach is based on secure multiparty computation which refers to cryptographic protocols that enable distributed computation of a function over distributed inputs without revealing additional information about the inputs. It enables multiple organizations to train machine learning models on their joint data and apply the trained models to encrypted data without revealing their sensitive data to the other parties. In our proposed approach, organizations (or sites) securely collaborate to build a machine learning model as it would have been trained on the aggregated data of all the organizations combined. Importantly, the approach does not require a trusted party (i.e. aggregator), each contributing site plays an equal role in the process, and no site can learn individual data of any other site. We demonstrate effectiveness of the proposed approach, in a range of empirical evaluations using different machine learning algorithms including logistic regression and convolutional neural network models on human structural and functional magnetic resonance imaging datasets.

Advances in machine learning methods facilitating collaborative image-based decision making for neuroscience

Editorial: Innovative applications with artificial intelligence methods in neuroimaging data analysis.

Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data

Editorial: Improving Diagnosis, Treatment, and Prognosis of Neuropsychiatric Disorders by Leveraging Neuroimaging-based Machine Learning

How Machine Learning is Powering Neuroimaging to Improve Brain Health

Synergizing medical imaging and radiotherapy with deep learning

Collaboration Analysis Using Deep Learning

Deep medical image analysis with representation learning and neuromorphic computing

Collaborative Image Synthesis and Disease Diagnosis for Classification of Neurodegenerative Disorders with Incomplete Multi-modal Neuroimages

Clinical Decision Support for Alzheimer's Disease Based on Deep Learning and Brain Network

Computational Pathology for Brain Disorders

Adversarial Neural Networks in Medical Imaging Advancements and Challenges in Semantic Segmentation

Editorial: New challenges and future perspectives in brain imaging methods

Editorial overview: Computational neuroscience as a bridge between artificial intelligence, modeling and data

Exploration of Imaging Genetic Biomarkers of Alzheimer's Disease Based on a Machine Learning Method

Towards Computational Analytics of 3D Neuron Images Using Deep Adversarial Learning

Guided interactive image segmentation using machine learning and color-based image set clustering

Collaborative augmented reconstruction of 3D neuron morphology in mouse and human brains

Motivation for using data-driven algorithms in research: A review of machine learning solutions for image analysis of micrographs in neuroscience

A collaborative brain-computer interface for accelerating human decision making

NeuroCrypt: Machine Learning Over Encrypted Distributed Neuroimaging Data