7,12-Dimethylbenz[a]anthracene-DNA adduct formation in Wistar rat and Syrian hamster embryo cell cultures.

S. Sebti,T. Smolarek,C. P. Salmon,W. Baird

DOI: https://doi.org/10.1016/0009-2797(85)90035-3

IF: 5.168

1985-12-17

Chemico-Biological Interactions

Abstract:

What problem does this paper attempt to address?

Mutual Information-Based Graph Co-Attention Networks for Multimodal Prior-Guided Magnetic Resonance Imaging Segmentation

Shaocong Mo,Ming Cai,Lanfen Lin,Ruofeng Tong,Qingqing Chen,Fang Wang,Hongjie Hu,Yutaro Iwamoto,Xian-Hua Han,Yen-Wei Chen

DOI: https://doi.org/10.1109/tcsvt.2021.3112551

IF: 5.859

2022-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Multimodal magnetic resonance imaging (MRI) provides complementary information about targets, and the segmentation of multimodal MRI is widely used as an essential preprocessing step for initial diagnosis, stage differentiation, and post-treatment efficacy evaluation in clinical situations. For the main modality or each of the modalities, it is important to enhance the visual information by modeling the connection and effectively fusing the features among them. However, the existing methods for multimodal segmentation have a drawback; they coincidentally drop information of individual modality during the fusion process. Recently, graph learning-based methods have been applied in segmentation, and these methods have achieved considerable improvements by modeling the relationships across feature regions and reasoning using global information. In this paper, we propose a graph learning-based approach to efficiently extract modality-specific features and establish regional correspondence effectively among all modalities. In detail, after projecting features into a graph domain and employing graph convolution to propagate information across all regions for learning global modality-specific features, we propose a mutual information-based graph co-attention module to learn the weight coefficients of one bipartite graph constructed by the fully connected graphs having different modalities in the graph domain and by selectively fusing the node features. Based on the deformation diagram between the spatial-graph space and our proposed graph co-attention module, we present a multimodal prior-guided segmentation framework, which uses two strategies for two clinical situations: Modality-Specific Learning Strategy and Co-Modality Learning Strategy. Besides, the improved Co-Modality Learning Strategy is used with trainable weights in the multi-task loss for the optimization of the proposed framework. We validated our proposed modules and frameworks on two multimodal MRI datasets: our private liver lesion dataset and a public prostate zone dataset. Our experimental results on both datasets prove the superiority of our proposed approaches.
MULTI-MODAL DATA FUSION SCHEMES FOR INTEGRATED CLASSIFICATION OF IMAGING AND NON-IMAGING BIOMEDICAL DATA

Pallavi Tiwari,Satish Viswanath,George Lee,Anant Madabhushi

DOI: https://doi.org/10.1109/ISBI.2011.5872379

Abstract:With a wide array of multi-modal, multi-protocol, and multi-scale biomedical data available for disease diagnosis and prognosis, there is a need for quantitative tools to combine such varied channels of information, especially imaging and non-imaging data (e.g. spectroscopy, proteomics). The major problem in such quantitative data integration lies in reconciling the large spread in the range of dimensionalities and scales across the different modalities. The primary goal of quantitative data integration is to build combined meta-classifiers; however these efforts are thwarted by challenges in (1) homogeneous representation of the data channels, (2) fusing the attributes to construct an integrated feature vector, and (3) the choice of learning strategy for training the integrated classifier. In this paper, we seek to (a) define the characteristics that guide the 4 independent methods for quantitative data fusion that use the idea of a meta-space for building integrated multi-modal, multi-scale meta-classifiers, and (b) attempt to understand the key components which allowed each method to succeed. These methods include (1) Generalized Embedding Concatenation (GEC), (2) Consensus Embedding (CE), (3) Semi-Supervised Multi-Kernel Graph Embedding (SeSMiK), and (4) Boosted Embedding Combination (BEC). In order to evaluate the optimal scheme for fusing imaging and non-imaging data, we compared these 4 schemes for the problems of combining (a) multi-parametric MRI with spectroscopy for prostate cancer (CaP) diagnosis in vivo, and (b) histological image with proteomic signatures (obtained via mass spectrometry) for predicting prognosis in CaP patients. The kernel combination approach (SeSMiK) marginally outperformed the embedding combination schemes. Additionally, intelligent weighting of the data channels (based on their relative importance) appeared to outperform unweighted strategies. All 4 strategies easily outperformed a naïve decision fusion approach, suggesting that data integration methods will play an important role in the rapidly emerging field of integrated diagnostics and personalized healthcare.
Mutually communicated model based on multi‐parametric MRI for automated segmentation and classification of prostate cancer

Kewen Liu,Piqiang Li,Martins Otikovs,Xinzhou Ning,Liyang Xia,Xiangyu Wang,Lian Yang,Feng Pan,Zhi Zhang,Guangyao Wu,Han Xie,Qingjia Bao,Xin Zhou,Chaoyang Liu

DOI: https://doi.org/10.1002/mp.16343

IF: 4.506

2023-03-12

Medical Physics

Abstract:BackGroud Multiparametric magnetic resonance imaging (mp‐MRI) is introduced and established as a noninvasive alternative for Prostate cancer (Pca) detection and characterization. Purpose To develop and evaluate a mutually communicated deep learning segmentation and classification network (MC‐DSCN) based on mp‐MRI for prostate segmentation and prostate cancer (PCa) diagnosis. Methods The proposed MC‐DSCN can transfer mutual information between segmentation and classification components and facilitate each other in a bootstrapping way. For classification task, the MC‐DSCN can transfer the masks produced by the coarse segmentation component to the classification component to exclude irrelevant regions and facilitate classification. For segmentation task, this model can transfer the high‐quality localization information learned by the classification component to the fine segmentation component to mitigate the impact of inaccurate localization on segmentation results. Consecutive MRI exams of patients were retrospectively collected from two medical centers (referred to as center A and B) . Two experienced radiologists segmented the prostate regions, and the ground truth of the classification refers to the prostate biopsy results. MC‐DSCN was designed, trained, and validated using different combinations of distinct MRI sequences as input (e.g., T2‐weighted and apparent diffusion coefficient) and the effect of different architectures on the network's performance was tested and discussed. Data from center A was used for training, validation, and internal testing, while another center's data was used for external testing. The statistical analysis is performed to evaluate the performance of the MC‐DSCN. The DeLong test and paired t‐test were used to assess the performance of classification and segmentation, respectively. Results In total, 134 patients were included. The proposed MC‐DSCN outperforms the networks that were designed solely for segmentation or classification. Regarding the segmentation task, the classification localization information helped to improve the IOU in center A: from 84.5% to 87.8% (p < 0.01) and in center B: from 83.8% to 87.1% (p < 0.01), while the AUC of PCa classification was improved in center A: from 0.946 to 0.991 (p < 0.02) and in center B: from 0.926 to 0.955 (p < 0.01) as a result of the additional information provided by the prostate segmentation. Conclusion The proposed architecture could effectively transfer mutual information between segmentation and classification components and facilitate each other in a bootstrapping way, thus outperforming the networks designed to perform only one task. This article is protected by copyright. All rights reserved

radiology, nuclear medicine & medical imaging
Modality-Specific Information Disentanglement from Multi-parametric MRI for Breast Tumor Segmentation and Computer-aided Diagnosis

Qianqian Chen,Jiadong Zhang,Runqi Meng,Lei Zhou,Zhenhui Li,Qianjin Feng,Dinggang Shen

DOI: https://doi.org/10.1109/tmi.2024.3352648

IF: 10.6

2024-01-01

IEEE Transactions on Medical Imaging

Abstract:Breast cancer is becoming a significant global health challenge, with millions of fatalities annually. Magnetic Resonance Imaging (MRI) can provide various sequences for characterizing tumor morphology and internal patterns, and becomes an effective tool for detection and diagnosis of breast tumors. However, previous deep-learning based tumor segmentation methods from multi-parametric MRI still have limitations in exploring inter-modality information and focusing task-informative modality/modalities. To address these shortcomings, we propose a Modality-Specific Information Disentanglement (MoSID) framework to extract both inter- and intra-modality attention maps as prior knowledge for guiding tumor segmentation. Specifically, by disentangling modality-specific information, the MoSID framework provides complementary clues for the segmentation task, by generating modality-specific attention maps to guide modality selection and inter-modality evaluation. Our experiments on two 3D breast datasets and one 2D prostate dataset demonstrate that the MoSID framework outperforms other state-of-the-art multi-modality segmentation methods, even in the cases of missing modalities. Based on the segmented lesions, we further train a classifier to predict the patients' response to radiotherapy. The prediction accuracy is comparable to the case of using manually-segmented tumors for treatment outcome prediction, indicating the robustness and effectiveness of the proposed segmentation method. The code is available at https://github.com/Qianqian-Chen/MoSID.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Exploring the efficacy of multi-flavored feature extraction with radiomics and deep features for prostate cancer grading on mpMRI

Hasan Khanfari,Saeed Mehranfar,Mohsen Cheki,Mahmoud Mohammadi Sadr,Samir Moniri,Sahel Heydarheydari,Seyed Masoud Rezaeijo

DOI: https://doi.org/10.1186/s12880-023-01140-0

IF: 2.7949

2023-11-22

BMC Medical Imaging

Abstract:Abstract Background The purpose of this study is to investigate the use of radiomics and deep features obtained from multiparametric magnetic resonance imaging (mpMRI) for grading prostate cancer. We propose a novel approach called multi-flavored feature extraction or tensor, which combines four mpMRI images using eight different fusion techniques to create 52 images or datasets for each patient. We evaluate the effectiveness of this approach in grading prostate cancer and compare it to traditional methods. Methods We used the PROSTATEx-2 dataset consisting of 111 patients’ images from T2W-transverse, T2W-sagittal, DWI, and ADC images. We used eight fusion techniques to merge T2W, DWI, and ADC images, namely Laplacian Pyramid, Ratio of the low-pass pyramid, Discrete Wavelet Transform, Dual-Tree Complex Wavelet Transform, Curvelet Transform, Wavelet Fusion, Weighted Fusion, and Principal Component Analysis. Prostate cancer images were manually segmented, and radiomics features were extracted using the Pyradiomics library in Python. We also used an Autoencoder for deep feature extraction. We used five different feature sets to train the classifiers: all radiomics features, all deep features, radiomics features linked with PCA, deep features linked with PCA, and a combination of radiomics and deep features. We processed the data, including balancing, standardization, PCA, correlation, and Least Absolute Shrinkage and Selection Operator (LASSO) regression. Finally, we used nine classifiers to classify different Gleason grades. Results Our results show that the SVM classifier with deep features linked with PCA achieved the most promising results, with an AUC of 0.94 and a balanced accuracy of 0.79. Logistic regression performed best when using only the deep features, with an AUC of 0.93 and balanced accuracy of 0.76. Gaussian Naive Bayes had lower performance compared to other classifiers, while KNN achieved high performance using deep features linked with PCA. Random Forest performed well with the combination of deep features and radiomics features, achieving an AUC of 0.94 and balanced accuracy of 0.76. The Voting classifiers showed higher performance when using only the deep features, with Voting 2 achieving the highest performance, with an AUC of 0.95 and balanced accuracy of 0.78. Conclusion Our study concludes that the proposed multi-flavored feature extraction or tensor approach using radiomics and deep features can be an effective method for grading prostate cancer. Our findings suggest that deep features may be more effective than radiomics features alone in accurately classifying prostate cancer.

radiology, nuclear medicine & medical imaging
Identifying pathological groups from MRI in prostate cancer using graph representation learning

Feng Liu,Yuanshen Zhao,Chongzhe Yan,Jingxian Duan,Lei Tang,Bo Gao,Rongpin Wang

DOI: https://doi.org/10.1016/j.displa.2024.102699

IF: 3.074

2024-03-28

Displays

Abstract:Multiparametric magnetic resonance imaging (mpMRI) plays a critical role in prostate cancer (PCa) diagnosis, aiding in clinical trial evaluation and personalized treatment planning. We propose a novel prediction approach based on graph representation learning (GRL) integrating mpMRI images for classifying International Society of Urological Pathology (ISUP) grade groups. We initially constructed a mpMRI image graph representation learning (MMIGRL) model using a graph-based representation fusion approach. After constructing a heterogeneous graph integrating T2-weighted and apparent diffusion coefficient (ADC) images, we applied an adaptive method that dynamically adjusted the edges within the graph to reveal relationships within the mpMRI images. Subsequently, we developed a residual graph convolution network (Res-GCN) model to establish the mapping relationship between the mpMRI fusion graph and ISUP grade groups. The results of 5-fold cross-validation demonstrated excellent overall performance, and the prediction results using independent testing datasets confirmed the model's generalizability. The results of ablation studies highlighted the positive impact of integrating T2-weighted and ADC images and the effectiveness of residual connections in learning hierarchical features within the graph structure. The results of comparative experiments validated the superiority of the proposed MMIGRL model compared with convolutional neural network (CNN) and vision transformer (ViT) models. This approach holds promise for accurate ISUP grade group classification in PCa diagnosis, contributing to improved patient care and clinical decision making.

engineering, electrical & electronic,instruments & instrumentation,optics,computer science, hardware & architecture
Deep Attentive Panoptic Model for Prostate Cancer Detection Using Biparametric MRI Scans

Xin Yu,Bin Lou,Donghao Zhang,David Winkel,Nacim Arrahmane,Mamadou Diallo,Tongbai Meng,Heinrich von Busch,Robert Grimm,Berthold Kiefer,Dorin Comaniciu,Ali Kamen

DOI: https://doi.org/10.1007/978-3-030-59719-1_58

2020-01-01

Abstract:Multi-parametric MRI (mp-MRI) has recently been established in major guidelines as a first-line diagnostic test for men suspected of having prostate cancer (PCa) primarily to detect and classify clinically significant lesions. However, widespread utilization is still challenged by 1) the difficulty of interpretation specifically for radiologists less experienced in reading mp-MRI scans, and 2) decreased productivity associated with increased time spent per case for reading these complex scans. Deep learning based lesion detection and segmentation methods have been proposed for radiologists to perform their tasks more accurately and efficiently. In this work, we present a novel panoptic lesion detection and segmentation method with both semantic and instance branches as well as an attention module to optimally incorporate both local and global image features. In a free-response receiver operating characteristics (FROC) analysis for lesion sensitivity on an independent dataset with 243 patients, our method has achieved 89% sensitivity and 85% with 0.94 and 0.62 false positives per patient, respectively. Using the proposed method, we have achieved an unprecedented area under ROC curve (AUC) of 0.897 in identifying clinically significant cases.
Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks

Minh Hung Le,Jingyu Chen,Liang Wang,Zhiwei Wang,Wenyu Liu,Kwang-Ting Cheng,Xin Yang,Kwang-Ting (Tim) Cheng

DOI: https://doi.org/10.1088/1361-6560/aa7731

IF: 3.5

2017-07-24

Physics in Medicine and Biology

Abstract:Automated methods for prostate cancer (PCa) diagnosis in multi-parametric magnetic resonance imaging (MP-MRIs) are critical for alleviating requirements for interpretation of radiographs while helping to improve diagnostic accuracy (Artan et al 2010 IEEE Trans. Image Process. 19 2444-55, Litjens et al 2014 IEEE Trans. Med. Imaging 33 1083-92, Liu et al 2013 SPIE Medical Imaging (International Society for Optics and Photonics) p 86701G, Moradi et al 2012 J. Magn. Reson. Imaging 35 1403-13, Niaf et al 2014 IEEE Trans. Image Process. 23 979-91, Niaf et al 2012 Phys. Med. Biol. 57 3833, Peng et al 2013a SPIE Medical Imaging (International Society for Optics and Photonics) p 86701H, Peng et al 2013b Radiology 267 787-96, Wang et al 2014 BioMed. Res. Int. 2014). This paper presents an automated method based on multimodal convolutional neural networks (CNNs) for two PCa diagnostic tasks: (1) distinguishing between cancerous and noncancerous tissues and (2) distinguishing between clinically significant (CS) and indolent PCa. Specifically, our multimodal CNNs effectively fuse apparent diffusion coefficients (ADCs) and T2-weighted MP-MRI images (T2WIs). To effectively fuse ADCs and T2WIs we design a new similarity loss function to enforce consistent features being extracted from both ADCs and T2WIs. The similarity loss is combined with the conventional classification loss functions and integrated into the back-propagation procedure of CNN training. The similarity loss enables better fusion results than existing methods as the feature learning processes of both modalities are mutually guided, jointly facilitating CNN to 'see' the true visual patterns of PCa. The classification results of multimodal CNNs are further combined with the results based on handcrafted features using a support vector machine classifier. To achieve a satisfactory accuracy for clinical use, we comprehensively investigate three critical factors which could greatly affect the performance of our multimodal CNNs but have not been carefully studied previously. (1) Given limited training data, how can these be augmented in sufficient numbers and variety for fine-tuning deep CNN networks for PCa diagnosis? (2) How can multimodal MP-MRI information be effectively combined in CNNs? (3) What is the impact of different CNN architectures on the accuracy of PCa diagnosis? Experimental results on extensive clinical data from 364 patients with a total of 463 PCa lesions and 450 identified noncancerous image patches demonstrate that our system can achieve a sensitivity of 89.85% and a specificity of 95.83% for distinguishing cancer from noncancerous tissues and a sensitivity of 100% and a specificity of 76.92% for distinguishing indolent PCa from CS PCa. This result is significantly superior to the state-of-the-art method relying on handcrafted features.

engineering, biomedical,radiology, nuclear medicine & medical imaging
A graph-based approach for the retrieval of multi-modality medical images

Ashnil Kumar,Jinman Kim,Lingfeng Wen,Michael Fulham,Dagan Feng

DOI: https://doi.org/10.1016/j.media.2013.11.003

IF: 10.9

2014-02-01

Medical Image Analysis

Abstract:In this paper, we address the retrieval of multi-modality medical volumes, which consist of two different imaging modalities, acquired sequentially, from the same scanner. One such example, positron emission tomography and computed tomography (PET-CT), provides physicians with complementary functional and anatomical features as well as spatial relationships and has led to improved cancer diagnosis, localisation, and staging. The challenge of multi-modality volume retrieval for cancer patients lies in representing the complementary geometric and topologic attributes between tumours and organs. These attributes and relationships, which are used for tumour staging and classification, can be formulated as a graph. It has been demonstrated that graph-based methods have high accuracy for retrieval by spatial similarity. However, naïvely representing all relationships on a complete graph obscures the structure of the tumour-anatomy relationships. We propose a new graph structure derived from complete graphs that structurally constrains the edges connected to tumour vertices based upon the spatial proximity of tumours and organs. This enables retrieval on the basis of tumour localisation. We also present a similarity matching algorithm that accounts for different feature sets for graph elements from different imaging modalities. Our method emphasises the relationships between a tumour and related organs, while still modelling patient-specific anatomical variations. Constraining tumours to related anatomical structures improves the discrimination potential of graphs, making it easier to retrieve similar images based on tumour location. We evaluated our retrieval methodology on a dataset of clinical PET-CT volumes. Our results showed that our method enabled the retrieval of multi-modality images using spatial features. Our graph-based retrieval algorithm achieved a higher precision than several other retrieval techniques: gray-level histograms as well as state-of-the-art methods such as visual words using the scale- invariant feature transform (SIFT) and relational matrices representing the spatial arrangements of objects.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Preanalytical variables in coagulation testing.

E. Favaloro

DOI: https://doi.org/10.1097/MBC.0B013E3280116C73

Abstract:
Multi-scale statistical deformation based co-registration of prostate MRI and post-surgical whole mount histopathology

Lin Li,Rakesh Shiradkar,Noah Gottlieb,Christina Buzzy,Amogh Hiremath,Vidya Sankar Viswanathan,Gregory T MacLennan,Danly Omil Lima,Karishma Gupta,Daniel Lee Shen,Sree Harsha Tirumani,Cristina Magi-Galluzzi,Andrei Purysko,Anant Madabhushi

DOI: https://doi.org/10.1002/mp.16753

Abstract:Background: Accurate delineations of regions of interest (ROIs) on multi-parametric magnetic resonance imaging (mpMRI) are crucial for development of automated, machine learning-based prostate cancer (PCa) detection and segmentation models. However, manual ROI delineations are labor-intensive and susceptible to inter-reader variability. Histopathology images from radical prostatectomy (RP) represent the "gold standard" in terms of the delineation of disease extents, for example, PCa, prostatitis, and benign prostatic hyperplasia (BPH). Co-registering digitized histopathology images onto pre-operative mpMRI enables automated mapping of the ground truth disease extents onto mpMRI, thus enabling the development of machine learning tools for PCa detection and risk stratification. Still, MRI-histopathology co-registration is challenging due to various artifacts and large deformation between in vivo MRI and ex vivo whole-mount histopathology images (WMHs). Furthermore, the artifacts on WMHs, such as tissue loss, may introduce unrealistic deformation during co-registration. Purpose: This study presents a new registration pipeline, MSERgSDM, a multi-scale feature-based registration (MSERg) with a statistical deformation (SDM) constraint, which aims to improve accuracy of MRI-histopathology co-registration. Methods: In this study, we collected 85 pairs of MRI and WMHs from 48 patients across three cohorts. Cohort 1 (D1), comprised of a unique set of 3D printed mold data from six patients, facilitated the generation of ground truth deformations between ex vivo WMHs and in vivo MRI. The other two clinically acquired cohorts (D2 and D3) included 42 patients. Affine and nonrigid registrations were employed to minimize the deformation between ex vivo WMH and ex vivo T2-weighted MRI (T2WI) in D1. Subsequently, ground truth deformation between in vivo T2WI and ex vivo WMH was approximated as the deformation between in vivo T2WI and ex vivo T2WI. In D2 and D3, the prostate anatomical annotations, for example, tumor and urethra, were made by a pathologist and a radiologist in collaboration. These annotations included ROI boundary contours and landmark points. Before applying the registration, manual corrections were made for flipping and rotation of WMHs. MSERgSDM comprises two main components: (1) multi-scale representation construction, and (2) SDM construction. For the SDM construction, we collected N = 200 reasonable deformation fields generated using MSERg, verified through visual inspection. Three additional methods, including intensity-based registration, ProsRegNet, and MSERg, were also employed for comparison against MSERgSDM. Results: Our results suggest that MSERgSDM performed comparably to the ground truth (p > 0.05). Additionally, MSERgSDM (ROI Dice ratio = 0.61, landmark distance = 3.26 mm) exhibited significant improvement over MSERg (ROI Dice ratio = 0.59, landmark distance = 3.69 mm) and ProsRegNet (ROI Dice ratio = 0.56, landmark distance = 4.00 mm) in local alignment. Conclusions: This study presents a novel registration method, MSERgSDM, for mapping ex vivo WMH onto in vivo prostate MRI. Our preliminary results demonstrate that MSERgSDM can serve as a valuable tool to map ground truth disease annotations from histopathology images onto MRI, thereby assisting in the development of machine learning models for PCa detection on MRI.
Multi-resolution Super Learner for Voxel-wise Classification of Prostate Cancer Using Multi-parametric MRI

Jin Jin,Lin Zhang,Ethan Leng,Gregory J. Metzger,Joseph S. Koopmeiners

DOI: https://doi.org/10.48550/arXiv.2007.00816

2021-11-03

Abstract:While current research has shown the importance of Multi-parametric MRI (mpMRI) in diagnosing prostate cancer (PCa), further investigation is needed for how to incorporate the specific structures of the mpMRI data, such as the regional heterogeneity and between-voxel correlation within a subject. This paper proposes a machine learning-based method for improved voxel-wise PCa classification by taking into account the unique structures of the data. We propose a multi-resolution modeling approach to account for regional heterogeneity, where base learners trained locally at multiple resolutions are combined using the super learner, and account for between-voxel correlation by efficient spatial Gaussian kernel smoothing. The method is flexible in that the super learner framework allows implementation of any classifier as the base learner, and can be easily extended to classifying cancer into more sub-categories. We describe detailed classification algorithm for the binary PCa status, as well as the ordinal clinical significance of PCa for which a weighted likelihood approach is implemented to enhance the detection of the less prevalent cancer categories. We illustrate the advantages of the proposed approach over conventional modeling and machine learning approaches through simulations and application to in vivo data.

Machine Learning
Joint Cancer Segmentation and PI-RADS Classification on Multiparametric MRI Using MiniSegCaps Network

Wenting Jiang,Yingying Lin,Varut Vardhanabhuti,Yanzhen Ming,Peng Cao

DOI: https://doi.org/10.3390/diagnostics13040615

IF: 3.6

2023-02-07

Diagnostics

Abstract:MRI is the primary imaging approach for diagnosing prostate cancer. Prostate Imaging Reporting and Data System (PI-RADS) on multiparametric MRI (mpMRI) provides fundamental MRI interpretation guidelines but suffers from inter-reader variability. Deep learning networks show great promise in automatic lesion segmentation and classification, which help to ease the burden on radiologists and reduce inter-reader variability. In this study, we proposed a novel multi-branch network, MiniSegCaps, for prostate cancer segmentation and PI-RADS classification on mpMRI. MiniSeg branch outputted the segmentation in conjunction with PI-RADS prediction, guided by the attention map from the CapsuleNet. CapsuleNet branch exploited the relative spatial information of prostate cancer to anatomical structures, such as the zonal location of the lesion, which also reduced the sample size requirement in training due to its equivariance properties. In addition, a gated recurrent unit (GRU) is adopted to exploit spatial knowledge across slices, improving through-plane consistency. Based on the clinical reports, we established a prostate mpMRI database from 462 patients paired with radiologically estimated annotations. MiniSegCaps was trained and evaluated with fivefold cross-validation. On 93 testing cases, our model achieved a 0.712 dice coefficient on lesion segmentation, 89.18% accuracy, and 92.52% sensitivity on PI-RADS classification (PI-RADS ≥ 4) in patient-level evaluation, significantly outperforming existing methods. In addition, a graphical user interface (GUI) integrated into the clinical workflow can automatically produce diagnosis reports based on the results from MiniSegCaps.

medicine, general & internal
Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis

Alessa Hering,Sarah de Boer,Anindo Saha,Jasper J. Twilt,Mattias P. Heinrich,Derya Yakar,Maarten de Rooij,Henkjan Huisman,Joeran S. Bosma

2024-06-28

Abstract:The PI-CAI (Prostate Imaging: Cancer AI) challenge led to expert-level diagnostic algorithms for clinically significant prostate cancer detection. The algorithms receive biparametric MRI scans as input, which consist of T2-weighted and diffusion-weighted scans. These scans can be misaligned due to multiple factors in the scanning process. Image registration can alleviate this issue by predicting the deformation between the sequences. We investigate the effect of image registration on the diagnostic performance of AI-based prostate cancer diagnosis. First, the image registration algorithm, developed in MeVisLab, is analyzed using a dataset with paired lesion annotations. Second, the effect on diagnosis is evaluated by comparing case-level cancer diagnosis performance between using the original dataset, rigidly aligned diffusion-weighted scans, or deformably aligned diffusion-weighted scans. Rigid registration showed no improvement. Deformable registration demonstrated a substantial improvement in lesion overlap (+10% median Dice score) and a positive yet non-significant improvement in diagnostic performance (+0.3% AUROC, p=0.18). Our investigation shows that a substantial improvement in lesion alignment does not directly lead to a significant improvement in diagnostic performance. Qualitative analysis indicated that jointly developing image registration methods and diagnostic AI algorithms could enhance diagnostic accuracy and patient outcomes.

Image and Video Processing,Computer Vision and Pattern Recognition,Quantitative Methods
Automatic detection of prostate cancer grades and chronic prostatitis in biparametric MRI

Oleksii Bashkanov,Marko Rak,Anneke Meyer,Lucas Engelage,Agron Lumiani,Rolf Muschter,Christian Hansen

DOI: https://doi.org/10.1016/j.cmpb.2023.107624

Abstract:Background and objective: With emerging evidence to improve prostate cancer (PCa) screening, multiparametric magnetic prostate imaging is becoming an essential noninvasive component of the diagnostic routine. Computer-aided diagnostic (CAD) tools powered by deep learning can help radiologists interpret multiple volumetric images. In this work, our objective was to examine promising methods recently proposed in the multigrade prostate cancer detection task and to suggest practical considerations regarding model training in this context. Methods: We collected 1647 fine-grained biopsy-confirmed findings, including Gleason scores and prostatitis, to form a training dataset. In our experimental framework for lesion detection, all models utilized 3D nnU-Net architecture that accounts for anisotropy in the MRI data. First, we explore an optimal range of b-values for diffusion-weighted imaging (DWI) modality and its effect on the detection of clinically significant prostate cancer (csPCa) and prostatitis using deep learning, as the optimal range is not yet clearly defined in this domain. Next, we propose a simulated multimodal shift as a data augmentation technique to compensate for the multimodal shift present in the data. Third, we study the effect of incorporating the prostatitis class alongside cancer-related findings at three different granularities of the prostate cancer class (coarse, medium, and fine) and its impact on the detection rate of the target csPCa. Furthermore, ordinal and one-hot encoded (OHE) output formulations were tested. Results: An optimal model configuration with fine class granularity (prostatitis included) and OHE has scored the lesion-wise partial Free-Response Receiver Operating Characteristic (FROC) area under the curve (AUC) of 1.94 (CI 95%: 1.76-2.11) and patient-wise ROC AUC of 0.874 (CI 95%: 0.793-0.938) in the detection of csPCa. Inclusion of the auxiliary prostatitis class has demonstrated a stable relative improvement in specificity at a false positive rate (FPR) of 1.0 per patient, with an increase of 3%, 7%, and 4% for coarse, medium, and fine class granularities. Conclusions: This paper examines several configurations for model training in the biparametric MRI setup and proposes optimal value ranges. It also shows that the fine-grained class configuration, including prostatitis, is beneficial for detecting csPCa. The ability to detect prostatitis in all low-risk cancer lesions suggests the potential to improve the quality of the early diagnosis of prostate diseases. It also implies an improved interpretability of the results by the radiologist.
Feature Fusion of Raman Chemical Imaging and Digital Histopathology using Machine Learning for Prostate Cancer Detection

Trevor Doherty,Susan McKeever,Nebras Al-Attar,Tiarnan Murphy,Claudia Aura,Arman Rahman,Amanda O'Neill,Stephen P Finn,Elaine Kay,William M. Gallagher,R. William G. Watson,Aoife Gowen,Patrick Jackman

DOI: https://doi.org/10.48550/arXiv.2101.07342

2021-01-18

Image and Video Processing

Abstract:The diagnosis of prostate cancer is challenging due to the heterogeneity of its presentations, leading to the over diagnosis and treatment of non-clinically important disease. Accurate diagnosis can directly benefit a patient's quality of life and prognosis. Towards addressing this issue, we present a learning model for the automatic identification of prostate cancer. While many prostate cancer studies have adopted Raman spectroscopy approaches, none have utilised the combination of Raman Chemical Imaging (RCI) and other imaging modalities. This study uses multimodal images formed from stained Digital Histopathology (DP) and unstained RCI. The approach was developed and tested on a set of 178 clinical samples from 32 patients, containing a range of non-cancerous, Gleason grade 3 (G3) and grade 4 (G4) tissue microarray samples. For each histological sample, there is a pathologist labelled DP - RCI image pair. The hypothesis tested was whether multimodal image models can outperform single modality baseline models in terms of diagnostic accuracy. Binary non-cancer/cancer models and the more challenging G3/G4 differentiation were investigated. Regarding G3/G4 classification, the multimodal approach achieved a sensitivity of 73.8% and specificity of 88.1% while the baseline DP model showed a sensitivity and specificity of 54.1% and 84.7% respectively. The multimodal approach demonstrated a statistically significant 12.7% AUC advantage over the baseline with a value of 85.8% compared to 73.1%, also outperforming models based solely on RCI and median Raman spectra. Feature fusion of DP and RCI does not improve the more trivial task of tumour identification but does deliver an observed advantage in G3/G4 discrimination. Building on these promising findings, future work could include the acquisition of larger datasets for enhanced model generalization.
Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases

Shanshan Shen,Chunquan Li,Yaohua Fan,Shanfu Lu,Ziye Yan,Hu Liu,Haihang Zhou,Zijian Zhang

DOI: https://doi.org/10.11817/j.issn.1672-7347.2024.230248

2024-01-28

Abstract:Objectives: Glioblastoma (GBM) and brain metastases (BMs) are the two most common malignant brain tumors in adults. Magnetic resonance imaging (MRI) is a commonly used method for screening and evaluating the prognosis of brain tumors, but the specificity and sensitivity of conventional MRI sequences in differential diagnosis of GBM and BMs are limited. In recent years, deep neural network has shown great potential in the realization of diagnostic classification and the establishment of clinical decision support system. This study aims to apply the radiomics features extracted by deep learning techniques to explore the feasibility of accurate preoperative classification for newly diagnosed GBM and solitary brain metastases (SBMs), and to further explore the impact of multimodality data fusion on classification tasks. Methods: Standard protocol cranial MRI sequence data from 135 newly diagnosed GBM patients and 73 patients with SBMs confirmed by histopathologic or clinical diagnosis were retrospectively analyzed. First, structural T1-weight, T1C-weight, and T2-weight were selected as 3 inputs to the entire model, regions of interest (ROIs) were manually delineated on the registered three modal MR images, and multimodality radiomics features were obtained, dimensions were reduced using a random forest (RF)-based feature selection method, and the importance of each feature was further analyzed. Secondly, we used the method of contrast disentangled to find the shared features and complementary features between different modal features. Finally, the response of each sample to GBM and SBMs was predicted by fusing 2 features from different modalities. Results: The radiomics features using machine learning and the multi-modal fusion method had a good discriminatory ability for GBM and SBMs. Furthermore, compared with single-modal data, the multimodal fusion models using machine learning algorithms such as support vector machine (SVM), Logistic regression, RF, adaptive boosting (AdaBoost), and gradient boosting decision tree (GBDT) achieved significant improvements, with area under the curve (AUC) values of 0.974, 0.978, 0.943, 0.938, and 0.947, respectively; our comparative disentangled multi-modal MR fusion method performs well, and the results of AUC, accuracy (ACC), sensitivity (SEN) and specificity(SPE) in the test set were 0.985, 0.984, 0.900, and 0.990, respectively. Compared with other multi-modal fusion methods, AUC, ACC, and SEN in this study all achieved the best performance. In the ablation experiment to verify the effects of each module component in this study, AUC, ACC, and SEN increased by 1.6%, 10.9% and 15.0%, respectively after 3 loss functions were used simultaneously. Conclusions: A deep learning-based contrast disentangled multi-modal MR radiomics feature fusion technique helps to improve GBM and SBMs classification accuracy.
Prostate cancer inference via weakly-supervised learning using a large collection of negative MRI

Ruiming Cao,Xinran Zhong,Fabien Scalzo,Steven Raman,Kyung hyun Sung

DOI: https://doi.org/10.48550/arXiv.1910.02185

2019-10-05

Abstract:Recent advances in medical imaging techniques have led to significant improvements in the management of prostate cancer (PCa). In particular, multi-parametric MRI (mp-MRI) continues to gain clinical acceptance as the preferred imaging technique for non-invasive detection and grading of PCa. However, the machine learning-based diagnosis systems for PCa are often constrained by the limited access to accurate lesion ground truth annotations for training. The performance of the machine learning system is highly dependable on both quality and quantity of lesion annotations associated with histopathologic findings, resulting in limited scalability and clinical validation. Here, we propose the baseline MRI model to alternatively learn the appearance of mp-MRI using radiology-confirmed negative MRI cases via weakly supervised learning. Since PCa lesions are case-specific and highly heterogeneous, it is assumed to be challenging to synthesize PCa lesions using the baseline MRI model, while it would be relatively easier to synthesize the normal appearance in mp-MRI. We then utilize the baseline MRI model to infer the pixel-wise suspiciousness of PCa by comparing the original and synthesized MRI with two distance functions. We trained and validated the baseline MRI model using 1,145 negative prostate mp-MRI scans. For evaluation, we used separated 232 mp-MRI scans, consisting of both positive and negative MRI cases. The 116 positive MRI scans were annotated by radiologists, confirmed with post-surgical whole-gland specimens. The suspiciousness map was evaluated by receiver operating characteristic (ROC) analysis for PCa lesions versus non-PCa regions classification and free-response receiver operating characteristic (FROC) analysis for PCa localization. Our proposed method achieved 0.84 area under the ROC curve and 77.0% sensitivity at one false positive per patient in FROC analysis.

Image and Video Processing,Machine Learning,Quantitative Methods
Utilizing Semi-Supervised Learning and Image Matting in Combination with Mask R-CNN for Accurate Dominant Intraprostatic Lesion Identification and Segmentation on Multiparametric-MRI

A. M. Feldman,Z. Dai,W. Zong,M. Pantelic,M. A. Elshaikh,N. Wen

DOI: https://doi.org/10.1016/j.ijrobp.2020.07.619

2020-01-01

Abstract:Identification of the dominant intraprostatic lesion (DIL) using multiparametric-MRI (mp-MRI) can aid clinicians in the diagnosis, risk stratification, staging and therapeutic options in men with prostate cancer. Deep-learning based segmentation models such as Mask R-CNN are an emerging modality capable of identification and auto-segmentation of these lesions. However, model generation is limited by relatively sparse annotated data and anatomic challenges such as the ambiguous transition zone between the DIL and normal prostate tissue. Here we used a Mask R-CNN backbone in combination with semi-supervised training and image matting in an effort to overcome these limitations and achieve accurate segmentation of the DIL. A total of 244 patients, split into 2 cohorts, with biopsy proven prostate adenocarcinoma and mp-MRI imaging, were reviewed. Cohort 1 included 202 patients from the SPIE-AAPM-NCI Prostate MR Gleason Grade Group Challenge (PROSTATEx-2 Challenge). Cohort 2 included 42 patients from our institution. All patients in cohort 2 and 96 patients in cohort 1 had the DIL annotated by two experienced clinicians from our institution on T2-weighted imaging (T2WI) to establish the ground truth. Apparent diffusion coefficient mapping was rigidly registered to T2WI. A base Mask R-CNN model was trained in a supervised fashion using 84 annotated patients gathered from both cohorts. The base model with the most confident label was then used to predict 106 cohort 1 patients without annotations. The 84 annotated patients and 106 self-annotated patients were then used as the training set to train a semi-supervised model. Finally, image matting was applied as a post-processing approach to refine the boundaries of detected lesions. Ten annotated cohort 1 patients were used as the validation set and 23 and 21 cohort 1 and cohort 2 patients, respectively, were used as the testing set. Dice similarity coefficient (DSC) and the 95th percentile Hausdorff distance (95 HD) were used as evaluation metrics. We defined agreement as the degree to which a model's predictions concurred with the ground truth annotations. The DSC, 95HD (mm) and agreement for the validation on the base model were 0.659 ± 0.105, 3.75 ± 1.40, and 90.0%, respectively. For the testing set on the base model, these results were 0.564 ± 0.153, 4.52 ± 2.16 and 78.6%, respectively. When applying the semi-supervised model, the DSC, 95HD (mm) and agreement were 0.635 ± 0.142, 4.31 ± 1.34 and 100.0% for the validation set and 0.585 ± 0.146, 4.83 ± 2.53 and 76.8% on the testing set. Using image mapping, these values were increased to 0.725± 0.116, 3.70 ± 1.09, 100%; and 0.672 ± 0.123, 4.18 ± 1.97, 76.8% on validation and testing sets, respectively. Semi-supervised learning offered limited improvements when applied to the Mask R-CNN backbone model. However, image matting proved to be a powerful tool in improving the segmentation of the DIL.
Multi-kernel SVM Based Classification for Tumor Segmentation by Fusion of MRI Images

Nan Zhang,Qingmin Liao,Su Ruan,Stephane Lebonvallet,Yuemin Zhu

DOI: https://doi.org/10.1109/ist.2009.5071605

2009-01-01

Abstract:Tumor segmentation, a significant application in the field of medical imaging and pattern recognition, is still a very difficult and unsolved problem up to now. In this paper, an improved SVM algorithm-multi-kernel SVM, integrated with data fusion process, is proposed to segment the tumors from the MRI image sequence. Three kinds of MRI image sequence-T2, PD, FLAIR are used as input sources in learning and classifying process. Then a region growing step is exploited for a refinement of the tumor contour. At last, according to the follow-up result of the same patient at five different periods, it is obvious that the tumor's volume becomes smaller, and an evaluation percentage is given to prove the effectiveness of the therapy. The quantification of result demonstrates the effectiveness of the proposed method.

7,12-Dimethylbenz[a]anthracene-DNA adduct formation in Wistar rat and Syrian hamster embryo cell cultures.

Mutual Information-Based Graph Co-Attention Networks for Multimodal Prior-Guided Magnetic Resonance Imaging Segmentation

MULTI-MODAL DATA FUSION SCHEMES FOR INTEGRATED CLASSIFICATION OF IMAGING AND NON-IMAGING BIOMEDICAL DATA

Mutually communicated model based on multi‐parametric MRI for automated segmentation and classification of prostate cancer

Modality-Specific Information Disentanglement from Multi-parametric MRI for Breast Tumor Segmentation and Computer-aided Diagnosis

Exploring the efficacy of multi-flavored feature extraction with radiomics and deep features for prostate cancer grading on mpMRI

Identifying pathological groups from MRI in prostate cancer using graph representation learning

Deep Attentive Panoptic Model for Prostate Cancer Detection Using Biparametric MRI Scans

Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks

A graph-based approach for the retrieval of multi-modality medical images

Preanalytical variables in coagulation testing.

Multi-scale statistical deformation based co-registration of prostate MRI and post-surgical whole mount histopathology

Multi-resolution Super Learner for Voxel-wise Classification of Prostate Cancer Using Multi-parametric MRI

Joint Cancer Segmentation and PI-RADS Classification on Multiparametric MRI Using MiniSegCaps Network

Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis

Automatic detection of prostate cancer grades and chronic prostatitis in biparametric MRI

Feature Fusion of Raman Chemical Imaging and Digital Histopathology using Machine Learning for Prostate Cancer Detection

Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases

Prostate cancer inference via weakly-supervised learning using a large collection of negative MRI

Utilizing Semi-Supervised Learning and Image Matting in Combination with Mask R-CNN for Accurate Dominant Intraprostatic Lesion Identification and Segmentation on Multiparametric-MRI

Multi-kernel SVM Based Classification for Tumor Segmentation by Fusion of MRI Images