Report from the Finnish Cancer Registry.

E. Saxén

DOI: https://doi.org/10.1159/000160810

1955-07-01

Abstract:

What problem does this paper attempt to address?

Automatic Segmentation of Coronary Lumen and External Elastic Membrane in Intravascular Ultrasound Images Using 8-Layer U-Net

Dong Liang,Jiang Wenbing,Lu Wei,Jiang Jun,Zhao Ya,Song Xiangfen,Leng Xiaochang,Zhao Hang,Wang Jian’an,Li Changling,Xiang Jianping

DOI: https://doi.org/10.1186/s12938-021-00852-0

2021-01-01

BioMedical Engineering OnLine

Abstract:Background: Intravascular ultrasound (IVUS) is the golden standard in accessing the coronary lesions, stenosis, and atherosclerosis plaques. In this paper, a fully-automatic approach by an 8-layer U-Net is developed to segment the coronary artery lumen and the area bounded by external elastic membrane (EEM), i.e. cross section area (EEM-CSA). The database comprises of single-vendor and single-frequency IVUS data. Particularly, the proposed data augmentation of MeshGrid combined with flip and rotation operations is implemented, improving the model performance without pre- or post-processing of the raw IVUS images.Results: The mean intersection of union (mIoU) of 0.937 and 0.804 for the lumen and EEM-CSA respectively were achieved, which exceeded the manual labeling accuracy of the clinician.Conclusion: The accuracy shown by the proposed method is sufficient for subsequent reconstruction of 3D IVUS images, which is essential for doctors’ diagnosis in the tissue characterization of coronary artery walls and plaque compositions, qualitatively and quantitatively.
A Sparse Deep Learning Approach for Automatic Segmentation of Human Vasculature in Multispectral Optoacoustic Tomography

Nikolaos-Kosmas Chlis,Angelos Karlas,Nikolina-Alexia Fasoula,Michael Kallmayer,Hans-Henning Eckstein,Fabian J. Theis,Vasilis Ntziachristos,Carsten Marr

DOI: https://doi.org/10.1016/j.pacs.2020.100203

IF: 9.656

2020-01-01

Photoacoustics

Abstract:Multispectral Optoacoustic Tomography (MSOT) resolves oxy- (HbO2) and deoxy-hemoglobin (Hb) to perform vascular imaging. MSOT suffers from gradual signal attenuation with depth due to light-tissue interactions: an effect that hinders the precise manual segmentation of vessels. Furthermore, vascular assessment requires functional tests, which last several minutes and result in recording thousands of images. Here, we introduce a deep learning approach with a sparse-UNET (S-UNET) for automatic vascular segmentation in MSOT images to avoid the rigorous and time-consuming manual segmentation. We evaluated the S-UNET on a test-set of 33 images, achieving a median DICE score of 0.88. Apart from high segmentation performance, our method based its decision on two wavelengths with physical meaning for the task-at-hand: 850 nm (peak absorption of oxy-hemoglobin) and 810 nm (isosbestic point of oxy-and deoxy-hemoglobin). Thus, our approach achieves precise data-driven vascular segmentation for automated vascular assessment and may boost MSOT further towards its clinical translation.
Evolution of a vision system by genetic algorithm

Wen Nian,K. Okazaki,S. Tamura

DOI: https://doi.org/10.1007/BF02471178

1998-12-01

Artificial Life and Robotics

Abstract:
Label-free segmentation from cardiac ultrasound using self-supervised learning

Danielle L. Ferreira,Zaynaf Salaymang,Rima Arnaout

2023-10-25

Abstract:Segmentation and measurement of cardiac chambers is critical in cardiac ultrasound but is laborious and poorly reproducible. Neural networks can assist, but supervised approaches require the same laborious manual annotations. We built a pipeline for self-supervised (no manual labels) segmentation combining computer vision, clinical domain knowledge, and deep learning. We trained on 450 echocardiograms (93,000 images) and tested on 8,393 echocardiograms (4,476,266 images; mean 61 years, 51% female), using the resulting segmentations to calculate biometrics. We also tested against external images from an additional 10,030 patients with available manual tracings of the left ventricle. r2 between clinically measured and pipeline-predicted measurements were similar to reported inter-clinician variation and comparable to supervised learning across several different measurements (r2 0.56-0.84). Average accuracy for detecting abnormal chamber size and function was 0.85 (range 0.71-0.97) compared to clinical measurements. A subset of test echocardiograms (n=553) had corresponding cardiac MRIs, where MRI is the gold standard. Correlation between pipeline and MRI measurements was similar to that between clinical echocardiogram and MRI. Finally, the pipeline accurately segments the left ventricle with an average Dice score of 0.89 (95% CI [0.89]) in the external, manually labeled dataset. Our results demonstrate a manual-label free, clinically valid, and highly scalable method for segmentation from ultrasound, a noisy but globally important imaging modality.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Vascular Segmentation of Functional Ultrasound Images using Deep Learning

Hana Sebia,Thomas Guyet,Mickaël Pereira,Marco Valdebenito,Hugues Berry,Benjamin Vidal

2024-10-28

Abstract:Segmentation of medical images is a fundamental task with numerous applications. While MRI, CT, and PET modalities have significantly benefited from deep learning segmentation techniques, more recent modalities, like functional ultrasound (fUS), have seen limited progress. fUS is a non invasive imaging method that measures changes in cerebral blood volume (CBV) with high spatio-temporal resolution. However, distinguishing arterioles from venules in fUS is challenging due to opposing blood flow directions within the same pixel. Ultrasound localization microscopy (ULM) can enhance resolution by tracking microbubble contrast agents but is invasive, and lacks dynamic CBV quantification. In this paper, we introduce the first deep learning-based segmentation tool for fUS images, capable of differentiating signals from different vascular compartments, based on ULM automatic annotation and enabling dynamic CBV quantification. We evaluate various UNet architectures on fUS images of rat brains, achieving competitive segmentation performance, with 90% accuracy, a 71% F1 score, and an IoU of 0.59, using only 100 temporal frames from a fUS stack. These results are comparable to those from tubular structure segmentation in other imaging modalities. Additionally, models trained on resting-state data generalize well to images captured during visual stimulation, highlighting robustness. This work offers a non-invasive, cost-effective alternative to ULM, enhancing fUS data interpretation and improving understanding of vessel function. Our pipeline shows high linear correlation coefficients between signals from predicted and actual compartments in both cortical and deeperregions, showcasing its ability to accurately capture blood flow dynamics.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis

Dilek M Yalcinkaya,Khalid Youssef,Bobak Heydari,Janet Wei,Noel Bairey Merz,Robert Judd,Rohan Dharmakumar,Orlando P Simonetti,Jonathan W Weinsaft,Subha V Raman,Behzad Sharif

DOI: https://doi.org/10.1016/j.jocmr.2024.101082

2024-08-12

Abstract:Background: Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze multi-center datasets despite limited training data and variations in software (pulse sequence) and hardware (scanner vendor) is an ongoing challenge. Methods: Datasets from 3 medical centers acquired at 3T (n = 150 subjects; 21,150 first-pass images) were included: an internal dataset (inD; n = 95) and two external datasets (exDs; n = 55) used for evaluating the robustness of the trained deep neural network (DNN) models against differences in pulse sequence (exD-1) and scanner vendor (exD-2). A subset of inD (n = 85) was used for training/validation of a pool of DNNs for segmentation, all using the same spatiotemporal U-Net architecture and hyperparameters but with different parameter initializations. We employed a space-time sliding-patch analysis approach that automatically yields a pixel-wise "uncertainty map" as a byproduct of the segmentation process. In our approach, dubbed Data Adaptive Uncertainty-Guided Space-time (DAUGS) analysis, a given test case is segmented by all members of the DNN pool and the resulting uncertainty maps are leveraged to automatically select the "best" one among the pool of solutions. For comparison, we also trained a DNN using the established approach with the same settings (hyperparameters, data augmentation, etc.). Results: The proposed DAUGS analysis approach performed similarly to the established approach on the internal dataset (Dice score for the testing subset of inD: 0.896 ± 0.050 vs. 0.890 ± 0.049; p = n.s.) whereas it significantly outperformed on the external datasets (Dice for exD-1: 0.885 ± 0.040 vs. 0.849 ± 0.065, p < 0.005; Dice for exD-2: 0.811 ± 0.070 vs. 0.728 ± 0.149, p < 0.005). Moreover, the number of image series with "failed" segmentation (defined as having myocardial contours that include bloodpool or are noncontiguous in ≥1 segment) was significantly lower for the proposed vs. the established approach (4.3% vs. 17.1%, p < 0.0005). Conclusions: The proposed DAUGS analysis approach has the potential to improve the robustness of deep learning methods for segmentation of multi-center stress perfusion datasets with variations in the choice of pulse sequence, site location or scanner vendor.
Deep learning-based detection of murine congenital heart defects from µCT scans

Hoa Nguyen,Audrey Desgrange,Amaia Ochandorena-Saa,Vanessa Benhamo,Sigolène M. Meilhac,Christophe Zimmer

DOI: https://doi.org/10.1101/2024.04.06.588383

2024-04-10

Abstract:Congenital heart defects (CHD) result in high morbidity and mortality rates, but their origins are poorly understood. Mouse models of heart morphogenesis are required to study the pathological mechanisms of heart development compared to normal. In mouse fetuses, CHD can be observed and detected in 3D images obtained by thoracic micro-computed tomography (μCT). However, diagnosis of CHD from μCT scans is a time-consuming process that requires the experience of senior experts. An automated alternative would thus save time, empower less experienced investigators and could broaden analysis to larger numbers of samples. Here, we describe and validate an approach based on deep learning to automatically segment the heart and screen normal from malformed hearts in mouse μCT scans. In an initial cohort, we collected 139 μCT scans from thorax and abdomen of control and mutant perinatal mice. We trained a self-configurating neural network (nnU-Net) to segment hearts from body μCT scans and validated its performance on expert segmentations, achieving a Dice coefficient of 96%. To identify malformed hearts, we developed and trained a 3D convolutional neural network (CNN) that uses segmented μCT scans as inputs. Despite the relatively small training data size, our diagnosis model achieved a sensitivity, specificity (for a 0.5 threshold), and area under the curve (AUC) of 92%, 96%, and 97% respectively, as determined by 5-fold cross-validation. As further validation, we analyzed two additional cohorts that were collected after the model was trained: a ‘prospective’ cohort, using the same experimental protocol as the initial cohort, and containing a subset of its genotypes, and a ‘divergent’ cohort in which mice were subjected to a different treatment for heart arrest (cardioplegia) and that contained a new mouse line. Performance on the prospective cohort was excellent, with a sensitivity of 92%, a specificity of 100%, and an AUC of 100%. Performance on the divergent cohort was moderate (sensitivity: 69%, specificity: 80% and AUC: 81%), but was much improved when the model was finetuned on (a subset of) the cohort (sensitivity: 79%, specificity: 88% and AUC: 91%). These results showcase our model’s robustness and adaptability to technical and biological differences in the data, highlighting its usefulness for practical applications. In order to facilitate the adoption, adaptation and further improvement of these methods, we built a user-friendly (available at ) that allows users without programming skills to utilize the segmentation and diagnosis models and re-train the latter on their own data and resources. The plugin also highlights the cardiac regions used for the diagnosis. Our automatic and retrainable pipeline, which can be employed in high-throughput genetic screening, will accelerate diagnosis of heart anomalies in mice and facilitate studies of the mechanisms of CHD.

Developmental Biology
Extraction of volumetric indices from echocardiography: which deep learning solution for clinical use?

Hang Jung Ling,Nathan Painchaud,Pierre-Yves Courand,Pierre-Marc Jodoin,Damien Garcia,Olivier Bernard

DOI: https://doi.org/10.1007/978-3-031-35302-4_25

2023-05-08

Abstract:Deep learning-based methods have spearheaded the automatic analysis of echocardiographic images, taking advantage of the publication of multiple open access datasets annotated by experts (CAMUS being one of the largest public databases). However, these models are still considered unreliable by clinicians due to unresolved issues concerning i) the temporal consistency of their predictions, and ii) their ability to generalize across datasets. In this context, we propose a comprehensive comparison between the current best performing methods in medical/echocardiographic image segmentation, with a particular focus on temporal consistency and cross-dataset aspects. We introduce a new private dataset, named CARDINAL, of apical two-chamber and apical four-chamber sequences, with reference segmentation over the full cardiac cycle. We show that the proposed 3D nnU-Net outperforms alternative 2D and recurrent segmentation methods. We also report that the best models trained on CARDINAL, when tested on CAMUS without any fine-tuning, still manage to perform competitively with respect to prior methods. Overall, the experimental results suggest that with sufficient training data, 3D nnU-Net could become the first automated tool to finally meet the standards of an everyday clinical device.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
Deep-learning-based Image Segmentation for Image-based Computational Hemodynamic Analysis of Abdominal Aortic Aneurysms: A Comparison Study

Zonghan Lyu,Kristin King,Mostafa Rezaeitaleshmahalleh,Drew Pienta,Nan Mu,Chen Zhao,Weihua Zhou,Jingfeng Jiang,Jingfeng None Jiang

DOI: https://doi.org/10.1088/2057-1976/acf3ed

2023-08-26

Abstract:Computational hemodynamics is increasingly used to quantify hemodynamic characteristics in and around abdominal aortic aneurysms (AAA) in a patient-specific fashion. However, the time-consuming manual annotation hinders the clinical translation of computational hemodynamic analysis. Thus, we investigate the feasibility of using deep-learning-based image segmentation methods to reduce the time required for manual segmentation. Two of the latest deep-learning-based image segmentation methods, ARU-Net and CACU-Net, were used to test the feasibility of automated computer model creation for computational hemodynamic analysis. Morphological features and hemodynamic metrics of 30 computed tomography angiography (CTA) scans were compared between pre-dictions and manual models. The DICE score for both networks was 0.916, and the correlation value was above 0.95, indicating their ability to generate models comparable to human segmentation. The Bland-Altman analysis shows a good agreement between deep learning and manual segmentation results. Compared with manual (computational hemodynamics) model recreation, the time for automated computer model generation was significantly reduced (from ~2hr to ~10min). Automated image segmentation can significantly reduce time expenses on the recreation of patient-specific AAA models. Moreover, our study showed that both CACU-Net and ARU-Net could accomplish AAA segmentation, and CACU-Net outperformed ARU-Net in terms of accuracy and time-saving.
Deep learning enables the fully automated quantification of high-resolution cardiac CT images: human in loop for model development

P Mohammadi Kazaj,G Baj,J Schutze,A Stark,W Valenzuela,A A Giannopoulos,R Ralf Buechel,C Graeni,I Shiri

DOI: https://doi.org/10.1093/eurheartj/ehae666.3471

IF: 39.3

2024-10-30

European Heart Journal

Abstract:Introduction Cardiac computed tomography (CCT) images provide vast spatial and temporal information. Segmentation of the structure of interest is necessary to provide quantitative information. However, manual segmentation of cardiac substructures is highly time-consuming. Objective This study aims to develop a robust deep-learning segmentation model for cardiac substructure segmentation in 3D CCT images. Method We initially developed a 3D U-Net architecture, incorporating extensive augmentation, for the segmentation of the Left Ventricle Myocardium (LVM), the blood cavities of the Left and Right Ventricles (LV, RV), and the Left and Right Atria (LA, RA). This model utilized CT images from 20 patients who had available manual segmentation. Subsequently, we applied this initial model to datasets from two centers, including different generations of scanners. We then visually inspected the segmentation, selected the highest-quality segmentations, and modify it if necessary, and excluded the low-quality data. We continued fine-tuning the model with the new dataset until we reached a count of 456 patients. As there were multiple images from one patient during this model's development, we generated datasets to develop a new model using the entire new dataset to avoid any data leakage in the reported metrics. The model was developed using data from Center 1 (5-fold cross-validation) and then evaluated on an external test set from Center 2 (126 patients) and also 4D images from Center 1. Various metrics were calculated to assess the model's performance. Results In the internal test set, utilizing 5-fold CV, the model demonstrated high segmentation accuracy, achieving an overall Dice coefficient of 0.98, with individual scores of 0.96 for LVM, 0.98 for LV, 0.98 for RV, 0.99 for RA, and 0.98 for LA. We assessed the automatic quantification capability of the segmentation model from 256 patients, resulting in an R2 value greater than 0.92 for both LV end-diastolic and systolic volumes. In contrast, the model maintained robust performance on the external dataset, achieving an overall Dice coefficient of 0.96, with individual scores of 0.95 for LVM, 0.98 for LV, 0.97 for RV, 0.98 for RA, and 0.94 for LA. Conclusion We provided a large cohort of ground truth segmentations for different cardiac CT substructures using a human-in-the-loop strategy. Subsequently, we developed a deep learning model for highly accurate automated segmentation of these substructures. This model allows for fast and fully automatic segmentation and quantification of 3D and 4D cardiac CT images, from which various quantitative metrics can be extracted from different cardiac substructures.

cardiac & cardiovascular systems
Assessment of Deep Learning Segmentation for Real-Time Free-Breathing Cardiac Magnetic Resonance Imaging at Rest and Under Exercise Stress

Martin Schilling,Christina Unterberg-Buchwald,Joachim Lotz,Martin Uecker

DOI: https://doi.org/10.1038/s41598-024-54164-z

2024-02-09

Abstract:In recent years, a variety of deep learning networks for cardiac MRI (CMR) segmentation have been developed and analyzed. However, nearly all of them are focused on cine CMR under breathold. In this work, accuracy of deep learning methods is assessed for volumetric analysis (via segmentation) of the left ventricle in real-time free-breathing CMR at rest and under exercise stress. Data from healthy volunteers (n=15) for cine and real-time free-breathing CMR at rest and under exercise stress were analyzed retrospectively. Segmentations of a commercial software (comDL) and a freely available neural network (nnU-Net), were compared to a reference created via the manual correction of comDL segmentation. Segmentation of left ventricular endocardium (LV), left ventricular myocardium (MYO), and right ventricle (RV) is evaluated for both end-systolic and end-diastolic phases and analyzed with Dice's coefficient (DC). The volumetric analysis includes LV end-diastolic volume (EDV), LV end-systolic volume (ESV), and LV ejection fraction (EF). For cine CMR, nnU-Net and comDL achieve a DC above 0.95 for LV and 0.9 for MYO, and RV. For real-time CMR, the accuracy of nnU-Net exceeds that of comDL overall. For real-time CMR at rest, nnU-Net achieves a DC of 0.94 for LV, 0.89 for MYO, and 0.90 for RV; mean absolute differences between nnU-Net and reference are 2.9mL for EDV, 3.5mL for ESV and 2.6% for EF. For real-time CMR under exercise stress, nnU-Net achieves a DC of 0.92 for LV, 0.85 for MYO, and 0.83 for RV; mean absolute differences between nnU-Net and reference are 11.4mL for EDV, 2.9mL for ESV and 3.6% for EF. Deep learning methods designed or trained for cine CMR segmentation can perform well on real-time CMR. For real-time free-breathing CMR at rest, the performance of deep learning methods is comparable to inter-observer variability in cine CMR and is usable or fully automatic segmentation.

Image and Video Processing,Computer Vision and Pattern Recognition
Does gel affect cytology or comfort in the screening papanicolaou smear?

Meredith Gilson,A. Desai,Gabriella Cardoza-Favarato,P. Vroman,J. Thornton

DOI: https://doi.org/10.3122/JABFM.19.4.340

2006-07-01

Abstract:PURPOSE Current medical training recommends obtaining cervical cytological specimens without the use of lubricating gel. The purpose of this study was to determine whether water-soluble lubricant gel affects cytologic outcomes in the screening Papanicolaou smear and patient comfort during vaginal speculum examination. METHODS The study was a randomized controlled trial performed at David Grant US Air Force Medical Center (Travis Air Force Base, CA). Participants were female patients at least 18 years old presenting for an annual Papanicolaou smear. Each patient, blinded to group assignment, consented to two consecutive Papanicolaou smears. The first Papanicolaou smear was performed without gel in all subjects as part of the "standard of care." Thirty control patients underwent a second examination with no gel, and 40 other patients had the second examination with gel. All patients rated the discomfort of each Papanicolaou smear on a numerical pain scale. Main outcome measures were cytologic discrepancies on standard glass slide samples and comfort differences regarding the use of gel lubrication. Fisher's exact test was used to interpret the effect of gel on cytology results. Student's t test was performed to compare the discomfort ratings for the second Papanicolaou smear in the GEL vs. the NO GEL groups. RESULTS There was no statistically significant difference between the number of inadequate Papanicolaou smears (P = .50) nor in the discomfort level ratings in the GEL vs. the NO GEL groups (P = .69). CONCLUSION Speculum gel lubrication does not affect cervical cytology during the traditional Papanicolaou smear, nor does it provide significant alteration of patient discomfort.
An efficient annotated data generation method for echocardiographic image segmentation

Patrice Monkam,Songbai Jin,Wenkai Lu

DOI: https://doi.org/10.1016/j.compbiomed.2022.106090

Abstract:Background: In recent years, deep learning techniques have demonstrated promising performances in echocardiography (echo) data segmentation, which constitutes a critical step in the diagnosis and prognosis of cardiovascular diseases (CVDs). However, their successful implementation requires large number and high-quality annotated samples, whose acquisition is arduous and expertise-demanding. To this end, this study aims at circumventing the tedious, time-consuming and expertise-demanding data annotation involved in deep learning-based echo data segmentation. Methods: We propose a two-phase framework for fast generation of annotated echo data needed for implementing intelligent cardiac structure segmentation systems. First, multi-size and multi-orientation cardiac structures are simulated leveraging polynomial fitting method. Second, the obtained cardiac structures are embedded onto curated endoscopic ultrasound images using Fourier Transform algorithm, resulting in pairs of annotated samples. The practical significance of the proposed framework is validated through using the generated realistic annotated images as auxiliary dataset to pretrain deep learning models for automatic segmentation of left ventricle and left ventricle wall in real echo data, respectively. Results: Extensive experimental analyses indicate that compared with training from scratch, fine-tuning after pretraining with the generated dataset always results in significant performance improvement whereby the improvement margins in terms of Dice and IoU can reach 12.9% and 7.74%, respectively. Conclusion: The proposed framework has great potential to overcome the shortage of labeled data hampering the deployment of deep learning approaches in echo data analysis.
Automated Segmentation and Quantification of the Right Ventricle in 2-D Echocardiography

Artem Chernyshov,Jahn Frederik Grue,John Nyberg,Bjørnar Grenne,Håvard Dalen,Svein Arne Aase,Andreas Østvik,Lasse Lovstakken

DOI: https://doi.org/10.1016/j.ultrasmedbio.2023.12.018

IF: 3.694

2024-01-30

Ultrasound in Medicine & Biology

Abstract:Objective The right ventricle receives less attention than its left counterpart in echocardiography research, practice and development of automated solutions. In the work described here, we sought to determine that the deep learning methods for automated segmentation of the left ventricle in 2-D echocardiograms are also valid for the right ventricle. Additionally, here we describe and explore a keypoint detection approach to segmentation that guards against erratic behavior often displayed by segmentation models. Methods We used a data set of echo images focused on the right ventricle from 250 participants to train and evaluate several deep learning models for segmentation and keypoint detection. We propose a compact architecture (U-Net KP) employing the latter approach. The architecture is designed to balance high speed with accuracy and robustness. Results All featured models achieved segmentation accuracy close to the inter-observer variability. When computing the metrics of right ventricular systolic function from contour predictions of U-Net KP, we obtained the bias and 95% limits of agreement of 0.8 ± 10.8% for the right ventricular fractional area change measurements, –0.04 ± 0.54 cm for the tricuspid annular plane systolic excursion measurements and 0.2 ± 6.6% for the right ventricular free wall strain measurements. These results were also comparable to the semi-automatically derived inter-observer discrepancies of 0.4 ± 11.8%, –0.37 ± 0.58 cm and –1.0 ± 7.7% for the aforementioned metrics, respectively. Conclusion Given the appropriate data, automated segmentation and quantification of the right ventricle in 2-D echocardiography are feasible with existing methods. However, keypoint detection architectures may offer higher robustness and information density for the same computational cost.

radiology, nuclear medicine & medical imaging,acoustics
Automatic Myocardial Segmentation by Using A Deep Learning Network in Cardiac MRI

Ariel H. Curiale,Flavio D. Colavecchia,Pablo Kaluza,Roberto A. Isoardi,German Mato

DOI: https://doi.org/10.48550/arXiv.1708.07452

2017-08-24

Abstract:Cardiac function is of paramount importance for both prognosis and treatment of different pathologies such as mitral regurgitation, ischemia, dyssynchrony and myocarditis. Cardiac behavior is determined by structural and functional features. In both cases, the analysis of medical imaging studies requires to detect and segment the myocardium. Nowadays, magnetic resonance imaging (MRI) is one of the most relevant and accurate non-invasive diagnostic tools for cardiac structure and function. In this work we propose to use a deep learning technique to assist the automatization of myocardial segmentation in cardiac MRI. We present several improvements to previous works in this paper: we propose to use the Jaccard distance as optimization objective function, we integrate a residual learning strategy into the code, and we introduce a batch normalization layer to train the fully convolutional neural network. Our results demonstrate that this architecture outperforms previous approaches based on a similar network architecture, and that provides a suitable approach for myocardial segmentation. Our benchmark shows that the automatic myocardial segmentation takes less than 22 seg. for a volume of 128~x~128~x~13 pixels in a 3.1 GHz intel core i7.

Computer Vision and Pattern Recognition
DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal

Zhongliang Jiang,Felix Duelmer,Nassir Navab

2023-05-16

Abstract:Medical ultrasound (US) is widely used to evaluate and stage vascular diseases, in particular for the preliminary screening program, due to the advantage of being radiation-free. However, automatic segmentation of small tubular structures (e.g., the ulnar artery) from cross-sectional US images is still challenging. To address this challenge, this paper proposes the DopUS-Net and a vessel re-identification module that leverage the Doppler effect to enhance the final segmentation result. Firstly, the DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels. It incorporates two encoders to exploit the maximum potential of the Doppler signal and recurrent neural network modules to preserve sequential information. Input to the first encoder is a two-channel duplex image representing the combination of the grey-scale Doppler and B-mode images to ensure anatomical spatial correctness. The second encoder operates on the pure Doppler images to provide a region proposal. Secondly, benefiting from the Doppler signal, this work first introduces an online artery re-identification module to qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images. This quality-aware module enables the closed-loop control of robotic screening to further improve the confidence and robustness of image segmentation. The experimental results demonstrate that the proposed approach with the re-identification process can significantly improve the accuracy and robustness of the segmentation results (dice score: from 0:54 to 0:86; intersection over union: from 0:47 to 0:78).

Computer Vision and Pattern Recognition,Robotics,Image and Video Processing
Fully Automated Machine Learning Pipeline for Echocardiogram Segmentation

Hang Duong Thi Thuy,Tuan Nguyen Minh,Phi Nguyen Van,Long Tran Quoc

DOI: https://doi.org/10.48550/arXiv.2107.08440

2021-10-28

Abstract:Nowadays, cardiac diagnosis largely depends on left ventricular function assessment. With the help of the segmentation deep learning model, the assessment of the left ventricle becomes more accessible and accurate. However, deep learning technique still faces two main obstacles: the difficulty in acquiring sufficient training data and time-consuming in developing quality models. In the ordinary data acquisition process, the dataset was selected randomly from a large pool of unlabeled images for labeling, leading to massive labor time to annotate those images. Besides that, hand-designed model development is strenuous and also costly. This paper introduces a pipeline that relies on Active Learning to ease the labeling work and utilizes Neural Architecture Search's idea to design the adequate deep learning model automatically. We called this Fully automated machine learning pipeline for echocardiogram segmentation. The experiment results show that our method obtained the same IOU accuracy with only two-fifths of the original training dataset, and the searched model got the same accuracy as the hand-designed model given the same training dataset.

Computer Vision and Pattern Recognition
Topology-preserving segmentation of abdominal muscle layers from ultrasound images

Feiyang Liao,Dongli Li,Xiaoyu Yang,Weiwei Cao,Dehui Xiang,Gang Yuan,Yingwei Wang,Jian Zheng

DOI: https://doi.org/10.1002/mp.17377

2024-09-06

Abstract:Background: In clinical anesthesia, precise segmentation of muscle layers from abdominal ultrasound images is crucial for identifying nerve block locations accurately. Despite deep learning advancements, challenges persist in segmenting muscle layers with accurate topology due to pseudo and weak edges caused by acoustic artifacts in ultrasound imagery. Purpose: To assist anesthesiologists in locating nerve block areas, we have developed a novel deep learning algorithm that can accurately segment muscle layers in abdominal ultrasound images with interference. Methods: We propose a comprehensive approach emphasizing the preservation of the segmentation's low-rank property to ensure correct topology. Our methodology integrates a Semantic Feature Extraction (SFE) module for redundant encoding, a Low-rank Reconstruction (LR) module to compress this encoding, and an Edge Reconstruction (ER) module to refine segmentation boundaries. Our evaluation involved rigorous testing on clinical datasets, comparing our algorithm against seven established deep learning-based segmentation methods using metrics such as Mean Intersection-over-Union (MIoU) and Hausdorff distance (HD). Statistical rigor was ensured through effect size quantification with Cliff's Delta, Multivariate Analysis of Variance (MANOVA) for multivariate analysis, and application of the Holm-Bonferroni method for multiple comparisons correction. Results: We demonstrate that our method outperforms other industry-recognized deep learning approaches on both MIoU and HD metrics, achieving the best outcomes with 88.21%/4.98 ( p m a x = 0.1893 $p_{max}=0.1893$ ) on the standard test set and 85.48%/6.98 ( p m a x = 0.0448 $p_{max}=0.0448$ ) on the challenging test set. The best&worst results for the other models on the standard test set were (87.20%/5.72)&(83.69%/8.12), and on the challenging test set were (81.25%/10.00)&(71.74%/16.82). Ablation studies further validate the distinct contributions of the proposed modules, which synergistically achieve a balance between maintaining topological integrity and edge precision. Conclusions: Our findings validate the effective segmentation of muscle layers with accurate topology in complex ultrasound images, leveraging low-rank constraints. The proposed method not only advances the field of medical imaging segmentation but also offers practical benefits for clinical anesthesia by improving the reliability of nerve block localization.
Multiview and Multiclass Image Segmentation using Deep Learning in Fetal Echocardiography

Ken C. L. Wong,Elena S. Sinkovskaya,Alfred Z. Abuhamad,Tanveer Syeda-Mahmood

DOI: https://doi.org/10.48550/arXiv.2103.12245

2021-03-23

Image and Video Processing

Abstract:Congenital heart disease (CHD) is the most common congenital abnormality associated with birth defects in the United States. Despite training efforts and substantial advancement in ultrasound technology over the past years, CHD remains an abnormality that is frequently missed during prenatal ultrasonography. Therefore, computer-aided detection of CHD can play a critical role in prenatal care by improving screening and diagnosis. Since many CHDs involve structural abnormalities, automatic segmentation of anatomical structures is an important step in the analysis of fetal echocardiograms. While existing methods mainly focus on the four-chamber view with a small number of structures, here we present a more comprehensive deep learning segmentation framework covering 14 anatomical structures in both three-vessel trachea and four-chamber views. Specifically, our framework enhances the V-Net with spatial dropout, group normalization, and deep supervision to train a segmentation model that can be applied on both views regardless of abnormalities. By identifying the pitfall of using the Dice loss when some labels are unavailable in some images, this framework integrates information from multiple views and is robust to missing structures due to anatomical anomalies, achieving an average Dice score of 79%.

Report from the Finnish Cancer Registry.

Automatic Segmentation of Coronary Lumen and External Elastic Membrane in Intravascular Ultrasound Images Using 8-Layer U-Net

A Sparse Deep Learning Approach for Automatic Segmentation of Human Vasculature in Multispectral Optoacoustic Tomography

Evolution of a vision system by genetic algorithm

Label-free segmentation from cardiac ultrasound using self-supervised learning

Vascular Segmentation of Functional Ultrasound Images using Deep Learning

Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis

Deep learning-based detection of murine congenital heart defects from µCT scans

Extraction of volumetric indices from echocardiography: which deep learning solution for clinical use?

Deep-learning-based Image Segmentation for Image-based Computational Hemodynamic Analysis of Abdominal Aortic Aneurysms: A Comparison Study

Deep learning enables the fully automated quantification of high-resolution cardiac CT images: human in loop for model development

Assessment of Deep Learning Segmentation for Real-Time Free-Breathing Cardiac Magnetic Resonance Imaging at Rest and Under Exercise Stress

Does gel affect cytology or comfort in the screening papanicolaou smear?

An efficient annotated data generation method for echocardiographic image segmentation

Automated Segmentation and Quantification of the Right Ventricle in 2-D Echocardiography

Automatic Myocardial Segmentation by Using A Deep Learning Network in Cardiac MRI

DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal

Fully Automated Machine Learning Pipeline for Echocardiogram Segmentation

Topology-preserving segmentation of abdominal muscle layers from ultrasound images

Multiview and Multiclass Image Segmentation using Deep Learning in Fetal Echocardiography