Etiopathogenesis of the gouty arthritis.

J. Scott,L. Hiisi-Brummer

Abstract:

What problem does this paper attempt to address?

Multi-task Learning for Motion Analysis and Segmentation in 3D Echocardiography

Kevinminh Ta,Shawn S. Ahn,Stephanie L. Thorn,John C. Stendahl,Xiaoran Zhang,Jonathan Langdon,Lawrence H. Staib,Albert J. Sinusas,James S. Duncan

DOI: https://doi.org/10.1109/tmi.2024.3355383

IF: 10.6

2024-01-01

IEEE Transactions on Medical Imaging

Abstract:Characterizing left ventricular deformation and strain using 3D+time echocardiography provides useful insights into cardiac function and can be used to detect and localize myocardial injury. To achieve this, it is imperative to obtain accurate motion estimates of the left ventricle. In many strain analysis pipelines, this step is often accompanied by a separate segmentation step; however, recent works have shown both tasks to be highly related and can be complementary when optimized jointly. In this work, we present a multi-task learning network that can simultaneously segment the left ventricle and track its motion between multiple time frames. Two task-specific networks are trained using a composite loss function. Cross-stitch units combine the activations of these networks by learning shared representations between the tasks at different levels. We also propose a novel shape-consistency unit that encourages motion propagated segmentations to match directly predicted segmentations. Using a combined synthetic and in-vivo 3D echocardiography dataset, we demonstrate that our proposed model can achieve excellent estimates of left ventricular motion displacement and myocardial segmentation. Additionally, we observe strong correlation of our image-based strain measurements with crystal-based strain measurements as well as good correspondence with SPECT perfusion mappings. Finally, we demonstrate the clinical utility of the segmentation masks in estimating ejection fraction and sphericity indices that correspond well with benchmark measurements.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

Ming Li,Weiwei Zhang,Guang Yang,Chengjia Wang,Heye Zhang,Huafeng Liu,Wei Zheng,Shuo Li

DOI: https://doi.org/10.1007/978-3-030-32245-8_75

2019-01-01

Abstract:Multi-view echocardiographic sequences segmentation is crucial for clinical diagnosis. However, this task is challenging due to limited labeled data, huge noise, and large gaps across views. Here we propose a recurrent aggregation learning method to tackle this challenging task. By pyramid ConvBlocks, multi-level and multi-scale features are extracted efficiently. Hierarchical ConvLSTMs next fuse these features and capture spatial-temporal information in multi-level and multi-scale space. We further introduce a double-branch aggregation mechanism for segmentation and classification which are mutually promoted by deep aggregation of multi-level and multi-scale features. The segmentation branch provides information to guide the classification while the classification branch affords multi-view regularization to refine segmentations and further lessen gaps across views. Our method is built as an end-to-end framework for segmentation and classification. Adequate experiments on our multi-view dataset (9000 labeled images) and the CAMUS dataset (1800 labeled images) corroborate that our method achieves not only superior segmentation and classification accuracy but also prominent temporal stability.
Automatic biplane left ventricular ejection fraction estimation with mobile point-of-care ultrasound using multi-task learning and adversarial training

Mohammad H. Jafari,Hany Girgis,Nathan Van Woudenberg,Zhibin Liao,Robert Rohling,Ken Gin,Purang Abolmaesumi,Terasa Tsang

DOI: https://doi.org/10.1007/s11548-019-01954-w

2019-04-02

International Journal of Computer Assisted Radiology and Surgery

Abstract:Left ventricular ejection fraction (LVEF) is one of the key metrics to assess the heart functionality, and cardiac ultrasound (echo) is a standard imaging modality for EF measurement. There is an emerging interest to exploit the point-of-care ultrasound (POCUS) usability due to low cost and ease of access. In this work, we aim to present a computationally efficient mobile application for accurate LVEF estimation.Our proposed mobile application for LVEF estimation runs in real time on Android mobile devices that have either a wired or wireless connection to a cardiac POCUS device. We propose a pipeline for biplane ejection fraction estimation using apical two-chamber (AP2) and apical four-chamber (AP4) echo views. A computationally efficient multi-task deep fully convolutional network is proposed for simultaneous LV segmentation and landmark detection in these views, which is integrated into the LVEF estimation pipeline. An adversarial critic model is used in the training phase to impose a shape prior on the LV segmentation output.The system is evaluated on a dataset of 427 patients. Each patient has a pair of captured AP2 and AP4 echo studies, resulting in a total of more than 40,000 echo frames. The mobile system reaches a noticeably high average Dice score of 92% for LV segmentation, an average Euclidean distance error of 2.85 pixels for the detection of anatomical landmarks used in LVEF calculation, and a median absolute error of 6.2% for LVEF estimation compared to the expert cardiologist's annotations and measurements.The proposed system runs in real time on mobile devices. The experiments show the effectiveness of the proposed system for automatic LVEF estimation by demonstrating an adequate correlation with the cardiologist's examination.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
A Simultaneous Framework for Recovering Three Dimensional Shape and Nonrigid Motion from Cardiac Image Sequences

Ling Zhuang,Huafeng Liu,Xiao Liang,Hujun Bao,Hongjie Hu,Pengcheng Shi

DOI: https://doi.org/10.1109/iembs.2005.1615789

2005-01-01

Abstract:Quantitative assessment of the shape and motion variability of the heart has important implications for the diagnosis and treatment of cardiac diseases. In this paper, we present a unified methodology which simultaneously recovers the shape and motion of the left ventricle, including the endo-, epi-, and mid-wall myocardium. The left ventricle is modeled as an isotropic linear elastic material, and represented by volumetric mesh constructed from the Delaunay triangulation of the sampling points. Specifically, the evolution forces imposed on the myocardium are individually constructed for each nodal point through the integration of the data-driven edginess measures, the prior spatial distributions of the myocardial tissues, the temporal coherence of the image-derived salient features, and the cyclic motion characteristics of the heart. The dense displacement field can then be estimated when the total energy of the elastic body is minimized at equilibrium. Experiments on 3D human magnetic resonance image sequences of healthy and pathological subjects show the accuracy and robustness of the strategy
M(otion)-mode Based Prediction of Ejection Fraction using Echocardiograms

Ece Ozkan,Thomas M. Sutter,Yurong Hu,Sebastian Balzer,Julia E. Vogt

2023-09-07

Abstract:Early detection of cardiac dysfunction through routine screening is vital for diagnosing cardiovascular diseases. An important metric of cardiac function is the left ventricular ejection fraction (EF), where lower EF is associated with cardiomyopathy. Echocardiography is a popular diagnostic tool in cardiology, with ultrasound being a low-cost, real-time, and non-ionizing technology. However, human assessment of echocardiograms for calculating EF is time-consuming and expertise-demanding, raising the need for an automated approach. In this work, we propose using the M(otion)-mode of echocardiograms for estimating the EF and classifying cardiomyopathy. We generate multiple artificial M-mode images from a single echocardiogram and combine them using off-the-shelf model architectures. Additionally, we extend contrastive learning (CL) to cardiac imaging to learn meaningful representations from exploiting structures in unlabeled data allowing the model to achieve high accuracy, even with limited annotations. Our experiments show that the supervised setting converges with only ten modes and is comparable to the baseline method while bypassing its cumbersome training process and being computationally much more efficient. Furthermore, CL using M-mode images is helpful for limited data scenarios, such as having labels for only 200 patients, which is common in medical applications.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
EFNet: A multitask deep learning network for simultaneous quantification of left ventricle structure and function

Samana Batool,Imtiaz Ahmad Taj,Mubeen Ghafoor

DOI: https://doi.org/10.1016/j.ejmp.2024.104505

2024-08-28

Abstract:Purpose: The purpose of this study is to develop an automated method using deep learning for the reliable and precise quantification of left ventricle structure and function from echocardiogram videos, eliminating the need to identify end-systolic and end-diastolic frames. This addresses the variability and potential inaccuracies associated with manual quantification, aiming to improve the diagnosis and management of cardiovascular conditions. Methods: A single, fully automated multitask network, the EchoFused Network (EFNet) is introduced that simultaneously addresses both left ventricle segmentation and ejection fraction estimation tasks through cross-module fusion. Our proposed approach utilizes semi-supervised learning to estimate the ejection fraction from the entire cardiac cycle, yielding more dependable estimations and obviating the need to identify specific frames. To facilitate joint optimization, the losses from task-specific modules are combined using a normalization technique, ensuring commensurability on a comparable scale. Results: The assessment of the proposed model on a publicly available dataset, EchoNet-Dynamic, shows significant performance improvement, achieving an MAE of 4.35% for ejection fraction estimation and DSC values of 0.9309 (end-diastolic) and 0.9135 (end-systolic) for left ventricle segmentation. Conclusions: The study demonstrates the efficacy of EFNet, a multitask deep learning network, in simultaneously quantifying left ventricle structure and function through cross-module fusion on echocardiogram data.
CardiacField: Computational Echocardiography for Automated Heart Function Estimation Using Two-Dimensional Echocardiography Probes

Chengkang Shen,Hao Zhu,You Zhou,Yu Liu,Si Yi,Lili Dong,Weipeng Zhao,David J. Brady,Xun Cao,Zhan Ma,Yi Lin

DOI: https://doi.org/10.1093/ehjdh/ztae072

2024-01-01

European Heart Journal - Digital Health

Abstract:Aims Accurate heart function estimation is vital for detecting and monitoring cardiovascular diseases. While two-dimensional echocardiography (2DE) is widely accessible and used, it requires specialized training, is prone to inter-observer variability, and lacks comprehensive three-dimensional (3D) information. We introduce CardiacField, a computational echocardiography system using a 2DE probe for precise, automated left ventricular (LV) and right ventricular (RV) ejection fraction (EF) estimations, which is especially easy to use for non-cardiovascular healthcare practitioners. We assess the system's usability among novice users and evaluate its performance against expert interpretations and advanced deep learning (DL) tools. Methods and results We developed an implicit neural representation network to reconstruct a 3D cardiac volume from sequential multi-view 2DE images, followed by automatic segmentation of LV and RV areas to calculate volume sizes and EF values. Our study involved 127 patients to assess EF estimation accuracy against expert readings and two-dimensional (2D) video-based DL models. A subset of 56 patients was utilized to evaluate image quality and 3D accuracy and another 50 to test usability by novice users and across various ultrasound machines. CardiacField generated a 3D heart from 2D echocardiograms with <2 min processing time. The LVEF predicted by our method had a mean absolute error (MAE) of 2.48%, while the RVEF had an MAE of 2.65%. Conclusion Employing a straightforward apical ring scan with a cost-effective 2DE probe, our method achieves a level of EF accuracy for assessing LV and RV function that is comparable to that of three-dimensional echocardiography probes. [GRAPHICS] .
Simultaneous Right Ventricle End-diastolic and End-systolic Frame Identification and Landmark Detection on Echocardiography

Zhaohui Wang,Jun Shi,Xiaoyu Hao,Ke Wen,Xu Jin,Hong An

DOI: https://doi.org/10.1109/EMBC46164.2021.9630310

2021-01-01

Abstract:End-diastolic (ED) and end-systolic (ES) frame identification and landmark detection are crucial steps of estimating right ventricle function in clinic practice. However, the complex morphology of the right ventricle and low-quality echocardiography pose challenges to these tasks. This study proposes a multi-task learning (MTL) framework to simultaneously identify the right ventricle ED and ES frames and detect anatomical landmarks for echocardiography. The framework contains an encoder and two branches: frame-branch and landmark-branch. The convolution neural network (CNN) encoder is employed for extracting the shared features of two branches. The frame-branch is built with a recurrent neural network (RNN) to select ED and ES frames. A heatmap-based model is used as the landmark-branch to detect the landmarks. Furthermore, instead of directly regressing the indexes of ED/ES frames, we form the frame identification as a curve regression problem, which achieves considerable performance. Experiments performed on the echocardiography dataset of 105 patients validate the effectiveness of the proposed approach, which leads to the average frame difference of 1.59 (+/- 1.34) frames (ED) and 1.56 (+/- 1.35) frames (ES) on the frame identification task, and the percentage of correctly predicted landmarks is 83.3%. These results demonstrated that our method outperforms most existing methods.
Simultaneous segmentation and motion recovery in 3d cardiac image analysis

Ling Zhuang,Huafeng Liu,Wei Chen,Hujun Bao,Pengcheng Shi

DOI: https://doi.org/10.1007/11569541_50

2005-01-01

Abstract:Accurate and robust estimation of the three-dimensional left ventricular geometry and deformation has important clinical implications for better diagnosis and understanding of ischemic heart diseases. So far, most image analysis efforts have performed the shape recovery and the motion tracking tasks in separate steps, typically in sequential fashion. In this paper, we present a continuum biomechanics model based framework that performs simultaneous segmentation and motion analysis of the left ventricle from 3D image sequences, achieved through the tracking of the spatiotemporal evolution of a 3D active region model driven by imaging data, statistical priors of the left ventricular boundaries, and cyclic motion models of the myocardial tissue elements. Experiments on 3D canine and human MR image sequences have shown the superiority of the strategy.
An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography

Ziyu Guo,Yuting Zhang,Zishan Qiu,Suyu Dong,Shan He,Huan Gao,Jinao Zhang,Yingtao Chen,Bingtao He,Zhe Kong,Zhaowen Qiu,Yan Li,Caijuan Li

DOI: https://doi.org/10.3389/fcvm.2023.1266260

IF: 3.6

2023-09-22

Frontiers in Cardiovascular Medicine

Abstract:Cardiac diseases have high mortality rates and are a significant threat to human health. Echocardiography is a commonly used imaging technique to diagnose cardiac diseases because of its portability, non-invasiveness and low cost. Precise segmentation of basic cardiac structures is crucial for cardiologists to efficiently diagnose cardiac diseases, but this task is challenging due to several reasons, such as: (1) low image contrast, (2) incomplete structures of cardiac, and (3) unclear border between the ventricle and the atrium in some echocardiographic images. In this paper, we applied contrastive learning strategy and proposed a semi-supervised method for echocardiographic images segmentation. This proposed method solved the above challenges effectively and made use of unlabeled data to achieve a great performance, which could help doctors improve the accuracy of CVD diagnosis and screening. We evaluated this method on a public dataset (CAMUS), achieving mean Dice Similarity Coefficient (DSC) of 0.898, 0.911, 0.916 with 1/4, 1/2 and full labeled data on two-chamber (2CH) echocardiography images, and of 0.903, 0.921, 0.928 with 1/4, 1/2 and full labeled data on four-chamber (4CH) echocardiography images. Compared with other existing methods, the proposed method had fewer parameters and better performance. The code and models are available at https://github.com/gpgzy/CL-Cardiac-segmentation.

cardiac & cardiovascular systems
A Unified Framework Integrating Recurrent Fully-Convolutional Networks and Optical Flow for Segmentation of the Left Ventricle in Echocardiography Data

Mohammad H. Jafari,Hany Girgis,Zhibin Liao,Delaram Behnami,Amir Abdi,Hooman Vaseli,Christina Luong,Robert Rohling,Ken Gin,Terasa Tsang,Purang Abolmaesumi

DOI: https://doi.org/10.1007/978-3-030-00889-5_4

2018-01-01

Abstract:Accurate segmentation of left ventricle (LV) from echocardiograms is a key step toward diagnosis of cardiovascular diseases. Manual segmentation of the LV done by sonographers or cardiologists can be time-consuming, and its accuracy is subjective to the operator’s experience and skill level. Automation of LV segmentation is a challenging task due to a number of factors such as the presence of speckle and a high operator-dependent variability in acquiring echocardiography data. In this paper, we present a method that integrates deep recurrent fully-convolutional networks and optical flow estimation to accurately segment the LV in the apical four-chamber (A4C) view. Our method analyzes the temporal information in echocardiogram cines with the use of convolutional bi-directional long short-term memory units. Furthermore, it uses optical flow motion estimation between consecutive frames to improve the segmentation accuracy. The proposed method is evaluated over an echo cine dataset of 566 patients. Experiments show that the proposed system can reach a noticeably high mean accuracy of 97.9%, and mean Dice score of 92.7% for LV segmentation in A4C view.
A Shape-Consistent Deep-Learning Segmentation Architecture for Low-Quality and High-Interference Myocardial Contrast Echocardiography

Rongpu Cui,Shichu Liang,Weixin Zhao,Zhiyue Liu,Zhicheng Lin,Wenfeng He,Yujun He,Chaohui Du,Jian Peng,He Huang

DOI: https://doi.org/10.1016/j.ultrasmedbio.2024.06.001

2024-08-14

Abstract:Objective: Myocardial contrast echocardiography (MCE) plays a crucial role in diagnosing ischemia, infarction, masses and other cardiac conditions. In the realm of MCE image analysis, accurate and consistent myocardial segmentation results are essential for enabling automated analysis of various heart diseases. However, current manual diagnostic methods in MCE suffer from poor repeatability and limited clinical applicability. MCE images often exhibit low quality and high noise due to the instability of ultrasound signals, while interference structures can further disrupt segmentation consistency. Methods: To overcome these challenges, we proposed a deep-learning network for the segmentation of MCE. This architecture leverages dilated convolutions to capture high-scale information without sacrificing positional accuracy and modifies multi-head self-attention to enhance global context and ensure consistency, effectively overcoming issues related to low image quality and interference. Furthermore, we also adapted the cascade application of transformers with convolutional neural networks for improved segmentation in MCE. Results: In our experiments, our architecture achieved the best Dice score of 84.35% for standard MCE views compared with that of several state-of-the-art segmentation models. For non-standard views and frames with interfering structures (mass), our models also attained the best Dice scores of 83.33% and 83.97%, respectively. Conclusion: These studies proved that our architecture is of excellent shape consistency and robustness, which allows it to deal with segmentation of various types of MCE. Our relatively precise and consistent myocardial segmentation results provide fundamental conditions for the automated analysis of various heart diseases, with the potential to discover underlying pathological features and reduce healthcare costs.
Cardiac Segmentation Method Based on Domain Knowledge.

Yingni Wang,Wenbin Chen,Tianhong Tang,Wenquan Xie,Yong Jiang,Huabin Zhang,Xiaobo Zhou,Kehong Yuan

DOI: https://doi.org/10.1177/01617346221099435

IF: 2

2022-01-01

Ultrasonic Imaging

Abstract:Echocardiography plays an important role in the clinical diagnosis of cardiovascular diseases. Cardiac function assessment by echocardiography is a crucial process in daily cardiology. However, cardiac segmentation in echocardiography is a challenging task due to shadows and speckle noise. The traditional manual segmentation method is a time-consuming process and limited by inter-observer variability. In this paper, we present a fast and accurate echocardiographic automatic segmentation framework based on Convolutional neural networks (CNN). We propose FAUet, a segmentation method serially integrated U-Net with coordinate attention mechanism and domain feature loss from VGG19 pre-trained on the ImageNet dataset. The coordinate attention mechanism can capture long-range dependencies along one spatial direction and meanwhile preserve precise positional information along the other spatial direction. And the domain feature loss is more concerned with the topology of cardiac structures by exploiting their higher-level features. In this research, we use a two-dimensional echocardiogram (2DE) of 88 patients from two devices, Philips Epiq 7C and Mindray Resona 7T, to segment the left ventricle (LV), interventricular septal (IVS), and posterior left ventricular wall (PLVW). We also draw the gradient weighted class activation mapping (Grad-CAM) to improve the interpretability of the segmentation results. Compared with the traditional U-Net, the proposed segmentation method shows better performance. The mean Dice Score Coefficient (Dice) of LV, IVS, and PLVW of FAUet can achieve 0.932, 0.848, and 0.868, and the average Dice of the three objects can achieve 0.883. Statistical analysis showed that there is no significant difference between the segmentation results of the two devices. The proposed method can realize fast and accurate segmentation of 2DE with a low time cost. Combining coordinate attention module and feature loss with the original U-Net framework can significantly increase the performance of the algorithm.
DDSB: An Unsupervised and Training-free Method for Phase Detection in Echocardiography

Zhenyu Bu,Yang Liu,Jiayu Huo,Jingjing Peng,Kaini Wang,Guangquan Zhou,Rachel Sparks,Prokar Dasgupta,Alejandro Granados,Sebastien Ourselin

2024-03-19

Abstract:Accurate identification of End-Diastolic (ED) and End-Systolic (ES) frames is key for cardiac function assessment through echocardiography. However, traditional methods face several limitations: they require extensive amounts of data, extensive annotations by medical experts, significant training resources, and often lack robustness. Addressing these challenges, we proposed an unsupervised and training-free method, our novel approach leverages unsupervised segmentation to enhance fault tolerance against segmentation inaccuracies. By identifying anchor points and analyzing directional deformation, we effectively reduce dependence on the accuracy of initial segmentation images and enhance fault tolerance, all while improving robustness. Tested on Echo-dynamic and CAMUS datasets, our method achieves comparable accuracy to learning-based models without their associated drawbacks. The code is available at

Computer Vision and Pattern Recognition
Echocardiography Segmentation with Enforced Temporal Consistency

Nathan Painchaud,Nicolas Duchateau,Olivier Bernard,Pierre-Marc Jodoin

DOI: https://doi.org/10.1109/TMI.2022.3173669

2022-05-06

Abstract:Convolutional neural networks (CNN) have demonstrated their ability to segment 2D cardiac ultrasound images. However, despite recent successes according to which the intra-observer variability on end-diastole and end-systole images has been reached, CNNs still struggle to leverage temporal information to provide accurate and temporally consistent segmentation maps across the whole cycle. Such consistency is required to accurately describe the cardiac function, a necessary step in diagnosing many cardiovascular diseases. In this paper, we propose a framework to learn the 2D+time apical long-axis cardiac shape such that the segmented sequences can benefit from temporal and anatomical consistency constraints. Our method is a post-processing that takes as input segmented echocardiographic sequences produced by any state-of-the-art method and processes it in two steps to (i) identify spatio-temporal inconsistencies according to the overall dynamics of the cardiac sequence and (ii) correct the inconsistencies. The identification and correction of cardiac inconsistencies relies on a constrained autoencoder trained to learn a physiologically interpretable embedding of cardiac shapes, where we can both detect and fix anomalies. We tested our framework on 98 full-cycle sequences from the CAMUS dataset, which are available alongside this paper. Our temporal regularization method not only improves the accuracy of the segmentation across the whole sequences, but also enforces temporal and anatomical consistency.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
TAN: Temporal Affine Network for Real-Time Left Ventricle Anatomical Structure Analysis Based on 2D Ultrasound Videos

Sihong Chen,Kai Ma,Yefeng Zheng

DOI: https://doi.org/10.48550/arXiv.1904.00631

2019-04-01

Computer Vision and Pattern Recognition

Abstract:With superiorities on low cost, portability, and free of radiation, echocardiogram is a widely used imaging modality for left ventricle (LV) function quantification. However, automatic LV segmentation and motion tracking is still a challenging task. In addition to fuzzy border definition, low contrast, and abounding artifacts on typical ultrasound images, the shape and size of the LV change significantly in a cardiac cycle. In this work, we propose a temporal affine network (TAN) to perform image analysis in a warped image space, where the shape and size variations due to the cardiac motion as well as other artifacts are largely compensated. Furthermore, we perform three frequent echocardiogram interpretation tasks simultaneously: standard cardiac plane recognition, LV landmark detection, and LV segmentation. Instead of using three networks with one dedicating to each task, we use a multi-task network to perform three tasks simultaneously. Since three tasks share the same encoder, the compact network improves the segmentation accuracy with more supervision. The network is further finetuned with optical flow adjusted annotations to enhance motion coherence in the segmentation result. Experiments on 1,714 2D echocardiographic sequences demonstrate that the proposed method achieves state-of-the-art segmentation accuracy with real-time efficiency.
EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiography

Rand Muhtaseb,Mohammad Yaqub

DOI: https://doi.org/10.48550/arXiv.2209.04242

2022-09-09

Computer Vision and Pattern Recognition

Abstract:Learning spatiotemporal features is an important task for efficient video understanding especially in medical images such as echocardiograms. Convolutional neural networks (CNNs) and more recent vision transformers (ViTs) are the most commonly used methods with limitations per each. CNNs are good at capturing local context but fail to learn global information across video frames. On the other hand, vision transformers can incorporate global details and long sequences but are computationally expensive and typically require more data to train. In this paper, we propose a method that addresses the limitations we typically face when training on medical video data such as echocardiographic scans. The algorithm we propose (EchoCoTr) utilizes the strength of vision transformers and CNNs to tackle the problem of estimating the left ventricular ejection fraction (LVEF) on ultrasound videos. We demonstrate how the proposed method outperforms state-of-the-art work to-date on the EchoNet-Dynamic dataset with MAE of 3.95 and $R^2$ of 0.82. These results show noticeable improvement compared to all published research. In addition, we show extensive ablations and comparisons with several algorithms, including ViT and BERT. The code is available at https://github.com/BioMedIA-MBZUAI/EchoCoTr.
A multi-task deep learning approach for real-time view classification and quality assessment of echocardiographic images

Xinyu Li,Hongmei Zhang,Jing Yue,Lixue Yin,Wenhua Li,Geqi Ding,Bo Peng,Shenghua Xie

DOI: https://doi.org/10.1038/s41598-024-71530-z

IF: 4.6

2024-09-04

Scientific Reports

Abstract:High-quality standard views in two-dimensional echocardiography are essential for accurate cardiovascular disease diagnosis and treatment decisions. However, the quality of echocardiographic images is highly dependent on the practitioner's experience. Ensuring timely quality control of echocardiographic images in the clinical setting remains a significant challenge. In this study, we aimed to propose new quality assessment criteria and develop a multi-task deep learning model for real-time multi-view classification and image quality assessment (six standard views and "others"). A total of 170,311 echocardiographic images collected between 2015 and 2022 were utilized to develop and evaluate the model. On the test set, the model achieved an overall classification accuracy of 97.8% (95%CI 97.7–98.0) and a mean absolute error of 6.54 (95%CI 6.43–6.66). A single-frame inference time of 2.8 ms was achieved, meeting real-time requirements. We also analyzed pre-stored images from three distinct groups of echocardiographers (junior, senior, and expert) to evaluate the clinical feasibility of the model. Our multi-task model can provide objective, reproducible, and clinically significant view quality assessment results for echocardiographic images, potentially optimizing the clinical image acquisition process and improving AI-assisted diagnosis accuracy.

multidisciplinary sciences
Development of automated neural network prediction for echocardiographic left ventricular ejection fraction

Yuting Zhang,Boyang Liu,Karina V. Bunting,David Brind,Alexander Thorley,Andreas Karwath,Wenqi Lu,Diwei Zhou,Xiaoxia Wang,Alastair R. Mobley,Otilia Tica,Georgios V. Gkoutos,Dipak Kotecha,Jinming Duan

DOI: https://doi.org/10.3389/fmed.2024.1354070

IF: 3.9

2024-04-03

Frontiers in Medicine

Abstract:Introduction The echocardiographic measurement of left ventricular ejection fraction (LVEF) is fundamental to the diagnosis and classification of patients with heart failure (HF). Methods This paper aimed to quantify LVEF automatically and accurately with the proposed pipeline method based on deep neural networks and ensemble learning. Within the pipeline, an Atrous Convolutional Neural Network (ACNN) was first trained to segment the left ventricle (LV), before employing the area-length formulation based on the ellipsoid single-plane model to calculate LVEF values. This formulation required inputs of LV area, derived from segmentation using an improved Jeffrey’s method, as well as LV length, derived from a novel ensemble learning model. To further improve the pipeline’s accuracy, an automated peak detection algorithm was used to identify end-diastolic and end-systolic frames, avoiding issues with human error. Subsequently, single-beat LVEF values were averaged across all cardiac cycles to obtain the final LVEF. Results This method was developed and internally validated in an open-source dataset containing 10,030 echocardiograms. The Pearson’s correlation coefficient was 0.83 for LVEF prediction compared to expert human analysis ( p < 0.001), with a subsequent area under the receiver operator curve (AUROC) of 0.98 (95% confidence interval 0.97 to 0.99) for categorisation of HF with reduced ejection (HFrEF; LVEF<40%). In an external dataset with 200 echocardiograms, this method achieved an AUC of 0.90 (95% confidence interval 0.88 to 0.91) for HFrEF assessment. Conclusion The automated neural network-based calculation of LVEF is comparable to expert clinicians performing time-consuming, frame-by-frame manual evaluations of cardiac systolic function.

medicine, general & internal

Etiopathogenesis of the gouty arthritis.

Multi-task Learning for Motion Analysis and Segmentation in 3D Echocardiography

Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

Automatic biplane left ventricular ejection fraction estimation with mobile point-of-care ultrasound using multi-task learning and adversarial training

A Simultaneous Framework for Recovering Three Dimensional Shape and Nonrigid Motion from Cardiac Image Sequences

M(otion)-mode Based Prediction of Ejection Fraction using Echocardiograms

EFNet: A multitask deep learning network for simultaneous quantification of left ventricle structure and function

CardiacField: Computational Echocardiography for Automated Heart Function Estimation Using Two-Dimensional Echocardiography Probes

Simultaneous Right Ventricle End-diastolic and End-systolic Frame Identification and Landmark Detection on Echocardiography

Simultaneous segmentation and motion recovery in 3d cardiac image analysis

An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography

A Unified Framework Integrating Recurrent Fully-Convolutional Networks and Optical Flow for Segmentation of the Left Ventricle in Echocardiography Data

A Shape-Consistent Deep-Learning Segmentation Architecture for Low-Quality and High-Interference Myocardial Contrast Echocardiography

Cardiac Segmentation Method Based on Domain Knowledge.

DDSB: An Unsupervised and Training-free Method for Phase Detection in Echocardiography

Echocardiography Segmentation with Enforced Temporal Consistency

TAN: Temporal Affine Network for Real-Time Left Ventricle Anatomical Structure Analysis Based on 2D Ultrasound Videos

EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiography

A multi-task deep learning approach for real-time view classification and quality assessment of echocardiographic images

Development of automated neural network prediction for echocardiographic left ventricular ejection fraction