Accuracy and Efficacy of Artificial Intelligence-Derived Automatic Measurements of Transthoracic Echocardiography in Routine Clinical Practice

Noriko Shiokawa,Masaki Izumo,Toshio Shimamura,Yui Kurosaka,Yukio Sato,Takanori Okamura,Yoshihiro Johnny Akashi
DOI: https://doi.org/10.3390/jcm13071861
IF: 3.9
2024-03-25
Journal of Clinical Medicine
Abstract:Background: Transthoracic echocardiography (TTE) is the gold standard modality for evaluating cardiac morphology, function, and hemodynamics in clinical practice. While artificial intelligence (AI) is expected to contribute to improved accuracy and is being applied clinically, its impact on daily clinical practice has not been fully evaluated. Methods: We retrospectively examined 30 consecutive patients who underwent AI-equipped TTE at a single institution. All patients underwent manual and automatic measurements of TTE parameters using the AI-equipped TTE. Measurements were performed by three sonographers with varying experience levels: beginner, intermediate, and expert. Results: A comparison between the manual and automatic measurements assessed by the experts showed extremely high agreement in the left ventricular (LV) filling velocities (E wave: r = 0.998, A wave: r = 0.996; both p < 0.001). The automated measurements of LV end-diastolic and end-systolic diameters were slightly smaller (−2.41 mm and −1.19 mm) than the manual measurements, although without significant differences, and both methods showing high agreement (r = 0.942 and 0.977, both p < 0.001). However, LV wall thickness showed low agreement between the automated and manual measurements (septum: r = 0.670, posterior: r = 0.561; both p < 0.01), with automated measurements tending to be larger. Regarding interobserver variabilities, statistically significant agreement was observed among the measurements of expert, intermediate, and beginner sonographers for all the measurements. In terms of measurement time, automatic measurement significantly reduced measurement time compared to manual measurement (p < 0.001). Conclusions: This preliminary study confirms the accuracy and efficacy of AI-equipped TTE in routine clinical practice. A multicenter study with a larger sample size is warranted.
medicine, general & internal
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the accuracy and efficiency of artificial intelligence (AI) - assisted automatic measurement techniques in performing transthoracic echocardiography (TTE) examinations in routine clinical practice. Specifically, the researchers hope to compare the accuracy, measurement time, and measurement consistency among operators with different experience levels between AI - assisted automatic measurement and manual measurement in TTE parameter measurement. ### Research Background - **Importance of TTE**: TTE is the gold - standard modality for evaluating cardiac morphology, function, and hemodynamics in clinical practice and is widely used because of its high cost - effectiveness and low invasiveness. - **Application Prospects of AI**: Although AI is expected to improve the accuracy of measurement and has been applied in clinical practice, its impact on daily clinical practice has not been fully evaluated. ### Research Objectives - **Compare Accuracy**: Compare the accuracy between AI - assisted automatic measurement and manual measurement in TTE parameter measurement. - **Evaluate Time Efficiency**: Evaluate whether AI - assisted automatic measurement can significantly reduce the measurement time. - **Analyze Inter - Operator Consistency**: Analyze the consistency among operators with different experience levels between manual and automatic measurements. ### Research Methods - **Study Population**: A retrospective analysis was performed on 30 patients who underwent AI - assisted TTE examinations in a single institution. - **Measurement Parameters**: These include left ventricular end - diastolic diameter (LVDd), left ventricular end - systolic diameter (LVDs), interventricular septal thickness (IVS), left ventricular posterior wall thickness (LVPW), mitral inflow velocities (E - wave and A - wave), deceleration time (DT), tissue Doppler measurements (e' - wave and a' - wave), velocity - time integral (VTI) and peak velocity in the left ventricular outflow tract (LVOT), etc. - **Manual and Automatic Measurements**: All parameters were measured manually and automatically, and repeated measurements were carried out by operators with different experience levels to evaluate consistency. - **Statistical Analysis**: The Spearman rank correlation coefficient and Bland - Altman method were used to analyze the errors between manual and automatic measurements, and the Wilcoxon signed - rank sum test was used to analyze the measurement time. ### Main Findings - **Accuracy**: - For LVDd and LVDs, the automatic measurement values were slightly smaller than the manual measurement values, but the two were highly consistent (LVDd: \( r = 0.942 \), LVDs: \( r = 0.977 \), both \( p < 0.001 \)). - For IVS and LVPW, the correlation between the automatic measurement values and the manual measurement values was lower (IVS: \( r = 0.670 \), LVPW: \( r = 0.561 \), both \( p < 0.01 \)), and the automatic measurement values tended to measure thicker wall thicknesses. - For the mitral inflow velocities of the E - wave and A - wave, the automatic measurement was highly consistent with the manual measurement (E - wave: \( r = 0.998 \), A - wave: \( r = 0.996 \), both \( p < 0.001 \)). - **Time Efficiency**: Automatic measurement significantly reduced the measurement time, especially for beginners and experts (beginners: manual measurement \( 121.5 \) seconds vs. automatic measurement \( 89.0 \) seconds, \( p < 0.001 \); experts: manual measurement \( 81.5 \) seconds vs. automatic measurement \( 59.0 \) seconds, \( p < 0.001 \)). - **Inter - Operator Consistency**: Operators with different experience levels showed high consistency between manual and automatic measurements, especially in the measurement of LVDd and LVDs (beginners and intermediate users: \( r = 0.92 \)). ### Conclusion Preliminary studies have shown that AI - assisted automatic measurement techniques have high accuracy and time efficiency in routine clinical practice. Future multi - center studies with larger sample sizes are needed to further verify these results.