Abstract:B-mode ultrasound-based computer-aided diagnosis model can help sonologists improve the diagnostic performance for liver cancers, but it generally suffers from the bottleneck due to the limited structure and internal echogenicity information in B-mode ultrasound images. Contrast-enhanced ultrasound images provide additional diagnostic information on dynamic blood perfusion of liver lesions for B-mode ultrasound images with improved diagnostic accuracy. Since transfer learning has indicated its effectiveness in promoting the performance of target computer-aided diagnosis model by transferring knowledge from related imaging modalities, a multi-view privileged information learning framework is proposed to improve the diagnostic accuracy of the single-modal B-mode ultrasound-based diagnosis for liver cancers. This framework can make full use of the shared label information between the paired B-mode ultrasound images and contrast-enhanced ultrasound images to guide knowledge transfer It consists of a novel supervised dual-view deep Boltzmann machine and a new deep multi-view SVM algorithm. The former is developed to implement knowledge transfer from the multi-phase contrast-enhanced ultrasound images to the B-mode ultrasound-based diagnosis model via a feature-level learning using privileged information paradigm, which is totally different from the existing learning using privileged information paradigm that performs knowledge transfer in the classifier. The latter further fuses and enhances feature representation learned from three pre-trained supervised dual-view deep Boltzmann machine networks for the classification task. An experiment is conducted on a bimodal ultrasound liver cancer dataset. The experimental results show that the proposed framework outperforms all the compared algorithms with the best classification accuracy of 88.91 ± 1.52%, sensitivity of 88.31 ± 2.02%, and specificity of 89.50 ± 3.12%. It suggests the effectiveness of our proposed MPIL framework for the BUS-based CAD of liver cancers.

Ultrasound-Based Diagnosis Of Breast Tumor With Parameter Transfer Multilayer Kernel Extreme Learning Machine

Doubly supervised parameter transfer classifier for diagnosis of breast cancer with imbalanced ultrasound imaging modalities

Parameter Transfer Deep Neural Network for Single-Modal B-Mode Ultrasound-Based Computer-Aided Diagnosis

B-mode ultrasound based CAD for liver cancers via multi-view privileged information learning

Multi-Source Transfer Learning Via Multi-Kernel Support Vector Machine Plus for B-Mode Ultrasound-Based Computer-Aided Diagnosis of Liver Cancers

Multimodal Ultrasound Imaging Based Diagnosis of Liver Cancers with a Two-Stage Multi-View Learning Framework.

[Application of Multiple Empirical Kernel Mapping Ensemble Classifier Based on Self-Paced Learning in Ultrasound-Based Computer-Aided Diagnosis for Breast Cancer].

Deep Doubly Supervised Transfer Network for Diagnosis of Breast Cancer with Imbalanced Ultrasound Imaging Modalities

Ensemble Transfer Learning of Elastography and B-mode Breast Ultrasound Images

BI-Modal Ultrasound Breast Cancer Diagnosis Via Multi-View Deep Neural Network SVM.

Multi-Features-Based Automated Breast Tumor Diagnosis Using Ultrasound Image and Support Vector Machine

Improving the diagnosis of breast cancer based on biophysical ultrasound features utilizing machine learning

Multi-View Feature Transformation Based SVM+ for Computer-Aided Diagnosis of Liver Cancers With Ultrasound Images

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Breast Lesion Diagnosis Using Static Images and Dynamic Video

Domain Knowledge-Guided Adversarial Adaptive Fusion of Hybrid Breast Ultrasound Data

B-Mode Ultrasound Based Diagnosis of Liver Cancer With CEUS Images as Privileged Information.

Automatic Identification of Breast Ultrasound Image Based on Supervised Block-Based Region Segmentation Algorithm and Features Combination Migration Deep Learning Model

B-mode ultrasound-based CAD by learning using privileged information with dual-level missing modality completion

Optimal deep transfer learning driven computer‐aided breast cancer classification using ultrasound images

3MT-Net: A Multi-modal Multi-task Model for Breast Cancer and Pathological Subtype Classification Based on a Multicenter Study