Abstract:Background: Breast cancer is one of the most important malignant tumors among women causing a serious impact on women's lives and mammography is one the most important methods for breast examination. When diagnosing the breast disease, radiologists sometimes may consult some previous diagnosis cases as a reference. But there are many previous cases and it is important to find which cases are the similar cases, which is a big project costing lots of time. Medical image retrieval can provide objective reference information for doctors to diagnose disease. The method of fusing deep features can improve the retrieval accuracy, which solves the "semantic gap" problem caused by only using content features and location features. Methods: A similarity measure method combining deep feature for mammogram retrieval is proposed in this paper. First, the images are pre-processed to extract the low-level features, including content features and location features. Before extracting location features, registration with the standard image is performed. Then, the Convolutional Neural Network, the Stacked Auto-encoder Network, and the Deep Belief Network are built to extract the deep features, which are regarded as high-level features. Next, content similarity and deep similarity are calculated separately using the Euclidean distance between the query image and the dataset images. The location similarity is obtained by calculating the ratio of intersection to union of the mass regions. Finally, content similarity, location similarity, and deep similarity are fused to form the image fusion similarity. According to the similarity, the specified number of the most similar images can be returned. Results: In the experiment, 740 MLO mammograms are used, which are from women in Northeast China. The content similarity, location similarity, and deep similarity are fused by different weight coefficients. When only considering low-level features, the results are better with fusing 60% content feature similarity and 40% lesion location feature similarity. On this basis, CNN deep similarity, DBN deep similarity, and SAE deep similarity are fused separately. The experiments show that when fusing 60% DBN deep feature similarity and 40% low-level feature similarity, the results have obvious advantages. At this time, the precision is 0.745, recall is 0.850, comprehensive evaluation index is 0.794. Conclusions: We propose a similarity measure method fusing deep feature, content feature, and location feature. The retrieval results show that the precision and recall of this method have obvious advantage, compared with the content-based image retrieval and location-based image retrieval.

Multimode Retrieval of Breast Masses Based on Association Rules

Multimode Retrieval of Mammography Based on Association Rules

Mammographic Mass Retrieval Using Multi-view Information and Laplacian Score Feature Selection

Improved Mammographic Mass Retrieval Performance Using Multi-View Information

Mammogram retrieval combining visual semantic

A New Application of Multimodality Radiomics Improves Diagnostic Accuracy of Nonpalpable Breast Lesions in Patients with Microcalcifications-Only in Mammography

Mammogram retrieval through machine learning within BI-RADS standards.

Breast Masses Diagnosis Based on A Weighted Ensemble Framework for Group Semantic Feature Vectors (Wegav)

Mass Classification in Mammogram with Semi-Supervised Relief Based Feature Selection

Mass diagnosis in mammography with mutual information based feature selection and support vector machine

A technology research for diagnosis of mammographic masses based on content-based image retrieval]

A Semantic Image Retrieval Approach Between Visual Features and Medical Concepts

A Novel Classification Scheme for Breast Masses Based on Multi-View Information Fusion

Application of Association Rules for Medical Image Data Mining

Medical Image Retrieval Based on Low Level Feature and High Level Semantic Feature

Breast mass detection and diagnosis using fused features with density.

A similarity measure method fusing deep feature for mammogram retrieval

Diagnosis technology research of mammographic masses in content-based image retrieval

Multi-Features-Based Automated Breast Tumor Diagnosis Using Ultrasound Image and Support Vector Machine

Diagnosis of breast masses from dynamic contrast-enhanced and diffusion-weighted MR: a machine learning approach.

The Identification Of Breast Mass Based On Multi-Agent Interactive Information Fusion Method