Abstract:Background: Breast cancer is one of the most important malignant tumors among women causing a serious impact on women's lives and mammography is one the most important methods for breast examination. When diagnosing the breast disease, radiologists sometimes may consult some previous diagnosis cases as a reference. But there are many previous cases and it is important to find which cases are the similar cases, which is a big project costing lots of time. Medical image retrieval can provide objective reference information for doctors to diagnose disease. The method of fusing deep features can improve the retrieval accuracy, which solves the "semantic gap" problem caused by only using content features and location features. Methods: A similarity measure method combining deep feature for mammogram retrieval is proposed in this paper. First, the images are pre-processed to extract the low-level features, including content features and location features. Before extracting location features, registration with the standard image is performed. Then, the Convolutional Neural Network, the Stacked Auto-encoder Network, and the Deep Belief Network are built to extract the deep features, which are regarded as high-level features. Next, content similarity and deep similarity are calculated separately using the Euclidean distance between the query image and the dataset images. The location similarity is obtained by calculating the ratio of intersection to union of the mass regions. Finally, content similarity, location similarity, and deep similarity are fused to form the image fusion similarity. According to the similarity, the specified number of the most similar images can be returned. Results: In the experiment, 740 MLO mammograms are used, which are from women in Northeast China. The content similarity, location similarity, and deep similarity are fused by different weight coefficients. When only considering low-level features, the results are better with fusing 60% content feature similarity and 40% lesion location feature similarity. On this basis, CNN deep similarity, DBN deep similarity, and SAE deep similarity are fused separately. The experiments show that when fusing 60% DBN deep feature similarity and 40% low-level feature similarity, the results have obvious advantages. At this time, the precision is 0.745, recall is 0.850, comprehensive evaluation index is 0.794. Conclusions: We propose a similarity measure method fusing deep feature, content feature, and location feature. The retrieval results show that the precision and recall of this method have obvious advantage, compared with the content-based image retrieval and location-based image retrieval.

Similarity Measurement of Lung Masses for Medical Image Retrieval Using Kernel Based Semisupervised Distance Metric

A Novel Similarity Learning Method Via Relative Comparison for Content-Based Medical Image Retrieval

A Novel Marker-Less Lung Tumor Localization Strategy on Low-Rank Fluoroscopic Images with Similarity Learning

A Multi-Level Similarity Measure for the Retrieval of the Common CT Imaging Signs of Lung Diseases

A similarity computing algorithm for volumetric data sets

Mutual Information Based Feature Selection for Medical Image Retrieval

A New Method of Content Based Medical Image Retrieval and Its Applications to CT Imaging Sign Retrieval.

Differentiation of Pulmonary Mucosa-Associated Lymphoid Tissue Lymphoma and Pulmonary Adenocarcinoma by Radiomics

Triplet Contents based Medical Image Retrieval System for Lung Nodules CT Images Retrieval and Recognition Application

A similarity measure method fusing deep feature for mammogram retrieval

Mammogram retrieval through machine learning within BI-RADS standards.

Evaluation of retrieval accuracy and visual similarity in content-based image retrieval of chest CT for obstructive lung disease

Predictive Modeling of Human Perception Subjectivity: Feasibility Study of Mammographic Lesion Similarity

Computer-aided Detection of Mammographic Masses Based on Content-Based Image Retrieval

Pairwise Latent Semantic Association for Similarity Computation Inmedical Imaging

Radon Features and Barcodes for Medical Image Retrieval via SVM

Medical Image Retrieval System Using Multiple Features from 3d Rois

Mass Classification in Mammogram with Semi-Supervised Relief Based Feature Selection

A Benign and Malignant Mass Classification Algorithm Based on an Improved Level Set Segmentation and Texture Feature Analysis

Detection of Medical Text Semantic Similarity Based on Convolutional Neural Network.

A New 3d Texture Feature Based Computer-Aided Diagnosis Approach to Differentiate Pulmonary Nodules