Abstract:PURPOSE:The bag of visual words (BoVW) model is a powerful tool for feature representation that can integrate various handcrafted features like intensity, texture, and spatial information. In this paper, we propose a novel BoVW-based method that incorporates texture and spatial information for the content-based image retrieval to assist radiologists in clinical diagnosis.METHODS:This paper presents a texture-specific BoVW method to represent focal liver lesions (FLLs). Pixels in the region of interest (ROI) are classified into nine texture categories using the rotation-invariant uniform local binary pattern method. The BoVW-based features are calculated for each texture category. In addition, a spatial cone matching (SCM)-based representation strategy is proposed to describe the spatial information of the visual words in the ROI. In a pilot study, eight radiologists with different clinical experience performed diagnoses for 20 cases with and without the top six retrieved results. A total of 132 multiphase computed tomography volumes including five pathological types were collected.RESULTS:The texture-specific BoVW was compared to other BoVW-based methods using the constructed dataset of FLLs. The results show that our proposed model outperforms the other three BoVW methods in discriminating different lesions. The SCM method, which adds spatial information to the orderless BoVW model, impacted the retrieval performance. In the pilot trial, the average diagnosis accuracy of the radiologists was improved from 66 to 80% using the retrieval system.CONCLUSION:The preliminary results indicate that the texture-specific features and the SCM-based BoVW features can effectively characterize various liver lesions. The retrieval system has the potential to improve the diagnostic accuracy and the confidence of the radiologists.

Medical Image Retrieval System Using Multiple Features from 3d Rois

Multistage and Multi-features Medical Image Retrieval System

A Retrieval System For 3d Multi-Phase Contrast-Enhanced Ct Images Of Focal Liver Lesions Based On Combined Bags Of Visual Words And Texture Words

Combined Density, Texture and Shape Features of Multi-phase Contrast-Enhanced CT Images for CBIR of Focal Liver Lesions: A Preliminary Study

Content-Based Retrieval of Focal Liver Lesions Using Geometrical and Textural Features of Multi-Phase CT-Scan Images

Research on Medical Image Retrieval System Based on DICOM Header Information and Content

Texture-based 3d image retrieval for medical applications

Texture-specific Bag of Visual Words Model and Spatial Cone Matching-Based Method for the Retrieval of Focal Liver Lesions Using Multiphase Contrast-Enhanced CT Images

Content-Based Retrieval Of 3d Medical Images

Content-Based Image Retrieval for Multi-Class Volumetric Radiology Images: A Benchmark Study

Design and implementation of content-based medical image retrieval system on mammograms

A New Way for Multidimensional Medical Data Management: Volume of Interest (VOI)-Based Retrieval of Medical Images With Visual and Functional Features

A Mapping Modelling of Visual Feature and Knowledge Representation Approach for Medical Image Retrieval

The Medical Image Retrieval Based On The Fuzzy Feature

Mutual Information Based Feature Selection for Medical Image Retrieval

3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology

Retrieval Of Brain Tumors By Adaptive Spatial Pooling And Fisher Vector Representation

Content-based Image Retrieval for Lung Nodule Classification Using Texture Features and Learned Distance Metric

Medicalimage Retrieval with Multiscale Features and Attention Mechanisms

A Tensor Sparse Representation-Based CBMIR System for Computer-Aided Diagnosis of Focal Liver Lesions and Its Pilot Trial.

Content-Based Image Retrieval Using Spatial Layout Information in Brain Tumor T1-Weighted Contrast-Enhanced MR Images