Abstract:PURPOSE:The bag of visual words (BoVW) model is a powerful tool for feature representation that can integrate various handcrafted features like intensity, texture, and spatial information. In this paper, we propose a novel BoVW-based method that incorporates texture and spatial information for the content-based image retrieval to assist radiologists in clinical diagnosis.METHODS:This paper presents a texture-specific BoVW method to represent focal liver lesions (FLLs). Pixels in the region of interest (ROI) are classified into nine texture categories using the rotation-invariant uniform local binary pattern method. The BoVW-based features are calculated for each texture category. In addition, a spatial cone matching (SCM)-based representation strategy is proposed to describe the spatial information of the visual words in the ROI. In a pilot study, eight radiologists with different clinical experience performed diagnoses for 20 cases with and without the top six retrieved results. A total of 132 multiphase computed tomography volumes including five pathological types were collected.RESULTS:The texture-specific BoVW was compared to other BoVW-based methods using the constructed dataset of FLLs. The results show that our proposed model outperforms the other three BoVW methods in discriminating different lesions. The SCM method, which adds spatial information to the orderless BoVW model, impacted the retrieval performance. In the pilot trial, the average diagnosis accuracy of the radiologists was improved from 66 to 80% using the retrieval system.CONCLUSION:The preliminary results indicate that the texture-specific features and the SCM-based BoVW features can effectively characterize various liver lesions. The retrieval system has the potential to improve the diagnostic accuracy and the confidence of the radiologists.

Texture feature extraction and description using fuzzy set of main dominant directions of variable scales in content-based medical image retrieval

Rough-fuzzy set approach for color and texture based image segmentation

Medical Image Retrieval Based on Nonlinear Texture Features

A multi-scale enhancement method to medical images based on fuzzy logic

A Retrieval System For 3d Multi-Phase Contrast-Enhanced Ct Images Of Focal Liver Lesions Based On Combined Bags Of Visual Words And Texture Words

Image Texture Clustering Based on Locality Preserving Projection

A Simple Texture Feature for Retrieval of Medical Images

Medical Image Retrieval Using Sift Feature

Spline Wavelets Based Texture Features For Image Retrieval

A Novel Medical Image Texture Retrieval Method By Dual-Tree Complex Wavelet Transform

Extracting volumes of interest (VOI) from 3D medical images using generalized fuzzy sets and rough sets

A new texture direction feature descriptor and its application in content-based image retrieval

A New Two-Step Method for Medical Image Retrieval

Texture feature extraction in the spatial-frequency domain for content-based image retrieval

Shape-based Shape Feature Extraction Using Wavelet Multi-Scale Analysis and Moment

Texture-specific Bag of Visual Words Model and Spatial Cone Matching-Based Method for the Retrieval of Focal Liver Lesions Using Multiphase Contrast-Enhanced CT Images

Texture image retrieval and similarity matching

EXTRACTION OF FUZZY BOUNDARY IN MEDICAL IMAGES

Image Retrieval Based on Multi-wavelet and Non-subsampled Contourlet Transform

A Study for Texture Feature Extraction of High-Resolution Satellite Images Based on a Direction Measure and Gray Level Co-Occurrence Matrix Fusion Algorithm

Self Organization Map based Texture Feature Extraction for Efficient Medical Image Categorization